🎛️ AUDIO · Voice & Speech Level: Beginner ⏱ 15 MIN Free & Open Source

Separate Stems, Remove Room Reverb & Make Key-Shifted Backing Tracks Offline with Audacity OpenVINO

Stop paying per track on web vocal removers. Install Intel’s free open-source OpenVINO AI plugins inside Audacity to split any song into 4 isolated stems (Vocals, Drums, Bass, Other) and suppress room noise 100% offline.

CORE TOOLS Audacity (Open Source), Intel OpenVINO AI Plugins (Open Source)

BEST FOR Singers, event performers, musicians learning songs by ear, video dubbing creators

REQUIREMENTS Windows or Linux PC (runs locally on CPU/iGPU/NPU); open-source Audacity

✦ WHY THIS WORKFLOW

Classic phase-cancellation vocal removal destroys center-panned bass and drums. Intel’s open-source OpenVINO plugin brings deep-learning 4-stem separation and neural denoising straight into Audacity for free.

✦ Interactive Workflow Animation Preview

Step-by-Step Action Checklist

0 / 4 Completed

✓ Step 1 [Enable Intel OpenVINO module in Audacity]: Install open-source Audacity and the `openvino-plugins-ai-audacity` package, then enable `mod-openvino` under `Preferences -> Modules`.
✓ Step 2 [Run 4-Stem Music Separation]: Select your song track and apply `Effect -> OpenVINO AI Effects -> OpenVINO Music Separation (4-Stem)` to split Vocals, Drums, Bass, and Other onto separate tracks.
✓ Step 3 [Transpose key without changing tempo]: Select the instrumental tracks and run `Effect -> Pitch and Tempo -> Change Pitch` with high-quality stretching enabled to shift +/- semitones.
✓ Step 4 [Apply AI Noise Suppression]: Record your own vocals and run `OpenVINO Noise Suppression` to strip fan noise and room reflections automatically.

READY-TO-USE PROMPT TEMPLATE

Open Official Tool / Repo ↗

I am using **Audacity + Intel OpenVINO AI plugins** to [goal: e.g., extract a clean backing track and transpose it down 2 semitones / strip movie dialogue while keeping ambient SFX and music for dubbing].
Provide:
1) EQ tips to clean up any faint high-frequency vocal bleed on the instrumental stem;
2) Safe semitone limits and high-quality pitch-shifting settings to preserve exact BPM;
3) Beginner vocal-mixing settings (Compressor, Reverb wet/dry %, and -14 LUFS loudness normalization) before exporting.

Use Cases & Tags:

Extracting clean karaoke backing tracks with custom key transpositionIsolating bass or drum stems for music transcriptionKeeping movie SFX while stripping dialogue for dubbingCleaning bedroom echo from podcast vocals#openvino

Related AI Workflows

← Describe your idea on Home

AUDIO · Voice & Speech

20 MIN

VoiceStudio: Fully Local Open-Source ElevenLabs Alternative for Instant Voice Cloning & Video Dubbing in 646 Languages

A sensational open-source, local-first ElevenLabs alternative boasting 89k+ GitHub stars! VoiceStudio eliminates subscription lock-in, per-character metering, and cloud data leaks. It unifies state-of-the-art open-source audio architectures (XTTS-v2, CosyVoice, F5-TTS, Chatterbox, Whisper, Kokoro) within an elegant local web interface. Featuring 3-second instant zero-shot voice cloning, cross-lingual voice transfer across 646 languages, emotional prosody control, and automated video dubbing with timeline sync. Optimized for CUDA and Apple Silicon MLX with zero external network dependencies.

VoiceStudio (Open Source)Python 3.10+PyTorch (CUDA / Apple Silicon MLX)Whisper

Best for: Video creators, cross-border localization teams, game developers, audiobook publishers, privacy-critical enterprise teams

Full guide ↗

AUDIO · Voice & Speech

10 MIN

Generate Full Vocal Songs & Arrangements Locally on 4GB Low-VRAM GPUs with ACE-Step 1.5

Say goodbye to costly Suno subscriptions and cloud queues. ACE-Step 1.5 is a breakthrough open-source local music generation engine distilled for low-resource hardware, running full vocal song composition on just 4GB VRAM. Specify genres (Pop, Folk, Rock, EDM), BPM, keys, and structured lyrics to synthesize broadcast-quality tracks with crisp lead vocals and arrangements in seconds.

ACE-Step 1.5 (Open Source)PythonPyTorchGradio WebUI

Best for: Indie musicians, YouTubers, game developers, commercial sound designers, music production enthusiasts

Full guide ↗

AUDIO · Voice & Speech

15 MIN

Turn Long-Form Articles into Realistic Multi-Speaker Dialogue Podcasts with SoulX-Podcast

Single-speaker TTS audiobooks often induce sleep. SoulX-Podcast is an open-source framework specifically engineered for multi-speaker dialogue podcasts. Input any article, research report, or document, and it synthesizes a natural banter script with two distinct voice personas—complete with spontaneous laughs, interruptions, sighs, and lively conversational cadence.

SoulX-Podcast (Open Source)DeepSeek / ClaudePythonPyTorch

Best for: Podcast hosts, newsletter writers, equity research analysts, storytellers, online educators

Full guide ↗

AUDIO · Voice & Speech

15 MIN

Design Custom Voices and Control Emotions with Natural Language Prompts via FireRedTTS

FireRedTTS by Xiaohongshu supports natural language voice design and granular emotional control. Describe any vocal persona in plain text (e.g. "a husky, sleepy midnight radio host") and inject fine-grained emotional tags (sigh, angry, cheerful) directly into specific dialogue phrases without needing any reference audio recordings.

FireRedTTS (Open Source)PythonPyTorchGradio

Best for: Video essayists, drama skit creators, indie game developers, animation directors, podcast producers

Full guide ↗

AUDIO · Voice & Speech

15 MIN

Zero-Shot Ultra-Realistic Voice Cloning across 30+ Languages & 9 Chinese Dialects with VoxCPM2

VoxCPM2 is an open-source end-to-end audio foundation model by Tsinghua and ModelBest. With just a few seconds of reference audio, it achieves zero-shot cloning across 30+ global languages and 9 Chinese dialects (Cantonese, Sichuanese, Minnan, Wu, etc.) with lifelike breathing, natural pauses, and emotional nuances.

VoxCPM2 (Open Source)PythonPyTorchGradio WebUI

Best for: Content creators, cross-border marketers, game audio designers, audiobook narrators, cultural preservationists

Full guide ↗

AUDIO · Voice & Speech

15 MIN

Run 70x Real-Time Speech Transcription with Word-Level Timestamps & Diarization via Open-Source WhisperX

Vanilla Whisper suffers from timestamp drift, silence hallucinations and slow sequential decoding. Use Oxford’s open-source WhisperX (15k+ GitHub stars) combining batched Faster-Whisper, Wav2Vec2 phoneme forced alignment and PyAnnote speaker diarization for 70x real-time transcription with exact word-level timestamps.

WhisperX (Oxford Open Source)Wav2Vec2 Alignment ModelPyAnnote Audio

Best for: Short-video editors, podcasters, subtitle teams, researchers

Full guide ↗