AI/AIZENME
📻 AUDIO · Voice & Speech Level: Beginner ⏱ 25 MIN Free & Open Source

Self-Host Open-Source Audiobookshelf with Whisper Synced LRC Subtitles for Podcasts & Audiobooks

Standard music players lose your place inside 20-hour audiobooks. Deploy open-source `Audiobookshelf` via Docker for multi-device progress sync, automatic podcast RSS downloading, and Whisper-powered `.lrc`/`.srt` synchronized scrolling transcripts.

CORE TOOLS Audiobookshelf (Open Source), Docker, Faster-Whisper LRC Generator
BEST FOR Audiobook listeners, language learners, podcast archivers, NAS homelabbers
REQUIREMENTS PC or NAS running Docker; local audio storage
✦ WHY THIS WORKFLOW

Music apps treat 30-hour audiobooks like 3-minute songs, losing your progress and shuffling chapters. Audiobookshelf gives you dedicated chapter memory, RSS podcast archiving, and Whisper read-along transcripts.

✦ Interactive Workflow Animation Preview

Step-by-Step Action Checklist

0 / 4 Completed
READY-TO-USE PROMPT TEMPLATE
Open Official Tool / Repo ↗ 
I self-host **Audiobookshelf** in Docker and want to automatically generate synchronized scrolling transcripts for my audiobooks (`.m4b`/`.mp3`) and podcasts.
Provide:
1) A clean `docker-compose.yml` for `audiobookshelf`;
2) A Python script using `faster-whisper` (with `vad_filter=True` to prevent timestamp drift during chapter pauses) that recursively scans `/audiobooks`, skips files that already have subtitles, and writes sidecar `.srt` and `.lrc` files recognized natively by Audiobookshelf.
Use Cases & Tags:
Self-hosted family audiobook and audio drama streaming serverListening to English audiobooks with live scrolling Whisper transcriptsAuto-archiving favorite podcast RSS feeds before episodes get deletedSeamless playback position sync between webiOS/Android and CarPlay#audiobookshelf
MORE

Related AI Workflows

← Describe your idea on Home
AUDIO · Voice & Speech
20 MIN

VoiceStudio: Fully Local Open-Source ElevenLabs Alternative for Instant Voice Cloning & Video Dubbing in 646 Languages

A sensational open-source, local-first ElevenLabs alternative boasting 89k+ GitHub stars! VoiceStudio eliminates subscription lock-in, per-character metering, and cloud data leaks. It unifies state-of-the-art open-source audio architectures (XTTS-v2, CosyVoice, F5-TTS, Chatterbox, Whisper, Kokoro) within an elegant local web interface. Featuring 3-second instant zero-shot voice cloning, cross-lingual voice transfer across 646 languages, emotional prosody control, and automated video dubbing with timeline sync. Optimized for CUDA and Apple Silicon MLX with zero external network dependencies.

VoiceStudio (Open Source)Python 3.10+PyTorch (CUDA / Apple Silicon MLX)Whisper
Best for: Video creators, cross-border localization teams, game developers, audiobook publishers, privacy-critical enterprise teams
Full guide ↗
AUDIO · Voice & Speech
10 MIN

Generate Full Vocal Songs & Arrangements Locally on 4GB Low-VRAM GPUs with ACE-Step 1.5

Say goodbye to costly Suno subscriptions and cloud queues. ACE-Step 1.5 is a breakthrough open-source local music generation engine distilled for low-resource hardware, running full vocal song composition on just 4GB VRAM. Specify genres (Pop, Folk, Rock, EDM), BPM, keys, and structured lyrics to synthesize broadcast-quality tracks with crisp lead vocals and arrangements in seconds.

ACE-Step 1.5 (Open Source)PythonPyTorchGradio WebUI
Best for: Indie musicians, YouTubers, game developers, commercial sound designers, music production enthusiasts
Full guide ↗
AUDIO · Voice & Speech
15 MIN

Turn Long-Form Articles into Realistic Multi-Speaker Dialogue Podcasts with SoulX-Podcast

Single-speaker TTS audiobooks often induce sleep. SoulX-Podcast is an open-source framework specifically engineered for multi-speaker dialogue podcasts. Input any article, research report, or document, and it synthesizes a natural banter script with two distinct voice personas—complete with spontaneous laughs, interruptions, sighs, and lively conversational cadence.

SoulX-Podcast (Open Source)DeepSeek / ClaudePythonPyTorch
Best for: Podcast hosts, newsletter writers, equity research analysts, storytellers, online educators
Full guide ↗
AUDIO · Voice & Speech
15 MIN

Design Custom Voices and Control Emotions with Natural Language Prompts via FireRedTTS

FireRedTTS by Xiaohongshu supports natural language voice design and granular emotional control. Describe any vocal persona in plain text (e.g. "a husky, sleepy midnight radio host") and inject fine-grained emotional tags (sigh, angry, cheerful) directly into specific dialogue phrases without needing any reference audio recordings.

FireRedTTS (Open Source)PythonPyTorchGradio
Best for: Video essayists, drama skit creators, indie game developers, animation directors, podcast producers
Full guide ↗
AUDIO · Voice & Speech
15 MIN

Zero-Shot Ultra-Realistic Voice Cloning across 30+ Languages & 9 Chinese Dialects with VoxCPM2

VoxCPM2 is an open-source end-to-end audio foundation model by Tsinghua and ModelBest. With just a few seconds of reference audio, it achieves zero-shot cloning across 30+ global languages and 9 Chinese dialects (Cantonese, Sichuanese, Minnan, Wu, etc.) with lifelike breathing, natural pauses, and emotional nuances.

VoxCPM2 (Open Source)PythonPyTorchGradio WebUI
Best for: Content creators, cross-border marketers, game audio designers, audiobook narrators, cultural preservationists
Full guide ↗
AUDIO · Voice & Speech
15 MIN

Run 70x Real-Time Speech Transcription with Word-Level Timestamps & Diarization via Open-Source WhisperX

Vanilla Whisper suffers from timestamp drift, silence hallucinations and slow sequential decoding. Use Oxford’s open-source WhisperX (15k+ GitHub stars) combining batched Faster-Whisper, Wav2Vec2 phoneme forced alignment and PyAnnote speaker diarization for 70x real-time transcription with exact word-level timestamps.

WhisperX (Oxford Open Source)Wav2Vec2 Alignment ModelPyAnnote Audio
Best for: Short-video editors, podcasters, subtitle teams, researchers
Full guide ↗