1
huggingface / transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
View huggingface/transformersTrending open-source projects · updated daily
Trending AI Audio Projects
The audio board covers speech and sound: speech recognition, text-to-speech, voice cloning and conversion, music generation, source separation, transcription and general audio DSP. It is assembled from GitHub topic pages for text-to-speech, speech recognition and music generation and ranked by stars, which makes it a quick snapshot of where the open-source voice stack stands — long-standing toolkits next to this year's model releases. Every entry lists language, stars and forks and opens a detail page with description, license, last push date, README and related audio projects. For anyone wiring voice into a product or processing recordings at scale, the activity dates matter as much as the star counts.
Trending AI Audio Projects
2
harry0703 / MoneyPrinterTurbo
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
View harry0703/MoneyPrinterTurbo3
debpalash / VoiceStudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
View debpalash/VoiceStudio4
unslothai / unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
View unslothai/unsloth5
calesthio / OpenMontage
World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files.
View calesthio/OpenMontage6
RVC-Boss / GPT-SoVITS
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
View RVC-Boss/GPT-SoVITS7
→8
coqui-ai / TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
View coqui-ai/TTS9
OpenBMB / VoxCPM
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
View OpenBMB/VoxCPM10
→11
myshell-ai / OpenVoice
Instant voice cloning by MIT and MyShell. Audio foundation model.
View myshell-ai/OpenVoice12
babysor / MockingBird
🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time
View babysor/MockingBird13
mozilla / DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
View mozilla/DeepSpeech14
→15
m-bain / whisperX
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
View m-bain/whisperX16
index-tts / index-tts
An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
View index-tts/index-tts17
QwenAudio / CosyVoice
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
View QwenAudio/CosyVoice18
modelscope / FunASR
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
View modelscope/FunASR19
jianchang512 / pyvideotrans
Translate the video from one language to another and embed dubbing & subtitles.
View jianchang512/pyvideotrans20
nari-labs / dia
A TTS model capable of generating ultra-realistic dialogue in one pass.
View nari-labs/dia21
→22
k2-fsa / sherpa-onnx
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection.
View k2-fsa/sherpa-onnx23
kaldi-asr / kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.
View kaldi-asr/kaldi24
alphacep / vosk-api
Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
View alphacep/vosk-api25
NVIDIA / DeepLearningExamples
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
View NVIDIA/DeepLearningExamples26
supertone-oss-archive / supertonic
Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.
View supertone-oss-archive/supertonic27
abus-aikorea / voice-pro
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download
View abus-aikorea/voice-pro28
kmario23 / deep-learning-drizzle
Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!
View kmario23/deep-learning-drizzle29
multimodal-art-projection / YuE
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
View multimodal-art-projection/YuE30
PaddlePaddle / PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System
View PaddlePaddle/PaddleSpeech31
rany2 / edge-tts
Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge
View rany2/edge-tts32
→33
→34
QuentinFuxa / WhisperLiveKit
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
View QuentinFuxa/WhisperLiveKit35
openvinotoolkit / openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
View openvinotoolkit/openvino36
open-mmlab / Amphion
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio
View open-mmlab/Amphion37
mozilla / TTS
🤖 💬 Deep learning for Text to Speech (Discussion forum: https://discourse.mozilla.org/c/tts)
View mozilla/TTS38
lemomo-ai / lemo-opuscar
A toolbox of film styles made in code for Claude Code: 66 ready to use, and your own. Each style is a style prompt plus a demo film made entirely in code by Claude Opus 5.5, with no video model.
View lemomo-ai/lemo-opuscar39
→40
QwenAudio / SenseVoice
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
View QwenAudio/SenseVoice41
Uberi / speech_recognition
Speech recognition module for Python, supporting several engines and APIs, online and offline.
View Uberi/speech_recognition42
MITDeepLearning / introtodeeplearning
Lab Materials for MIT 6.S191: Introduction to Deep Learning
View MITDeepLearning/introtodeeplearning43
netease-youdao / EmotiVoice
EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine
View netease-youdao/EmotiVoice44
nl8590687 / ASRT_SpeechRecognition
A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统
View nl8590687/ASRT_SpeechRecognition45
Blaizzy / mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
View Blaizzy/mlx-audio46
Plachtaa / VALL-E-X
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/
View Plachtaa/VALL-E-X47
jaywalnut310 / vits
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
View jaywalnut310/vits48
Osmantic / ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
View Osmantic/ODS49
myshell-ai / MeloTTS
High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.
View myshell-ai/MeloTTS50
espeak-ng / espeak-ng
eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.
View espeak-ng/espeak-ng51
→52
modelscope / FunClip
FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.
View modelscope/FunClip53
flashlight / wav2letter
Facebook AI Research's Automatic Speech Recognition Toolkit
View flashlight/wav2letter54
→55
promptslab / Awesome-Prompt-Engineering
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
View promptslab/Awesome-Prompt-Engineering56
yl4579 / StyleTTS2
StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
View yl4579/StyleTTS257
→58
denizsafak / abogen
Generate audiobooks from EPUBs, PDFs and text with synchronized captions.
View denizsafak/abogen59
snakers4 / silero-models
Silero Models: pre-trained text-to-speech models made embarrassingly simple
View snakers4/silero-models60
dograh-hq / dograh
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
View dograh-hq/dograh61
liuzhao1225 / YouDub-webui
Open-source AI video localization and dubbing for YouTube/Bilibili: speech recognition, subtitle translation, voice cloning, audio mixing and rendering. 开源 AI 视频翻译配音工具。
View liuzhao1225/YouDub-webui62
MahmoudAshraf97 / whisper-diarization
Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper
View MahmoudAshraf97/whisper-diarization63
remsky / Kokoro-FastAPI
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI
View remsky/Kokoro-FastAPI64
wenet-e2e / wenet
Production First and Production Ready End-to-End Speech Recognition Toolkit
View wenet-e2e/wenet65
fspecii / ace-step-ui
🎵 The Ultimate Open Source Suno Alternative - Professional UI for ACE-Step 1.5 AI Music Generation. Free, local, unlimited. Stop paying for Suno!
View fspecii/ace-step-ui66
Picovoice / porcupine
On-device wake word detection powered by deep learning
View Picovoice/porcupine67
yanshengjia / ml-road
Machine Learning and Agentic AI Resources, Practice and Research
View yanshengjia/ml-road68
MoonInTheRiver / DiffSinger
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code
View MoonInTheRiver/DiffSinger69
AhmadHassan-BTed / B
An autonomous, context-aware AI desktop companion. Built with Python, featuring real-time screen vision, custom ONNX voice synthesis, active window tracking
View AhmadHassan-BTed/B70
jianchang512 / stt
Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具，输出json、srt字幕、纯文字格式
View jianchang512/stt71
sanchit-gandhi / whisper-jax
JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
View sanchit-gandhi/whisper-jax72
→73
OpenMOSS / MOSS-TTS-Nano
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
View OpenMOSS/MOSS-TTS-Nano74
→75
→76
OpenMOSS / MOSS-TTS
An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
View OpenMOSS/MOSS-TTS77
metavoiceio / metavoice-src
Foundational model for human-like, expressive TTS
View metavoiceio/metavoice-src78
huggingface / distil-whisper
Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
View huggingface/distil-whisper79
→80
TensorSpeech / TensorFlowTTS
😝 TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
View TensorSpeech/TensorFlowTTS81
IAHispano / Applio
A simple, high-quality voice conversion tool focused on ease of use and performance.
View IAHispano/Applio82
0xShug0 / audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance.
View 0xShug0/audio.cpp83
ahmetoner / whisper-asr-webservice
OpenAI Whisper ASR Webservice API
View ahmetoner/whisper-asr-webservice84
rsxdalv / TTS-WebUI
A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet
View rsxdalv/TTS-WebUI85
Purfview / whisper-standalone-win
Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.
View Purfview/whisper-standalone-win86
elevenlabs / elevenlabs-python
The official Python SDK for the ElevenLabs API.
View elevenlabs/elevenlabs-python87
zzw922cn / awesome-speech-recognition-speech-synthesis-papers
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
View zzw922cn/awesome-speech-recognition-speech-synthesis-papers88
chenyme / Chenyme-AAVT
这是一个全自动（音频）视频翻译项目。利用Whisper识别声音，AI大模型翻译字幕，最后合并字幕视频，生成翻译后的视频。
View chenyme/Chenyme-AAVT89
HeyWillow / willow
Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative
View HeyWillow/willow90
QwenAudio / qwen-audio-agent
A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents
View QwenAudio/qwen-audio-agent91
pluja / whishper
Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!
View pluja/whishper92
AutoArk / GPA
[AutoArk] GPA (General Purpose Audio) can do ASR, TTS and voice conversion with one tiny model!
View AutoArk/GPA93
pnnbao97 / VieNeu-TTS
Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 48kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng Việt • TTS tiếng Việt
View pnnbao97/VieNeu-TTS94
→95
readbeyond / aeneas
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
View readbeyond/aeneas96
→97
linto-ai / whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
View linto-ai/whisper-timestamped98
zzw922cn / Automatic_Speech_Recognition
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
View zzw922cn/Automatic_Speech_Recognition99
→100
→Speech Recognition & Voice AI
- debpalash/VoiceStudio — ★ 96,661
- RVC-Boss/GPT-SoVITS — ★ 64,414
- ggml-org/whisper.cpp — ★ 54,826
- coqui-ai/TTS — ★ 46,175
- OpenBMB/VoxCPM — ★ 40,911
- 2noise/ChatTTS — ★ 39,963
- myshell-ai/OpenVoice — ★ 38,115
- babysor/MockingBird — ★ 36,882
Text-to-Speech & Voice Cloning
- index-tts/index-tts — ★ 24,844
- modelscope/FunASR — ★ 20,895
- nari-labs/dia — ★ 19,408
- k2-fsa/sherpa-onnx — ★ 15,648
- supertone-oss-archive/supertonic — ★ 13,757
- abus-aikorea/voice-pro — ★ 13,386
- PaddlePaddle/PaddleSpeech — ★ 12,702
- rany2/edge-tts — ★ 12,427
Music & Audio Generation Tools
- huggingface/transformers — ★ 168,393
- QwenAudio/CosyVoice — ★ 24,213
- multimodal-art-projection/YuE — ★ 12,941
- open-mmlab/Amphion — ★ 10,328
- QwenAudio/SenseVoice — ★ 9,645
- Blaizzy/mlx-audio — ★ 8,167
- denizsafak/abogen — ★ 6,180
- liuzhao1225/YouDub-webui — ★ 5,785
More AI Trending Projects
1
→2
→3
→4
→5
→6
→