1
huggingface / transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
View huggingface/transformersTrending open-source projects · updated daily
Trending AI Audio Projects
The audio board covers speech and sound: speech recognition, text-to-speech, voice cloning and conversion, music generation, source separation, transcription and general audio DSP. It is assembled from GitHub topic pages for text-to-speech, speech recognition and music generation and ranked by stars, which makes it a quick snapshot of where the open-source voice stack stands — long-standing toolkits next to this year's model releases. Every entry lists language, stars and forks and opens a detail page with description, license, last push date, README and related audio projects. For anyone wiring voice into a product or processing recordings at scale, the activity dates matter as much as the star counts.
Trending AI Audio Projects
2
harry0703 / MoneyPrinterTurbo
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
View harry0703/MoneyPrinterTurbo3
unslothai / unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
View unslothai/unsloth4
RVC-Boss / GPT-SoVITS
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
View RVC-Boss/GPT-SoVITS5
calesthio / OpenMontage
World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files.
View calesthio/OpenMontage6
→7
coqui-ai / TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
View coqui-ai/TTS8
→9
OpenBMB / VoxCPM
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
View OpenBMB/VoxCPM10
myshell-ai / OpenVoice
Instant voice cloning by MIT and MyShell. Audio foundation model.
View myshell-ai/OpenVoice11
babysor / MockingBird
🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time
View babysor/MockingBird12
debpalash / VoiceStudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
View debpalash/VoiceStudio13
mozilla / DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
View mozilla/DeepSpeech14
→15
m-bain / whisperX
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
View m-bain/whisperX16
index-tts / index-tts
An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
View index-tts/index-tts17
QwenAudio / CosyVoice
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
View QwenAudio/CosyVoice18
modelscope / FunASR
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
View modelscope/FunASR19
nari-labs / dia
A TTS model capable of generating ultra-realistic dialogue in one pass.
View nari-labs/dia20
jianchang512 / pyvideotrans
Translate the video from one language to another and embed dubbing & subtitles.
View jianchang512/pyvideotrans21
→22
kaldi-asr / kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.
View kaldi-asr/kaldi23
alphacep / vosk-api
Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
View alphacep/vosk-api24
NVIDIA / DeepLearningExamples
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
View NVIDIA/DeepLearningExamples25
k2-fsa / sherpa-onnx
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection.
View k2-fsa/sherpa-onnx26
supertone-oss-archive / supertonic
Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.
View supertone-oss-archive/supertonic27
kmario23 / deep-learning-drizzle
Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!
View kmario23/deep-learning-drizzle28
abus-aikorea / voice-pro
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download
View abus-aikorea/voice-pro29
PaddlePaddle / PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System
View PaddlePaddle/PaddleSpeech30
rany2 / edge-tts
Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge or Windows or an API key
View rany2/edge-tts31
→32
→33
QuentinFuxa / WhisperLiveKit
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
View QuentinFuxa/WhisperLiveKit34
openvinotoolkit / openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
View openvinotoolkit/openvino35
open-mmlab / Amphion
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio
View open-mmlab/Amphion36
mozilla / TTS
🤖 💬 Deep learning for Text to Speech (Discussion forum: https://discourse.mozilla.org/c/tts)
View mozilla/TTS37
→38
QwenAudio / SenseVoice
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
View QwenAudio/SenseVoice39
multimodal-art-projection / YuE
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
View multimodal-art-projection/YuE40
Uberi / speech_recognition
Speech recognition module for Python, supporting several engines and APIs, online and offline.
View Uberi/speech_recognition41
MITDeepLearning / introtodeeplearning
Lab Materials for MIT 6.S191: Introduction to Deep Learning
View MITDeepLearning/introtodeeplearning42
netease-youdao / EmotiVoice
EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine
View netease-youdao/EmotiVoice43
nl8590687 / ASRT_SpeechRecognition
A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统
View nl8590687/ASRT_SpeechRecognition44
Plachtaa / VALL-E-X
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/
View Plachtaa/VALL-E-X45
Blaizzy / mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
View Blaizzy/mlx-audio46
jaywalnut310 / vits
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
View jaywalnut310/vits47
myshell-ai / MeloTTS
High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.
View myshell-ai/MeloTTS48
espeak-ng / espeak-ng
eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.
View espeak-ng/espeak-ng49
→50
Osmantic / ODS
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
View Osmantic/ODS51
flashlight / wav2letter
Facebook AI Research's Automatic Speech Recognition Toolkit
View flashlight/wav2letter52
→53
yl4579 / StyleTTS2
StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
View yl4579/StyleTTS254
promptslab / Awesome-Prompt-Engineering
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
View promptslab/Awesome-Prompt-Engineering55
modelscope / FunClip
FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.
View modelscope/FunClip56
→57
snakers4 / silero-models
Silero Models: pre-trained text-to-speech models made embarrassingly simple
View snakers4/silero-models58
denizsafak / abogen
Generate audiobooks from EPUBs, PDFs and text with synchronized captions.
View denizsafak/abogen59
dograh-hq / dograh
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
View dograh-hq/dograh60
MahmoudAshraf97 / whisper-diarization
Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper
View MahmoudAshraf97/whisper-diarization61
liuzhao1225 / YouDub-webui
Open-source AI video localization and dubbing for YouTube/Bilibili: speech recognition, subtitle translation, voice cloning, audio mixing and rendering. 开源 AI 视频翻译配音工具。
View liuzhao1225/YouDub-webui62
remsky / Kokoro-FastAPI
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI
View remsky/Kokoro-FastAPI63
wenet-e2e / wenet
Production First and Production Ready End-to-End Speech Recognition Toolkit
View wenet-e2e/wenet64
Picovoice / porcupine
On-device wake word detection powered by deep learning
View Picovoice/porcupine65
yanshengjia / ml-road
Machine Learning and Agentic AI Resources, Practice and Research
View yanshengjia/ml-road66
fspecii / ace-step-ui
🎵 The Ultimate Open Source Suno Alternative - Professional UI for ACE-Step 1.5 AI Music Generation. Free, local, unlimited. Stop paying for Suno!
View fspecii/ace-step-ui67
MoonInTheRiver / DiffSinger
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code
View MoonInTheRiver/DiffSinger68
jianchang512 / stt
Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具，输出json、srt字幕、纯文字格式
View jianchang512/stt69
sanchit-gandhi / whisper-jax
JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
View sanchit-gandhi/whisper-jax70
→71
crmne / ruby_llm
The Ruby-native AI framework. Chats, agents, tools, images, audio, and video through one consistent API, in plain Ruby or Rails.
View crmne/ruby_llm72
OpenMOSS / MOSS-TTS-Nano
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
View OpenMOSS/MOSS-TTS-Nano73
→74
→75
metavoiceio / metavoice-src
Foundational model for human-like, expressive TTS
View metavoiceio/metavoice-src76
huggingface / distil-whisper
Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
View huggingface/distil-whisper77
OpenMOSS / MOSS-TTS
An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
View OpenMOSS/MOSS-TTS78
→79
TensorSpeech / TensorFlowTTS
😝 TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
View TensorSpeech/TensorFlowTTS80
IAHispano / Applio
A simple, high-quality voice conversion tool focused on ease of use and performance.
View IAHispano/Applio81
ahmetoner / whisper-asr-webservice
OpenAI Whisper ASR Webservice API
View ahmetoner/whisper-asr-webservice82
rsxdalv / TTS-WebUI
A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet
View rsxdalv/TTS-WebUI83
Purfview / whisper-standalone-win
Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.
View Purfview/whisper-standalone-win84
zzw922cn / awesome-speech-recognition-speech-synthesis-papers
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
View zzw922cn/awesome-speech-recognition-speech-synthesis-papers85
chenyme / Chenyme-AAVT
这是一个全自动（音频）视频翻译项目。利用Whisper识别声音，AI大模型翻译字幕，最后合并字幕视频，生成翻译后的视频。
View chenyme/Chenyme-AAVT86
AutoArk / GPA
[AutoArk] GPA (General Purpose Audio) can do ASR, TTS and voice conversion with one tiny model!
View AutoArk/GPA87
HeyWillow / willow
Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative
View HeyWillow/willow88
elevenlabs / elevenlabs-python
The official Python SDK for the ElevenLabs API.
View elevenlabs/elevenlabs-python89
pluja / whishper
Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!
View pluja/whishper90
→91
readbeyond / aeneas
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
View readbeyond/aeneas92
→93
linto-ai / whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
View linto-ai/whisper-timestamped94
zzw922cn / Automatic_Speech_Recognition
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
View zzw922cn/Automatic_Speech_Recognition95
→96
0xShug0 / audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance.
View 0xShug0/audio.cpp97
→98
QwenAudio / qwen-audio-agent
A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents
View QwenAudio/qwen-audio-agent99
pndurette / gTTS
Python library and CLI tool to interface with Google Translate's text-to-speech API
View pndurette/gTTS100
coqui-ai / STT
🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.
View coqui-ai/STTSpeech Recognition & Voice AI
- RVC-Boss/GPT-SoVITS — ★ 61,795
- ggml-org/whisper.cpp — ★ 53,692
- coqui-ai/TTS — ★ 46,016
- 2noise/ChatTTS — ★ 39,845
- OpenBMB/VoxCPM — ★ 37,599
- myshell-ai/OpenVoice — ★ 37,532
- babysor/MockingBird — ★ 36,907
- debpalash/VoiceStudio — ★ 31,260
Text-to-Speech & Voice Cloning
- index-tts/index-tts — ★ 23,995
- modelscope/FunASR — ★ 20,357
- nari-labs/dia — ★ 19,400
- k2-fsa/sherpa-onnx — ★ 14,789
- supertone-oss-archive/supertonic — ★ 13,778
- abus-aikorea/voice-pro — ★ 12,830
- PaddlePaddle/PaddleSpeech — ★ 12,685
- rany2/edge-tts — ★ 11,952
Music & Audio Generation Tools
- huggingface/transformers — ★ 166,221
- QwenAudio/CosyVoice — ★ 23,633
- open-mmlab/Amphion — ★ 10,295
- QwenAudio/SenseVoice — ★ 9,315
- multimodal-art-projection/YuE — ★ 9,061
- Blaizzy/mlx-audio — ★ 7,894
- denizsafak/abogen — ★ 6,011
- liuzhao1225/YouDub-webui — ★ 5,485
More AI Trending Projects
1
→2
→3
→4
→5
→6
→