Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

YuE: Open Full-song Music Generation Foundation Model, something similar to Suno.ai but open

A framework for efficient model inference with omni-modality models

AudioLDM: Generate speech, sound effects, music and beyond, with text.

Text-to-Audio/Music Generation

Audio generation using diffusion models, in PyTorch.

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

A fundamental toolkit designed for music, song, and audio generation

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

A family of diffusion models for text-to-audio generation.

Official PyTorch implementation of BigVGAN (ICLR 2023)

A ComfyUI custom node integration for local multi-engine multi-language Text-to-Speech and Voice Conversion. Supports: RVC, Echo-TTS, Qwen3-TTS, Cozy Voice 3, Step Audio EditX, IndexTTS-2, Chatterbox (classic and multilingual), F5-TTS, Higgs Audio 2, 3, and VibeVoice with unlimited text length, SRT timing, Character support, and many audio tools

Official CLI for muapi.ai — generate images, videos & audio from the terminal. MCP server, 14 AI models, npm + pip installable.

The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.

Real-time voice assistant — WebRTC streaming, faster-whisper ASR, local LLM, Vui Nano (300M) TTS. OpenAI Realtime API compatible. Voice cloning, barge-in, ~9× realtime on a 4090. Apache 2.0.

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music generation et.al.

An Open-Source Project to Unify Audio Processing and Generation

[ICLR 2026] Official implementation of JavisDiT and JavisDiT++ series.