#Local Inference (2)

audio.cpp: One C++ Runtime for 110+ Local Audio Models

A ggml-based pure C++ audio inference framework that pulls 110+ model families (TTS, voice cloning, voice conversion, speech recognition, diarization, VAD, source separation, codecs and music generation) into one native runtime with CUDA, HIP, Vulkan, Metal and CPU backends, entered through a CLI, an OpenAI-style server, an embedded WebUI and JSON pipelines; same-machine comparisons against Python reference paths show 1.8x to 5x on several TTS routes and up to 37% lower peak VRAM with Q8 packages.