音声・オーディオ

openai / whisper

Whisper は OpenAI による汎用音声認識モデルです。68 万時間の多様な音声データで訓練され、多言語音声認識、音声翻訳、言語識別を高精度で実行できます。

ggml-org / whisper.cpp

Port of OpenAI's Whisper model in C/C++

RVC-Boss / GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

CorentinJ / Real-Time-Voice-Cloning

Clone a voice in 5 seconds to generate arbitrary speech in real-time

coqui-ai / TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

mozilla / DeepSpeech

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.