Whisper Ecosystem
Whisper is an autoregressive language model developed by OpenAI. It is trained on a large corpus of text using a transformer architecture and is capable of generating high-quality natural language text. Whisper can be used for tasks such as language modeling, text completion, and text generation. It has shown impressive performance on various benchmarks and has been released by OpenAI to encourage research in the field of language modeling. Whisper is not yet available for public use, but it has the potential to transform the field of natural language processing and generate new opportunities for language-based applications.
Keywords
Languages
whisperX
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
whisper-diarization
Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper
WhisperKit
Swift native on-device speech recognition with Whisper for Apple Silicon
PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting
whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
whisper-ctranslate2
Whisper command line client compatible with original OpenAI client based on CTranslate2
FunASR
A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc
use-whisper
React hook for OpenAI Whisper with speech recorder, real-time transcription, and silence removal built-in
inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code
