Any speech to text library that uses whisper api?

So I have the api working as in I can send audio files and get text back but what I am looking for is a robust way to have streaming functionality. For example, if there is a small duration of silence it should stop recording and send the audio to api etc.

Is there any such library in python?

19 points · 5 comments · view on lemmy.world

5 Comments

Sims@lemmy.ml · 4 pts · 2y (2 replies)

Dunno, but this guy (all about ai) builds one with 'faster-whisper', so perhaps you can get a few pointers there? I believe he chunks the Audio on silence. He have a few other speech2x videos. Have fun. https://youtu.be/k6nIxWGdrS4

Also: https://github.com/SYSTRAN/faster-whisper

Sims@lemmy.ml · 3 pts · 2y

Just stumbled upon this speedy one: https://github.com/sanchit-gandhi/whisper-jax

And this one for word precision time marks: https://github.com/m-bain/whisperX

PipedLinkBot@feddit.rocks · 2 pts · 2y

Here is an alternative Piped link(s):

https://piped.video/k6nIxWGdrS4

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.

k110111@feddit.de · 3 pts · 2y

I found this so far: https://github.com/KoljaB/RealtimeSTT

Maybe I can modify it to use whisper api.

paf@jlai.lu · 3 pts · 2y

Don't have knowledge to answer your question but you could check how home assistant does it, I think that should point you to the right direction.