My Journey to a reliable and enjoyable locally hosted voice assistant

https://community.home-assistant.io/t/my-journey-to-a-reliable-and-enjoyable-locally-hosted-voice-assistant/944860

62 points · 4 comments · view on lemmy.world

4 Comments

lowspeedchase@lemmy.dbzer0.com · 14 pts · 167d (1 reply)

Good read!

"...but I eventually found the brilliant llm-intents integration..."

immediately followed by this:

"...the results were mediocre."

made me chuckle though. I'll probably jump in this pool once we achieve better performace/response times - both the silence and the idle dialog during that 2-5 seconds are maddening to me. I do not need loading screens irl.

marduk@lemmy.sdf.org · 1 pts · 166d

avidamoeba@lemmy.ca · 5 pts · 167d

This is something I'm going for too. Currently just running Ollama integration with HA for voice control but I'd be moving STT/TTS locally too. The new Qwen 3.5 35B loads fairly quickly and responds quickly enough to be usable for conversation on my system. The 9B version is extremely fast and adequate for voice control.

4lan@lemmy.world · 1 pts · 160d

Maybe I'm dumb but I tried to do this a few months ago and it was horrible. Couldn't do simple things unless I said the exactly perfect name of entities. Even then took forever to do anything