Raspberry Pi 5 local voice assistant

A voice assistant powered by Raspberry Pi 5, working completely offline!

Uses VOSK for speech-to-text, llama.cpp for LLM processing, and KittenTTS to speak!

Built in an AIY voice kit.

This project uses AI

I used AI to help me convert from Ollama to llama.cpp

Demo Repository

nirvaannn worked on Raspberry Pi 5 local voice assistant

9 days ago

0h 26m logged

I added a GitHub action to compile it into a pyinstaller binary (with help from Gemini)

nirvaannn worked on Raspberry Pi 5 local voice assistant

10 days ago

0h 16m logged

I experimented with the Kakao KANANA and LG EXAONE LLMs, as they’ve worked well in the past.

They are VERY fast even at high quantizations, but lose some world knowledge compared to Gemma3n or Phi4-mini.

nirvaannn worked on Raspberry Pi 5 local voice assistant

10 days ago

0h 26m logged

What have i done since then?

nirvaannn worked on Raspberry Pi 5 local voice assistant

29 days ago

0h 16m logged

Experimented with different models in llama.cpp and found Gemma 3n e2B to be the best balance of performance to world knowledge

0 Followers