nanoloop banner

nanoloop

1 devlog
1h 41m 12s

Small Python-based agent loop for nano local models!
Designed to run with local models on a Pi 5!

Access to web search & terminal tools and runs in an agentic loop!

This project uses AI

I used Gemini to help me with writing tool call definitions and using the OpenAI API to get responses.

Demo Repository

Loading README...

nirvaannn

I made the app, starting with Python!

  • Tested the OpenAI SDK with llama.cpp
  • Added a loop
  • Created tools (web search with DDGS, terminal commands)
  • Added token tracking
  • Used a smaller sub-model to aid in search summarization

What did I learn along the way?

  • Subprocess and Python-based process management
  • Streaming LLM responses

🎬 Video processing — check back later!

0