nanoloop banner

nanoloop

Created by: nirvaannn
2 devlogs
1h 59m 29s

Small Python-based agent loop for nano local models!
Designed to run with local models on a Pi 5!

Access to web search & terminal tools and runs in an agentic loop!

This project uses AI

I used Gemini to help me with writing tool call definitions and using the OpenAI API to get responses.

Demo Repository

README

Loading README...
nirvaannn
nirvaannn worked on nanoloop
6 days ago
0h 18m logged

What did I do today:

  • Replaced the 2 small models with 1 big model
  • Simplified the shell tool user print so it only shows the base command
Attachment
0
nirvaannn
nirvaannn worked on nanoloop
11 days ago
1h 41m logged

I made the app, starting with Python!

  • Tested the OpenAI SDK with llama.cpp
  • Added a loop
  • Created tools (web search with DDGS, terminal commands)
  • Added token tracking
  • Used a smaller sub-model to aid in search summarization

What did I learn along the way?

  • Subprocess and Python-based process management
  • Streaming LLM responses

🎬 Video processing — check back later!

0