Writing · Tag

#local LLM

3 posts tagged #local LLM.

Jun 30, 20265 min read
How to Run Local LLM Verifier Loops on Owned Hardware
A local LLM workflow needs more than a model prompt. It needs a verifier loop that proves the file, command, URL, or report changed before the agent claims done.
#local LLM#AI agents#verifier loops#llama.cpp
Apr 2, 20266 min read
Raspberry Pi 5 Offline Voice Assistant: Sub-2s, No Cloud (2026)
Want a private voice assistant with zero cloud and no subscription? A Raspberry Pi 5 runs it offline at sub-2s latency. We tested 6 local models on real hardware — here's the winner. (2026)
#Raspberry Pi#Edge AI#Voice Assistant#Local LLM
Mar 28, 20267 min read
Consumer GPUs Can Run Production LLMs Now — 50 req/s for $0/call (2026)
An RTX 5070 Ti runs Llama 3.1 at 50 req/s — replacing $2K/month in API costs. We benchmarked 4 GPUs, compared cloud pricing, and built the exact setup.
#Local LLM#Consumer GPU#AI Agents#llama.cpp

The AI agent build notes

Real costs, real tools, no fluff. M-F when I ship, publish, or learn something worth sending.