Writing · Tag

#Local LLM

2 posts tagged #Local LLM.

Apr 2, 20266 min read
Raspberry Pi 5 Offline Voice AI: No Cloud, Sub-2s Latency (2026)
Want a private voice assistant with no cloud and no subscription? A Raspberry Pi 5 runs local voice AI at sub-2s latency. We tested 6 models on real hardware and picked the winner. (2026)
#Raspberry Pi#Edge AI#Voice Assistant#Local LLM
Mar 28, 20267 min read
Consumer GPUs Can Run Production LLMs Now — 50 req/s for $0/call (2026)
An RTX 5070 Ti runs Llama 3.1 at 50 req/s — replacing $2K/month in API costs. We benchmarked 4 GPUs, compared cloud pricing, and built the exact setup.
#Local LLM#Consumer GPU#AI Agents#llama.cpp

The AI agent build notes

Real costs, real tools, no fluff. M-F when I ship, publish, or learn something worth sending.