Writing · Tag

#GPU

2 posts tagged #GPU.

May 13, 20268 min read
GGUF Quantization Explained: Q4_K_M vs Q5_K_M vs Q8 — Which to Pick (2026)
Q4_K_M cuts model size 75% with minimal quality loss — but when should you use Q5, Q6, or Q8 instead? We benchmarked every quant level on real hardware and measured the actual accuracy tradeoffs.
#llama.cpp#GGUF#Quantization#Local AI
Apr 16, 20265 min read
GPU Prices Up 48% in Two Months. I Run LLMs in My Garage.
Blackwell rental hit $4.08/hr. CoreWeave raised prices 20%. Anthropic restricted their newest model to 40 orgs. Meanwhile, consumer GPUs are sitting idle.
#local-llm#gpu#infrastructure#agentguard

The weekly AI automation breakdown

Real costs, real tools, no fluff. One email per week with what I'm building, what's working, and what's not.