Writing · Tag

#local-llm

3 posts tagged #local-llm.

Apr 16, 20265 min read
GPU Prices Up 48% in Two Months. I Run LLMs in My Garage.
Blackwell rental hit $4.08/hr. CoreWeave raised prices 20%. Anthropic restricted their newest model to 40 orgs. Meanwhile, consumer GPUs are sitting idle.
#local-llm#gpu#infrastructure#agentguard
Apr 15, 20266 min read
Anthropic's Advisor Tool Is the Cost-Split Pattern You Should Already Be Running
Anthropic shipped a pattern where a cheap model runs the loop and escalates to Opus only when it needs to. The pattern works on any two-model setup. Here is the math and the playbook.
#ai-agents#cost-optimization#anthropic#agentguard
Apr 6, 20267 min read
llama.cpp n_gpu_layers Explained: -1, 0 & VRAM Guide
n_gpu_layers -1 offloads every layer to GPU. Learn what each value means, the exact VRAM math, and pick the right setting with real benchmarks.
#llama-cpp#local-llm#gpu-offloading#n-gpu-layers

The weekly AI automation breakdown

Real costs, real tools, no fluff. One email per week with what I'm building, what's working, and what's not.