§ 001 / TOPIC
Hardware
71 posts on hardware, guides and lab notes from real runs on hardware we own. New posts land here automatically. Start anywhere, or grab the copy-paste prompts that ship with them.
- 5 min read
Full Precision vs Q8 vs Q6 vs Q4: Which Weights to Run?
Compare full precision vs Q8 vs Q6 vs Q4 weight sizes, memory needs, and measured speeds so you can pick the right GGUF quant for your local setup.
- 5 min read
llama.cpp 1.0.0 release november 2026
The llama.cpp 1.0.0 release in November 2026 sets SemVer rules, cuts 35 deprecated functions, and adds FP8 KV caches. Here is what to check in your setup.
- 5 min read
OpenClaw: Who Is Using It? Demographics Survey 2026
See verified 2026 OpenClaw survey demographics, user limits, and real sample metrics to help you evaluate your local AI agent setup against real data.
- 5 min read
LLM GPU Costs Unexpectedly High: How to Diagnose the Bill
When LLM GPU costs are unexpectedly high, idle replica minutes, cold starts, and separate disk fees inflate invoices. Here is how to audit your runtime spend.
- 5 min read
What Does --cache-type-k Do in llama.cpp?
Learn what --cache-type-k does in llama.cpp, how q8_0 cuts memory in half at 32K context, and how to configure key cache types for your GPU setup.
- 5 min read
Is OpenClaw Worth It? Setup Costs and Risks
OpenClaw offers free self-hosted messaging agents under the MIT license, but model token fees, host security, and skill audits determine your real costs.
- 5 min read
OpenClaw AI Assistant Latest News 2026
OpenClaw release v2026.10.4 repairs sleep restarts and Tlon permissions, following skill discovery, MCP Apps, and R2 backup updates in October 2026.
- 5 min read
Q6_K vs Q8_0: Which GGUF Preset Fits Your Setup?
Compare Q6_K and Q8_0 presets for llama.cpp. See real VRAM allocation, file sizes, and test steps to decide which GGUF quantization fits your card.
- 5 min read
llama-server ngl: How to Set and Verify GPU Offload
Learn how to set -ngl in llama-server, verify GPU layer offload in startup logs, avoid silent CPU fallback, and check device readiness.
- 5 min read
What Does ngl 99 Mean in llama.cpp?
In llama.cpp, ngl 99 sets a numeric cap of 99 layers in GPU memory rather than 99 percent VRAM. Here is how layer offloading works and what to run.
- 5 min read
q4km vs q4ks: which 4-bit file fits?
q4km is Q4_K_M and q4ks is Q4_K_S. For Llama 3.1 8B, the quantize README lists 4.36 GiB for Q4_K_S and 4.58 GiB for Q4_K_M.
- 5 min read
KV Cache Q4 vs Q8 in llama.cpp Explained
Compare q4_0 and q8_0 KV cache options in llama.cpp server. Learn the exact CLI flags, allowed types, defaults, and how to verify output quality.
The AI agent build notes
Real costs, real tools, no fluff. One evidence-backed note on Friday when there is something worth sharing.
Get the requested artifact now, then at most one evidence-backed Local AI Lab Note on Friday when there is something worth sharing. One-click unsubscribe. No sponsored placements. Privacy.