§ 001 / TOPIC
5090 Reports
62 posts on 5090 reports, guides and lab notes from real runs on hardware we own. New posts land here automatically. Start anywhere, or grab the copy-paste prompts that ship with them.
- 5 min read
Full Precision vs Q8 vs Q6 vs Q4: Which Weights to Run?
Compare full precision vs Q8 vs Q6 vs Q4 weight sizes, memory needs, and measured speeds so you can pick the right GGUF quant for your local setup.
- 5 min read
llama.cpp 1.0.0 release november 2026
The llama.cpp 1.0.0 release in November 2026 sets SemVer rules, cuts 35 deprecated functions, and adds FP8 KV caches. Here is what to check in your setup.
- 5 min read
OpenClaw: Who Is Using It? Demographics Survey 2026
See verified 2026 OpenClaw survey demographics, user limits, and real sample metrics to help you evaluate your local AI agent setup against real data.
- 5 min read
LLM GPU Costs Unexpectedly High: How to Diagnose the Bill
When LLM GPU costs are unexpectedly high, idle replica minutes, cold starts, and separate disk fees inflate invoices. Here is how to audit your runtime spend.
- 5 min read
Is OpenClaw Worth It? Setup Costs and Risks
OpenClaw offers free self-hosted messaging agents under the MIT license, but model token fees, host security, and skill audits determine your real costs.
- 6 min read
q5_k_m vs q5_k_s: what the extra 0.12 GiB changes
Q5_K_M moves part of attn_v and ffn_down to Q6_K. Q5_K_S keeps Q5_K. For Llama 3.1 8B that is 5.33 GiB vs 5.21 GiB, and lower perplexity.
- 5 min read
OpenClaw AI Assistant Latest News 2026
OpenClaw release v2026.10.4 repairs sleep restarts and Tlon permissions, following skill discovery, MCP Apps, and R2 backup updates in October 2026.
- 5 min read
Q6_K vs Q8_0: Which GGUF Preset Fits Your Setup?
Compare Q6_K and Q8_0 presets for llama.cpp. See real VRAM allocation, file sizes, and test steps to decide which GGUF quantization fits your card.
- 5 min read
llama-server ngl: How to Set and Verify GPU Offload
Learn how to set -ngl in llama-server, verify GPU layer offload in startup logs, avoid silent CPU fallback, and check device readiness.
- 5 min read
What Does ngl 99 Mean in llama.cpp?
In llama.cpp, ngl 99 sets a numeric cap of 99 layers in GPU memory rather than 99 percent VRAM. Here is how layer offloading works and what to run.
- 5 min read
q4km vs q4ks: which 4-bit file fits?
q4km is Q4_K_M and q4ks is Q4_K_S. For Llama 3.1 8B, the quantize README lists 4.36 GiB for Q4_K_S and 4.58 GiB for Q4_K_M.
- 5 min read
KV Cache Q4 vs Q8 in llama.cpp Explained
Compare q4_0 and q8_0 KV cache options in llama.cpp server. Learn the exact CLI flags, allowed types, defaults, and how to verify output quality.
The AI agent build notes
Real costs, real tools, no fluff. One evidence-backed note on Friday when there is something worth sharing.
Get the requested artifact now, then at most one evidence-backed Local AI Lab Note on Friday when there is something worth sharing. One-click unsubscribe. No sponsored placements. Privacy.