Writing · Tag
#local-ai-agents
2 posts tagged #local-ai-agents.
- 6 min read
Preview Retrieval Before Your Local LLM Runs
Preview the files your local LLM will receive before inference. This simple gate catches bad retrieval while the fix is still cheap and clear.
#local-llm#retrieval#local-ai-agents#private-ai - 6 min read
Pin Your Context Window or Pay the Reload Tax
Change num_ctx in Ollama and it reloads the whole model. On my RTX 5090 that meant 140 seconds of dead air per context swap. Here is how to stop paying it.
#local-llm#ollama#num-ctx#local-ai-agents
The AI agent build notes
Real costs, real tools, no fluff. One evidence-backed note on Friday when there is something worth sharing.
Get the requested artifact now, then at most one evidence-backed Local AI Lab Note on Friday when there is something worth sharing. One-click unsubscribe. No sponsored placements. Privacy.