My local daily brief used 0 model calls
On September 4, 2026 my llama3.1:8b daily brief was ready with 0 model calls and 0 seconds. Preview-only file ranking is not a model run.
I almost put a 0-second llama3.1:8b row on a model-speed chart. On September 4, 2026 the daily brief stamped itself ready. The same receipt recorded 0 model calls, 0 successful model calls, and 0 seconds of model time. The GPU did no generate work.
Short answer: preview_only ranked source files and stopped. A ready flag with 0 generate calls is a retrieval pass, not a model run. Do not mix that row with a later llama3.1:8b generate. Canonical URL: https://bmdpat.com/blog/local-llm-preview-only-zero-model-calls-2026

What would I have charted by mistake?
If I only read daily-brief-ready, the chart would show a successful llama3.1:8b brief. If I also read model_call_count, the same day is a ranked file list with no inference.
I already refuse to promote a local model just because it exists. I also refuse to treat a ready stamp as proof of inference. Those are different events.
A later generate with the same model name would look slower and messier next to this 0-second row. That comparison is false. The 0-call row had no citation errors because it wrote no citations.
What did the September 4 receipt record?
Run 20260904-000702 used llama3.1:8b. The flag preview_only was true. The receipt recorded four sections. model_call_count was 0. model_ok_count was 0. total_latency_s was 0. citation_error_count was 0. redaction_issue_count was 0.
The last two zeros are not a quality win. The model wrote nothing, so it could not cite a wrong file or leak text.
The same pattern showed up on September 3, 2026 in run 20260903-083854. Same model. Same preview_only flag. Same 0 model calls and 0 seconds.
Did llama3.1:8b generate any tokens?
No. A local Ollama run is a generate request. The Ollama generate API is that call. This receipt never made it. Latency stayed at 0 seconds because there was no generate interval to measure.
The model name in the header is the model that would have run if preview_only were false. It is not proof that llama3.1:8b produced tokens.
When I size a local agent I care whether the GPU did work. 0 seconds of model time means this brief did not use the 5090. A later llama3.1:8b generate is a different event.
What did the file ranker actually score?
It ranked files. The Decisions section scored a Request file at 3.0 on keyword overlap. The Coding section scored Reports/5090/vault-model-lab/2026-09-04.md at 41.0 and the September 3 report at 43.0. The Learning and Growth sections scored signal and reflection pages.
Each section listed two sources and a score. No section includes model output. The review gate on the receipt says answers stay unreviewed until a human approves them. There were no answers to review.
If I treated that 3.0 as llama3.1:8b judgment, I would be scoring keyword overlap as model quality. It is not.
I already preview retrieval before a local model run. That post is about inspecting chunks before generate. This receipt skipped generate after the preview. The preview became the whole job.
Why can I not quote this brief as a model result?
daily-brief-ready was true. A dashboard that only reads that flag reports a successful brief. A dashboard that also reads model_call_count reports a retrieval pass with no model.
The runtime preflight I run before a benchmark already separates "the runtime loaded" from "the model scored." This is the same split for a daily brief.
The rule is short. If generate did not run, do not quote the brief as a model result. Do not drop the 0-call row onto a tok/s chart. Do not use 0 citation errors as a quality score.
What does the dashboard need next to ready?
I keep the model name. I also keep model_call_count, total_latency_s, and preview_only on the same line. A brief with preview_only true and 0 calls is a ranked file list. It is not a local model result.
Mixing them in one daily-brief chart would hide both. The retrieval pass would look cheap. The real generate would look expensive. Neither number would describe the other.
Accompanying prompt
What the prompt does: It reads a local daily-brief receipt and says whether the named model actually ran, or only ranked files.
Copy/paste this prompt:
Copy-ready prompt
Paste the exact block into your coding agent.
No article chrome, no footnotes, no formatting drift.
This prompt and every other one we publish live in the free prompt library.
Copy the block above.
Get the next measured local-AI field note by email: The 5090 Reports.
Get the Local AI Field Kit
Four copy-ready tools now, then one evidence-backed Local AI Lab Note on Friday when there is something worth sharing.
Get the requested artifact now, then at most one evidence-backed Local AI Lab Note on Friday when there is something worth sharing. One-click unsubscribe. No sponsored placements. Privacy.
Patrick Hughes
Building BMD HODL — a one-person AI-operated holding company. Nashville, Tennessee. Twenty-Two agents.
More writing
- 6 min
My agent wrote 126 empty pages and every gate passed
One commit wrote 130 knowledge pages. 126 were the same four sentences with the title swapped. Schema checks, link checks and orphan checks all passed.
- 5 min
Long Context Cost Me VRAM, Not Tokens a Second
A 94x bigger prompt cost llama3.1:8b only 9.7% of its generation rate. VRAM rose 656 MiB, but num_ctx doubled in the same step. Budget memory first.
- 5 min
One model logged 14.5 and 6,178 prompt tokens a second
gemma4:26b read 53 prompt tokens at 14.5 tok/s and 4,470 at 6,178.9 on the same RTX 5090 run set. Prompt speed is not one number.
- 5 min
Ollama Load Time Can Hide a Fast Local LLM
My RTX 5090 run spent 43.48 seconds on model load and 0.17 seconds on output. Split wall time before you judge local LLM speed.
- 5 min
A 32 GB GPU Still Needs Host RAM Headroom
My RTX 5090 had 32 GB of VRAM ready, but my local policy stopped Ollama at 7.02 GiB of free host RAM. Here is my preflight before model load.