Privacy statuschoice required

Essential cookies keep the site working. Optional analytics are off unless you allow them.

Writing · Tag

#gpu-inference

1 post tagged #gpu-inference.

May 15, 20267 min read
Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.
Tom Tunguz called it localmaxxing. I run a 3070 + 5070 Ti + 5090 in one box and serve Llama 3.1 8B locally every day. Here are the real tokens-per-second, the real watts, and the real cost per million tokens.
#local-llm#ai-economics#agent-cost-control#gpu-inference

The AI agent build notes

Real costs, real tools, no fluff. One evidence-backed note on Friday when there is something worth sharing.

Get the requested artifact now, then at most one evidence-backed Local AI Lab Note on Friday when there is something worth sharing. One-click unsubscribe. No sponsored placements. Privacy.

Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.

The AI agent build notes