#agent-cost-control

Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.

Tom Tunguz called it localmaxxing. I run a 3070 + 5070 Ti + 5090 in one box and serve Llama 3.1 8B locally every day. Here are the real tokens-per-second, the real watts, and the real cost per million tokens.