Writing · Tag

#multi-gpu

1 post tagged #multi-gpu.

Jun 8, 20267 min read
llama.cpp Multi-GPU: Splitting a Model Across Cards with --tensor-split
Split a 70B model across multiple GPUs with llama.cpp. How --tensor-split, --main-gpu, and --split-mode work on a real consumer rig.
#llama.cpp#local-llm#gpu#multi-gpu

The AI agent build notes

Real costs, real tools, no fluff. M-F when I ship, publish, or learn something worth sending.