Writing · Tag
1 post tagged #num-ctx.
Change num_ctx in Ollama and it reloads the whole model. On my RTX 5090 that meant 140 seconds of dead air per context swap. Here is how to stop paying it.
Real costs, real tools, no fluff. M-F when I ship, publish, or learn something worth sending.