Bonsai 27B vs Gemma 4 E4B: Which Should You Run?
This prompt evaluates your hardware specs and workload requirements to recommend either Ternary Bonsai 27B or Gemma 4 E4B.
Show prompt
Role: Local AI Systems Architect Context: Evaluate local model deployments based on hardware limits, input modalities, and reasoning requirements. Inputs: - Available VRAM: __ GB - Required Modalities: __ (Text, Image, Audio) - Required Context Window: __ tokens - Host Runtime: __ (Ollama, llama.cpp) Task: 1. Check Available VRAM, Required Modalities, and Required Context Window. 2. If Required Modalities includes Audio, or only the 4.5 GB Q4_0 weight file fits, select Gemma 4 E4B. 3. If the 7.2 GB deployed footprint fits, Required Modalities has no Audio, and math or 262K context is required, select Ternary Bonsai 27B. Do not select it for a 6 GB per-app iOS budget. 4. Output the matching CLI command for the Host Runtime. Output: - Selected Model: Ternary Bonsai 27B or Gemma 4 E4B - Rationale: Memory and modality fit - Launch Command: CLI command Constraints: - Use only facts from published model cards. - Do not assume audio on Ternary Bonsai 27B. - Never exceed Available VRAM.