Best open-weight LLMs for the RTX 3060 (12GB)

With ~12 GB available for model weights, 0 open-weight models run locally on a RTX 3060 (12GB) — each at the best quantization that fits. The 5 that need more memory are listed below with the cheapest provider to rent them instead. VRAM figures are estimates.Updated May 2026.

Different machine? Pick another rig or enter your VRAM →

VRAM ≈ parameters × bytes-per-param × 1.2 overhead, at the best available quantization — see the methodology docs. Estimates, not a guarantee.

Other hardware