Skip to main content

Lab · LLM VRAM · Apple

Computed

What LLMs can the Apple M4 Pro (48GB) run?

58 of 62 rostered models have a usable on-device fit. The table keeps all 62 visible, including 1 below-context fits and 3 that exceed this device, so “not listed” never masquerades as an answer.

Published memory

48 GB

LPDDR5X unified

Assumed usable

36.0 GiB

75% of capacity

Peak bandwidth

273 GB/s

theoretical device spec

Usable fits

58 / 62

largest: 70.6B at Q3_K_M

Every model, solved on this accelerator

Usable rows fit weights plus at least 4k tokens, capped at the model’s own trained window. Tight rows hold weights but fall below that floor. The speed column is a memory-bandwidth ceiling, not a benchmark.

58 usable · 1 tight · 3 no fit

ModelParametersOn-device resultSelected weightsMax contextDecode ceiling · read per token
DeepSeek-R1-Distill-Llama 70BDeepSeek70.6BQuantized fitQ3_K_M · 31.9 GiBpublished file13k7 tok/sreads 34.4 GiB/token
Llama 3.1 70B InstructLlama70.6BQuantized fitQ3_K_M · 31.9 GiBpublished file13k7 tok/sreads 34.4 GiB/token
Llama 3.1 Nemotron 70B InstructNemotron70.6BQuantized fitQ3_K_M · 31.9 GiBpublished file13k7 tok/sreads 34.4 GiB/token
Llama 3.3 70B InstructLlama70.6BQuantized fitQ3_K_M · 31.9 GiBpublished file13k7 tok/sreads 34.4 GiB/token
Mixtral 8x7B InstructMistral46.7BQuantized fitQ5_K_M · 30.8 GiBarchitecture calculation32k27 tok/sreads 9.5 GiB/token
Hermes 4.3 36BSeed OSS36.2BQuantized fitQ6_K · 27.6 GiBarchitecture calculation34k9 tok/sreads 29.6 GiB/token
KAT Coder V2.5 DevQwen3 5 MOE Text34.7BQuantized fitQ8_0 · 34.3 GiBarchitecture calculation22k74 tok/sreads 3.4 GiB/token
Qwen AgentWorld 35B A3BQwen3 5 MOE Text34.7BQuantized fitQ8_0 · 34.4 GiBpublished file21k74 tok/sreads 3.5 GiB/token
Yi 1.5 34B ChatYi34.4BQuantized fitQ8_0 · 34.0 GiBpublished file4k7 tok/sreads 35.0 GiB/token
Laguna XS 2.1Laguna33.4BQuantized fitQ8_0 · 33.2 GiBpublished file71k87 tok/sreads 2.9 GiB/token
DeepSeek-R1-Distill-Qwen 32BDeepSeek32.8BQuantized fitQ8_0 · 32.4 GiBpublished file14k7 tok/sreads 34.4 GiB/token
Qwen2.5 32B InstructQwen32.8BQuantized fitQ8_0 · 32.4 GiBpublished file14k7 tok/sreads 34.4 GiB/token
Qwen2.5-Coder 32B InstructQwen32.8BQuantized fitQ8_0 · 32.4 GiBpublished file14k7 tok/sreads 34.4 GiB/token
QwQ 32BQwen32.8BQuantized fitQ8_0 · 32.4 GiBarchitecture calculation14k7 tok/sreads 34.4 GiB/token
Qwen3 32BQwen32.8BQuantized fitQ8_0 · 32.4 GiBarchitecture calculation14k7 tok/sreads 34.4 GiB/token
Qwen3 30B-A3BQwen30.5BQuantized fitQ8_0 · 30.3 GiBpublished file40k62 tok/sreads 4.1 GiB/token
Gemma 3 27B InstructGemma27.4BQuantized fitQ8_0 · 27.1 GiBarchitecture calculation108k9 tok/sreads 28.2 GiB/token
Gemma 2 27B InstructGemma27.2BQuantized fitQ8_0 · 27.0 GiBpublished file8k9 tok/sreads 29.8 GiB/token
Dolphin Mistral 24B Venice EditionMistral24BQuantized fitQ8_0 · 23.8 GiBarchitecture calculation78k10 tok/sreads 25.0 GiB/token
Mistral Small 24B InstructMistral23.6BQuantized fitQ8_0 · 23.3 GiBpublished file32k10 tok/sreads 24.6 GiB/token
gpt-oss 20Bgpt-oss21.5BFull precision · comfortableAs released · 12.8 GiBpublished file128k92 tok/sreads 2.8 GiB/token
DeepSeek-R1-Distill-Qwen 14BDeepSeek14.8BFull precision · comfortableFP16 / BF16 · 27.5 GiBpublished file45k9 tok/sreads 29.0 GiB/token
Qwen2.5 14B InstructQwen14.8BFull precision · comfortableFP16 / BF16 · 27.5 GiBpublished file32k9 tok/sreads 29.0 GiB/token
Qwen3 14BQwen14.8BFull precision · comfortableFP16 / BF16 · 27.5 GiBpublished file40k9 tok/sreads 28.8 GiB/token
Phi-4 14BPhi14.7BFull precision · comfortableFP16 / BF16 · 27.3 GiBpublished file16k9 tok/sreads 28.9 GiB/token
OLMo 2 13B InstructOLMo13.7BFull precision · comfortableFP16 / BF16 · 25.5 GiBpublished file4k9 tok/sreads 28.7 GiB/token
Mistral Nemo 12B InstructMistral12.2BFull precision · comfortableFP16 / BF16 · 22.8 GiBpublished file84k11 tok/sreads 24.1 GiB/token
Gemma 3 12B InstructGemma12.2BFull precision · comfortableFP16 / BF16 · 22.7 GiBpublished file128k11 tok/sreads 23.5 GiB/token
Qwythos 9B Claude Mythos 5 1MQwen3 5 Text9.4BFull precision · comfortableFP16 / BF16 · 17.5 GiBpublished file148k14 tok/sreads 18.5 GiB/token
Gemma 2 9B InstructGemma9.2BFull precision · comfortableFP16 / BF16 · 17.2 GiBpublished file8k13 tok/sreads 19.8 GiB/token
Qwen3 8BQwen8.2BFull precision · comfortableFP16 / BF16 · 15.3 GiBpublished file40k16 tok/sreads 16.4 GiB/token
Granite 3.3 8B InstructGranite8.2BFull precision · comfortableFP16 / BF16 · 15.2 GiBpublished file128k15 tok/sreads 16.5 GiB/token
DeepSeek-R1-Distill-Llama 8BDeepSeek8BFull precision · comfortableFP16 / BF16 · 15.0 GiBpublished file128k16 tok/sreads 16.0 GiB/token
Llama 3.1 8B InstructLlama8BFull precision · comfortableFP16 / BF16 · 15.0 GiBpublished file128k16 tok/sreads 16.0 GiB/token
DeepSeek-R1-Distill-Qwen 7BDeepSeek7.6BFull precision · comfortableFP16 / BF16 · 14.2 GiBpublished file128k17 tok/sreads 14.6 GiB/token
Qwen2.5 7B InstructQwen7.6BFull precision · comfortableFP16 / BF16 · 14.2 GiBpublished file32k17 tok/sreads 14.6 GiB/token
Qwen2.5-Coder 7B InstructQwen7.6BFull precision · comfortableFP16 / BF16 · 14.2 GiBpublished file32k17 tok/sreads 14.6 GiB/token
Falcon3 7B InstructFalcon7.5BFull precision · comfortableFP16 / BF16 · 13.9 GiBpublished file32k17 tok/sreads 14.8 GiB/token
Mistral 7B Instruct v0.3Mistral7.2BFull precision · comfortableFP16 / BF16 · 13.5 GiBpublished file32k18 tok/sreads 14.5 GiB/token
Gemma 3 4B InstructGemma4.3BFull precision · comfortableFP16 / BF16 · 8.0 GiBpublished file128k31 tok/sreads 8.3 GiB/token
Nanbeige4.2 3BNanbeige4.2BFull precision · comfortableFP16 / BF16 · 7.8 GiBpublished file256k30 tok/sreads 8.5 GiB/token
Qwen3 4BQwen4BFull precision · comfortableFP16 / BF16 · 7.5 GiBpublished file40k30 tok/sreads 8.6 GiB/token
Phi-4-mini 3.8B InstructPhi3.8BFull precision · comfortableFP16 / BF16 · 7.1 GiBpublished file128k31 tok/sreads 8.1 GiB/token
Phi-3.5-mini 3.8B InstructPhi3.8BFull precision · comfortableFP16 / BF16 · 7.1 GiBpublished file77k25 tok/sreads 10.1 GiB/token
Llama 3.2 3B InstructLlama3.2BFull precision · comfortableFP16 / BF16 · 6.0 GiBpublished file128k37 tok/sreads 6.9 GiB/token
Qwen2.5 3B InstructQwen3.1BFull precision · comfortableFP16 / BF16 · 5.7 GiBpublished file32k42 tok/sreads 6.0 GiB/token
Qwen3 1.7BQwen2BFull precision · comfortableFP16 / BF16 · 3.8 GiBpublished file40k55 tok/sreads 4.7 GiB/token
DeepSeek-R1-Distill-Qwen 1.5BDeepSeek1.8BFull precision · comfortableFP16 / BF16 · 3.3 GiBpublished file128k72 tok/sreads 3.5 GiB/token
SmolLM2 1.7B InstructSmolLM1.7BFull precision · comfortableFP16 / BF16 · 3.2 GiBpublished file8k54 tok/sreads 4.7 GiB/token
Qwen2.5 1.5B InstructQwen1.5BFull precision · comfortableFP16 / BF16 · 2.9 GiBpublished file32k82 tok/sreads 3.1 GiB/token
Llama 3.2 1B InstructLlama1.2BFull precision · comfortableFP16 / BF16 · 2.3 GiBpublished file128k100 tok/sreads 2.6 GiB/token
TinyLlama 1.1B ChatTinyLlama1.1BFull precision · comfortableFP16 / BF16 · 2.0 GiBpublished file2k122 tok/sreads 2.1 GiB/token
MiniCPM5 1BLlama1.1BFull precision · comfortableFP16 / BF16 · 2.0 GiBpublished file128k116 tok/sreads 2.2 GiB/token
Gemma 3 1B InstructGemma1000MFull precision · comfortableFP16 / BF16 · 1.9 GiBpublished file32k134 tok/sreads 1.9 GiB/token
Qwen3 0.6BQwen752MFull precision · comfortableFP16 / BF16 · 1.4 GiBpublished file40k112 tok/sreads 2.3 GiB/token
Qwen2.5 0.5B InstructQwen494MFull precision · comfortableFP16 / BF16 · 942 MiBpublished file32k251 tok/sreads 1.0 GiB/token
SmolLM2 360M InstructSmolLM362MFull precision · comfortableFP16 / BF16 · 690 MiBpublished file8k258 tok/sreads 1010 MiB/token
SmolLM2 135M InstructSmolLM135MFull precision · comfortableFP16 / BF16 · 257 MiBpublished file8k596 tok/sreads 437 MiB/token
Qwen2.5 72B InstructQwen72.7BBelow usable contextQ3_K_M · 35.1 GiBpublished file3k7 tok/sreads 36.0 GiB/token
Hy3HY V3298.8BNo on-device fitQ3_K_M · 128.1 GiBpublished fileNot resident
Laguna S 2.1Laguna117.6BNo on-device fitQ3_K_M · 50.3 GiBpublished fileNot resident
gpt-oss 120Bgpt-oss116.8BNo on-device fitQ3_K_M · 58.3 GiBpublished fileNot resident

Device specification and assumption

Memory
48 GB LPDDR5X unified
Bandwidth
273 GB/s
Usable budget
75% → 36.0 GiB

Capacity and bandwidth come from the vendor specification. The usable fraction is an explicit planning assumption, not a device specification.

What the table does — and does not — claim

Weight sizes use published checkpoint or GGUF files where the roster has one, otherwise the documented bits-per-weight calculation. Context comes from each model’s layer and KV-head geometry. The decode figure is the card’s peak bandwidth divided by the bytes one token reads — the weights it routes through plus one pass over the KV cache, printed under each ceiling — so it is a roofline bound, not measured application throughput. Multi-GPU splitting and host-memory offload are outside this on-device table.

Questions about this card

What LLMs can the Apple M4 Pro (48GB) run?

58 of the 62 open models in this roster have an on-device configuration with usable context. The largest by exact parameter count is DeepSeek-R1-Distill-Llama 70B at Q3_K_M, with room for 13k tokens. “Largest” describes parameter count, not model quality or task performance.

How much memory is usable on the Apple M4 Pro (48GB)?

The device publishes 48 GB of LPDDR5X unified. This calculator budgets 75%, or 36.0 GiB, for model weights and KV cache; the remainder is an explicit allowance for the runtime, driver or operating system, workspace, and display. It is an assumption rather than a vendor specification.

Are the speed figures benchmarks for the Apple M4 Pro (48GB)?

No. They are bandwidth-bound roofline ceilings: 273 GB/s divided by the bytes one decoded token actually reads, which the table prints beside every ceiling. That is not the size of the file on disk — a token reads the weights it routes through, all of them for a dense model but only the selected experts for a mixture-of-experts, plus one pass over the KV cache. Laguna XS 2.1 holds 33.2 GiB resident at Q8_0 yet reads 2.9 GiB/token, which is what produces its 87 tok/s. Real throughput is lower because kernels, cache traffic, prompt processing, scheduling, and runtime overhead also consume time.