Library · Edge AI Radar · 2026-08-25
DailyWhich fresh models actually fit your board.
A daily, deterministic scan of new GGUF and ONNX releases on Hugging Face — verified file bytes in, datasheet memory ceilings out. Every fit verdict on this page is arithmetic you can check, not a benchmark we invented.
Tuesday, August 25, 2026 · 12 models × 10 boards · generated Aug 25, 02:21 PM UTC
Real file sizes vs real hardware memory limits.
Quantized model weights vary dramatically by quantization scheme. Below is today's verified fit profile across microcontrollers, single-board computers, and edge GPU accelerators.
Click any board vertex or pill below to inspect model headroom & RAM limits.
LattePanda Sigma (32 GB)
Memory topology & context pressure
Simulate how model tensor weights, runtime scratchpads, and expanding KV cache context windows occupy memory across hardware targets — from 7 MiB microcontrollers to 30 GiB x86 edge servers (Pi 5 8GB/16GB, Orange Pi 5 Plus 16GB, Rock 5B 16GB, Orin Nano/NX, Sigma 32GB).
Pick a real Hugging Face release (verified file bytes). The bar showsweights + 12% overhead + KV cache growing with context. MCU & Coral TPU rows show architectural class mismatch for 2–16 GiB LLMs — not a fabricated 98,000% overflow.
KV cache grows linearly with tokens. At — vs 512 baseline.Formula: max(runtime×ratio×seq/2048, 256 KiB). ratio 0.08 MCU, 0.04 SBC/GPU.
Single-Board
· 6.5–30 GiB model budget · 5 boardsEdge GPU
· Unified RAM · CUDA/TensorRT · 2 boardsAI Accelerator
· 8 MB cache · int8 graph · 1 boardMicrocontroller
· 7 MiB arena · TinyML only · 2 boardsToday's fit matrix
Representative quant file per repo (Q4_K_M preferred), runtime estimate = verified bytes × 1.25, against each board's disclosed model-memory ceiling. Fits ≤ 80% of ceiling · Tight ≤ 100% · otherwise No.
| Model · representative file | Runtime est. | Sigma 32GB30.00 GiB ceiling | Orin NX 16GB14.50 GiB ceiling | Pi 5 16GB14.50 GiB ceiling | Orange Pi 5+ 16GB14.00 GiB ceiling | ROCK 5B 16GB14.00 GiB ceiling | Orin Nano 8GB6.50 GiB ceiling | Pi 5 8GB6.50 GiB ceiling | Coral TPU8.0 MiB ceiling | Teensy 4.1 8MB7.0 MiB ceiling | ESP32-S3 N8R87.0 MiB ceiling | Score |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| onnx-community/single-floppy-346k-merged-ONNXONNX · 1.6 MiB file · text-generation | 2.0 MiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | 10/10 |
| onnx-community/floppyx3-MEGAmodel-merged-ONNXONNX · 4.5 MiB file · text-generation | 5.7 MiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Tight | Tight | 10/10 |
| onnx-community/learn_hf_food_not_food_text_classifier_distilbert_base_uncased-ONNXONNX · 255.5 MiB file · text-classification | 319.4 MiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | No | No | No | 7/10 |
| unsloth/Qwen3.8-27B-GGUFGGUF · Q4_K_M · 15.33 GiB file | 19.17 GiB | Fits | No | No | No | No | No | No | No | No | No | 1/10 |
| onnx-community/whisper-kannada-base-ONNXONNX · 300.1 MiB file · automatic-speech-recognition | 375.2 MiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | No | No | No | 7/10 |
| onnx-community/s1-mini-ONNXONNX · 0.4 MiB file | 0.4 MiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | 10/10 |
| bartowski/Ornith-1.5-9B-GGUFGGUF · Q4_K_M · 5.50 GiB file · image-text-to-text | 6.88 GiB | Fits | Fits | Fits | Fits | Fits | No | No | No | No | No | 5/10 |
| OBLITERATUS/Qwen3.8-27B-OBLITERATEDGGUF · Q4_K_M · 15.66 GiB file · text-generation | 19.57 GiB | Fits | No | No | No | No | No | No | No | No | No | 1/10 |
| bartowski/tencent_UI-Mate-9B-GGUFGGUF · Q4_K_M · 5.50 GiB file · image-text-to-text | 6.88 GiB | Fits | Fits | Fits | Fits | Fits | No | No | No | No | No | 5/10 |
| onnx-community/Supra2-Nano-ONNXONNX · 4.7 MiB file · text-generation | 5.9 MiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Fits | Tight | Tight | 10/10 |
| orcarouter/Qwen3.8-27B-Uncensored-GGUFGGUF · Q4_K_M · 15.66 GiB file · image-text-to-text | 19.57 GiB | Fits | No | No | No | No | No | No | No | No | No | 1/10 |
| unsloth/LFM2.5-VL-3B-GGUFGGUF · Q4_K_M · 1.56 GiB file · image-text-to-text | 1.95 GiB | Fits | Fits | Fits | Fits | Fits | Fits | Fits | No | No | No | 7/10 |
Quantization & board fit analytics
Bits-per-weight distribution across today's models and breakdown of fit capacity per hardware board class.
Quantization Spectrum · Bits Per Weight (bpw)
Lower bpw fits smaller boards; 4.85 bpw (Q4_K_M) retains ~99% perplexity with 70% RAM savings.
Board Fit Breakdown · 12 Scanned Models
Percentage of today's models fitting within each board's datasheet memory limit.
Sigma 32GB
Orin NX 16GB
Pi 5 16GB
Orange Pi 5+ 16GB
ROCK 5B 16GB
Orin Nano 8GB
Pi 5 8GB
Coral TPU
Teensy 4.1 8MB
ESP32-S3 N8R8
The arithmetic, per model
File bytes come from the repo's verified Hugging Face file tree. Parameter count is back-derived from those bytes ÷ the quant's published bits-per-weight. FLOPs/token is the dense-transformer 2·P rule.
- onnx10/10 boardsonnx-community/single-floppy-346k-merged-ONNXonnx/model.onnx
- File
- 1.6 MiB
- Runtime est.
- 2.0 MiB
- ≈ Params
- —
- FLOPs/token
- —
Footprint vs ceilings · log 1 MiB→32 GiB2.0 MiB - onnx10/10 boardsonnx-community/floppyx3-MEGAmodel-merged-ONNXonnx/model.onnx
- File
- 4.5 MiB
- Runtime est.
- 5.7 MiB
- ≈ Params
- —
- FLOPs/token
- —
Footprint vs ceilings · log 1 MiB→32 GiB5.7 MiB - onnx7/10 boardsonnx-community/learn_hf_food_not_food_text_classifier_distilbert_base_uncased-ONNXonnx/model.onnx
- File
- 255.5 MiB
- Runtime est.
- 319.4 MiB
- ≈ Params
- —
- FLOPs/token
- —
Footprint vs ceilings · log 1 MiB→32 GiB319.4 MiB - gguf · Q4_K_M1/10 boardsunsloth/Qwen3.8-27B-GGUFQwen3.8-27B-UD-Q4_K_M.gguf
- File
- 15.33 GiB
- Runtime est.
- 19.17 GiB
- ≈ Params
- 27.16B
- FLOPs/token
- 54.3 GFLOP
Footprint vs ceilings · log 1 MiB→32 GiB19.17 GiB - onnx7/10 boardsonnx-community/whisper-kannada-base-ONNXonnx/decoder_model_merged_int8.onnx
- File
- 300.1 MiB
- Runtime est.
- 375.2 MiB
- ≈ Params
- —
- FLOPs/token
- —
Footprint vs ceilings · log 1 MiB→32 GiB375.2 MiB - onnx10/10 boardsonnx-community/s1-mini-ONNXonnx/model_quantized.onnx
- File
- 0.4 MiB
- Runtime est.
- 0.4 MiB
- ≈ Params
- —
- FLOPs/token
- —
Footprint vs ceilings · log 1 MiB→32 GiB0.4 MiB - gguf · Q4_K_M5/10 boardsbartowski/Ornith-1.5-9B-GGUFOrnith-1.5-9B-Q4_K_M.gguf
- File
- 5.50 GiB
- Runtime est.
- 6.88 GiB
- ≈ Params
- 9.75B
- FLOPs/token
- 19.5 GFLOP
Footprint vs ceilings · log 1 MiB→32 GiB6.88 GiB - gguf · Q4_K_M1/10 boardsOBLITERATUS/Qwen3.8-27B-OBLITERATEDQwen3.8-27B-OBLITERATED-Q4_K_M.gguf
- File
- 15.66 GiB
- Runtime est.
- 19.57 GiB
- ≈ Params
- 27.73B
- FLOPs/token
- 55.5 GFLOP
Footprint vs ceilings · log 1 MiB→32 GiB19.57 GiB - gguf · Q4_K_M5/10 boardsbartowski/tencent_UI-Mate-9B-GGUFtencent_UI-Mate-9B-Q4_K_M.gguf
- File
- 5.50 GiB
- Runtime est.
- 6.88 GiB
- ≈ Params
- 9.75B
- FLOPs/token
- 19.5 GFLOP
Footprint vs ceilings · log 1 MiB→32 GiB6.88 GiB - onnx10/10 boardsonnx-community/Supra2-Nano-ONNXonnx/model.onnx
- File
- 4.7 MiB
- Runtime est.
- 5.9 MiB
- ≈ Params
- —
- FLOPs/token
- —
Footprint vs ceilings · log 1 MiB→32 GiB5.9 MiB - gguf · Q4_K_M1/10 boardsorcarouter/Qwen3.8-27B-Uncensored-GGUFQwen3.8-27B-Uncensored-Q4_K_M.gguf
- File
- 15.66 GiB
- Runtime est.
- 19.57 GiB
- ≈ Params
- 27.73B
- FLOPs/token
- 55.5 GFLOP
Footprint vs ceilings · log 1 MiB→32 GiB19.57 GiB - gguf · Q4_K_M7/10 boardsunsloth/LFM2.5-VL-3B-GGUFLFM2.5-VL-3B-Q4_K_M.gguf
- File
- 1.56 GiB
- Runtime est.
- 1.95 GiB
- ≈ Params
- 2.76B
- FLOPs/token
- 5.5 GFLOP
Footprint vs ceilings · log 1 MiB→32 GiB1.95 GiB
Daily release & fit history
Tracking total Hugging Face releases vs edge-fittable models across daily radar snapshots.
Edge AI Release & Fit Trend · 33 Daily Snapshots
Daily count of fresh Hugging Face model releases and how many fit edge hardware ceilings.
The boards behind the ceilings
Prices shown were retrieved from the Amazon Product Advertising API on 19 July 2026 and are indicative only — the price and availability on Amazon at the time of purchase apply.
Sigma 32GB
32 GB LPDDR5 (x86)
x86 edge server — 30 GiB model ceiling fits Gemma 4-26B-A4B Q4_K_M (15.8 GiB file / 19.7 GiB runtime) with 10 GiB headroom for 8k context.
Orin NX 16GB
16 GB LPDDR5 (100 TOPS)
Orin NX 16GB — double RAM vs Nano, fits 4-12B Q4_K_M with long context (8k) headroom for TensorRT-LLM.
Pi 5 16GB
16 GB LPDDR4X
16GB flagship — fits 9-12B Q4_K_M (5-7 GiB files) with 2-4k context headroom. Same power envelope, double RAM for local LLM.
Orange Pi 5+ 16GB
16 GB LPDDR4X (RK3588)
RK3588 SBC — cheaper Pi5-class alternative with PCIe NVMe for model storage; 14 GiB ceiling after RKLLM / llama.cpp overhead.
ROCK 5B 16GB
16 GB LPDDR4X (RK3588)
ROCK 5B 16GB — solid mid-range for 7-12B Q4_K_M; active cooling recommended for sustained inference.
Orin Nano 8GB
8 GB LPDDR5 (unified)
Unified memory — CUDA/TensorRT runtime, desktop and display all share the same 8 GB pool.
Pi 5 8GB
8 GB LPDDR4X
Full Linux host — llama.cpp / ONNX Runtime with headroom for the OS and KV cache growth at long context.
Coral TPU
8 MB on-chip model cache
Full-speed int8 only while the compiled model stays inside the 8 MB cache; larger graphs spill to host RAM. Host supplies its own memory via USB.
Teensy 4.1 8MB
1 MB on-chip + 8 MB PSRAM
Ceiling assumes the PSRAM fitted. On-chip alone caps models near 0.75 MB. Linked card is the Teensy 4.0 sibling (same 600 MHz i.MX RT1062 core; the 4.1 adds the PSRAM pads this ceiling needs).
ESP32-S3 N8R8
512 KB SRAM + 8 MB PSRAM
Model arena lives in octal PSRAM; on-chip SRAM stays free for the RTOS and tensor arena scratch.
Methodology — deterministic, checkable
Inputs (ground truth only)
- Verified file bytes — each repo's public Hugging Face file tree, fetched at build time. No benchmark claims, no tokens/sec, no accuracy numbers.
- Datasheet memory constants — ESP32-S3 N8R8 (512 KB + 8 MB PSRAM), Teensy 4.1 +8MB, Pi 5 8GB/16GB, Orange Pi 5+ 16GB, ROCK 5B 16GB, Coral TPU (8 MB cache), Orin Nano 8GB / NX 16GB, Sigma 32GB. Hardcoded in scripts/edgespec/radar-core.mjs with sources in comments.
- Published quant formats — llama.cpp bits-per-weight values (Q4_K_M ≈ 4.85 bpw, Q8_0 ≈ 8.5, …).
Formulas (nothing else)
- runtime = fileBytes × 1.25 (weights + KV/buffers)
- ≈params = fileBytes × 8 ÷ bitsPerWeight (GGUF only)
- FLOPs/token = 2 × params (dense transformer rule)
- fits ≤ 80% ceiling · tight ≤ 100% · else no
Gate tests (scripts/edgespec/pipeline.test.mjs) run before every publish in CI. Days with zero grounded models publish nothing — the same anti-abuse posture as the Signals Journal.
Frequently Asked Questions
Why no tokens-per-second or accuracy numbers?+
Because we'd have to invent them. Throughput depends on your exact runtime, cooling, and build flags — a number we didn't measure on the named board would be fabrication. This radar answers only the question arithmetic can answer honestly: does the model's memory footprint fit the board's ceiling?
Why does a “fits” verdict stop at 80% of the ceiling?+
KV cache grows with context length, runtimes allocate scratch buffers, and OS/framework overhead varies. The 20% margin is the difference between “loads once in a demo” and “runs reliably on your bench.” Tight means it fits on paper — plan your context budget carefully.
The repo name says 27B but your table shows fewer params — why?+
We derive ≈params from the verified file bytes ÷ the quant's bits-per-weight, not from the repo's title. Some repos ship partial, draft, or experimental files whose real size doesn't match the name. The bytes are the ground truth; the name is marketing.
When does this page update?+
A daily GitHub Action (edgespec-digest.yml) rescans Hugging Face, re-runs the gate tests, and commits a new dated snapshot only when grounded models pass. This site itself makes zero runtime requests — the fetch happens at build time, per our privacy boundary.