Per-model leaderboard
llama3.2:3b
The fastest mini PC for llama3.2:3b is Aoostar GEM12 at 26.7 tok/s.
| # | Machine | tok/s | watts | tok/s/W |
|---|---|---|---|---|
| #1 | Aoostar GEM12 backend: gpu | 26.7 tok/s | — | — |
Per-model leaderboard
The fastest mini PC for llama3.2:3b is Aoostar GEM12 at 26.7 tok/s.
| # | Machine | tok/s | watts | tok/s/W |
|---|---|---|---|---|
| #1 | Aoostar GEM12 backend: gpu | 26.7 tok/s | — | — |