KRANKY ai

Per-model leaderboard

llama3.2:1b

The fastest mini PC for llama3.2:1b is Aoostar GEM12 at 48.1 tok/s.

# Machine tok/s watts tok/s/W
#1 Aoostar GEM12

backend: gpu

48.1 tok/s