Measured on real machines

Each post is one hardware and model combination. Newest first.

Tokens per second

llama3.2:3b114.23 tok/s

31 Aug 2026
llama3.2:3b on RTX 3060 Laptop
Intel Core i5-10500H, RTX 3060 Laptop 6GB VRAM · 62.5GB RAM · Ubuntu 24.04.4 LTS
114.23 tok/s