TinyStories
ESP32-P4 vs ESP32-S3: Energy per Token, Measured at the USB Port
Board-level energy per token for a TinyStories model: ESP32-P4 7.9 mJ, ESP32-S3 12.4-14.7 mJ. The P4 draws more power and still uses about 46% less per token.
LLM on a Microcontroller: ESP32-S3 at 22.6 tok/s
esp32-ai's 28.9M-parameter model on an $8 ESP32-S3: 10.3 to 22.6 tok/s from five exact patches, same output to the byte. PSRAM bandwidth is the limit.
A weekly email with every new guide and measured benchmark.
Subscribe — free, no spam