Microcontroller
The chip that draws more power uses less of it
Energy per token at the USB port: the ESP32-P4 board used 7.909 mJ against the ESP32-S3's 14.709 while drawing more power. Plus used GPU prices on 39 guides, llama.cpp flag changes and six Quick Hits.
ESP32-P4 vs ESP32-S3: Energy per Token, Measured at the USB Port
Board-level energy per token for a TinyStories model: ESP32-P4 7.9 mJ, ESP32-S3 12.4-14.7 mJ. The P4 draws more power and still uses about 46% less per token.
An $8 chip, twice as fast, same story
esp32-ai's 28.9M-parameter story model on an $8 ESP32-S3: 10.34 to 22.59 tok/s from five patches, the same 200-token story byte for byte. Plus four new articles, an unpatched LMCache hole and six Quick Hits.
LLM on a Microcontroller: ESP32-S3 at 22.6 tok/s
esp32-ai's 28.9M-parameter model on an $8 ESP32-S3: 10.3 to 22.6 tok/s from five exact patches, same output to the byte. PSRAM bandwidth is the limit.
A weekly email with every new guide and measured benchmark.
Subscribe — free, no spam