PSRAM
An $8 chip, twice as fast, same story
esp32-ai's 28.9M-parameter story model on an $8 ESP32-S3: 10.34 to 22.59 tok/s from five patches, the same 200-token story byte for byte. Plus four new articles, an unpatched LMCache hole and six Quick Hits.
LLM on a Microcontroller: ESP32-S3 at 22.6 tok/s
esp32-ai's 28.9M-parameter model on an $8 ESP32-S3: 10.3 to 22.6 tok/s from five exact patches, same output to the byte. PSRAM bandwidth is the limit.
A weekly email with every new guide and measured benchmark.
Subscribe — free, no spam