NVIDIA's 74B Nemotron 3.5 Bolt on one RTX 3090: 128K context loads with 2,310 MiB spare, about 90 tok/s decode, 82.42 at 100K deep. Measured, with misses.
A weekly email with every new guide and measured benchmark.