Signal Over Noise

Signal Over Noise

How to Benchmark a Local Model Without Lying to Yourself

Justin Wilson's avatar
Justin Wilson
Sep 23, 2026
∙ Paid
Upgrade to paid to play voiceover

A useful benchmark is a reproducible workload record, not the fastest number the terminal printed.

User's avatar

Continue reading this post for free, courtesy of Justin Wilson.

Or purchase a paid subscription.
© 2026 Justin Wilson · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for writing, podcasting, and media founders.