Signal Over Noise

Signal Over Noise

Mixture of Experts Changed the Question, Not the Hardware

Justin Wilson's avatar
Justin Wilson
Sep 05, 2026
∙ Paid
Upgrade to paid to play voiceover

Sparse activation is a compute trick. The expert pool is still a storage problem.

User's avatar

Continue reading this post for free, courtesy of Justin Wilson.

Or purchase a paid subscription.
© 2026 Justin Wilson · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture