Compute is cheap. Picking the job is not.

Author: Diogo Almeida

2026-09-10

The Bitterest Lesson

Complete Skeptic

If you train a huge model to do the wrong job, it gets better at the wrong job. Diogo's point is that someone still has to name the task. Classify starts there too: what should Jev decide?

The Bitterest Lesson

TL;DR: Compute drives progress in AI, but what good is progress if you are not doing the right task!

Rich Sutton's bitter lesson states that compute beats algorithms.