The Bitter Lesson is Misunderstood
Together, the Bitter Lesson and Scaling Laws reveal that the god of Compute we worship is yoked to an even greater one — the god of Data.
tl;dr: For years, we've bee...
Similar Articles (10 found)
🔍 80.8% similar
Does the Bitter Lesson Have Limits?
Recently, “the bitter lesson” is having a moment. Coined in an essay by Rich Sutton, the bitter lesson is that, “g...
🔍 76.7% similar
2/3/22, 9:31 PM The Bitter Lesson
The Bitter Lesson
Rich Sutton
March 13, 2019
The biggest lesson that can be read from 70 years of AI research is tha...
🔍 72.7% similar
> the generation of 281,128 augmented examples, from which 1,000 were
held out as a benchmark test set.
This model is trained on a custom dataset of 2...
🔍 71.3% similar
First, thanks to the publisher and authors for making this freely available!
I retired recently after using neural networks since the 1980s. I still s...
🔍 70.5% similar
What happens when coding agents stop feeling like dialup?
It's funny how quickly humans adjust to new technology. Only a few months ago Claude Code an...
🔍 70.2% similar
Why AI Development May Soon Escape Human Control?
A Technical Analysis of AI Development Through 2027
Where This is All Heading (tl;dr)
After absorbin...
🔍 69.4% similar
What AI is Really For
Best case: we’re in a bubble. Worst case: the people profiting most know exactly what they’re doing.
After three years of immers...
🔍 69.1% similar
Intro
I was listening, recently, to an episode of The Pragmatic Engineer podcast with Armin Ronacher, and something he said really resonated with me. ...
🔍 67.9% similar
For some reason they focus on the inference, which is the computationally cheap part. If you're working on ML (as opposed to deploying someone else's ...
🔍 67.8% similar
I'm curious why we seem convinced that this is a task that is possible or something worthy of investigation.
I've worked on language models since 2018...