2/3/22, 9:31 PM The Bitter Lesson
The Bitter Lesson
Rich Sutton
March 13, 2019
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage
computation are ul...
Similar Articles (10 found)
🔍 84.2% similar
Does the Bitter Lesson Have Limits?
Recently, “the bitter lesson” is having a moment. Coined in an essay by Rich Sutton, the bitter lesson is that, “g...
🔍 76.7% similar
The Bitter Lesson is Misunderstood
Together, the Bitter Lesson and Scaling Laws reveal that the god of Compute we worship is yoked to an even greater ...
🔍 67.5% similar
First, thanks to the publisher and authors for making this freely available!
I retired recently after using neural networks since the 1980s. I still s...
🔍 65.2% similar
Why AI Development May Soon Escape Human Control?
A Technical Analysis of AI Development Through 2027
Where This is All Heading (tl;dr)
After absorbin...
🔍 65.1% similar
What AI is Really For
Best case: we’re in a bubble. Worst case: the people profiting most know exactly what they’re doing.
After three years of immers...
🔍 64.5% similar
> the generation of 281,128 augmented examples, from which 1,000 were
held out as a benchmark test set.
This model is trained on a custom dataset of 2...
🔍 63.9% similar
Things I’ve learned in my 7 Years implementing AI
Even though the impacts of LLMs have never been seen before, they feel familiar to earlier assumptio...
🔍 63.8% similar
If you're a solo developer building your next Salesforce killer, you will feel that dopamine rush every time AI helps you get closer to launch.
Don't ...
🔍 63.1% similar
Agree with much of this—particularly that these systems are uncannily good at inferring how to 'play along' with the user and extreme caution is there...
🔍 62.9% similar
AlphaGo, in context
Update Oct 18, 2017: AlphaGo Zero was announced. This post refers to the previous version. 95% of it still applies.
I had a chance...