p-Hacking your A/B tests
Faking results using real experiments
You are a pharmaceutical company who has blown through a billion dollars of research and development, only to produce a drug that doesn’t...
Similar Articles (10 found)
🔍 80.2% similar
The Pattern-Seeking Fallacy
What do these have in common?
- “This pitcher has retired 5 of the last 7 batters.”
- “We tried 10 AdWords variants and co...
🔍 72.2% similar
Solving the Low-Budget Online Marketing Dilemma
Stop me if you’ve heard this one:
Your bootstrapped startup is finally off the ground. You’re able to ...
🔍 71.2% similar
What if your car worked like so many apps? You’re driving somewhere important…maybe running a little bit late. A few minutes into the drive, your car ...
🔍 67.6% similar
The Iterative-Hypothesis customer development method
This is a simple but effective process for building knowledge through interviewing (potential) cu...
🔍 67.2% similar
The Serengeti Plain: Fallacies that aren’t fallacies
I never want to hear this narrative again:
- Back when humans were living in the…
- Serengeti Pla...
🔍 67.2% similar
Stubborn Visionaries & Pigheaded Fools
The puzzle
- Scenario 1 (S1)
- At time (A) you start an AdWords campaign.
At time (B) it’s obviously not workin...
🔍 67.2% similar
Easy statistics for A/B testing and hamsters
This video explains the concept, as well as the statistical principle that explains the mental fallacy th...
🔍 67.2% similar
Business Advice Plagued by Survivor Bias
Do you read articles written by a founder who failed three times, never finding success?
No, because you want...
🔍 66.8% similar
The “errors” that mean you’re doing it right
If you don’t make mistakes, you’re not working on hard enough problems.
—Frank Wilczek, 2004 winner of No...
🔍 66.7% similar
Put down the compiler until you learn why they’re not buying
New companies rarely have a problem writing code.
The problem they have is: We don’t have...