Skip to content
Excellence School
EXCELLENCE SCHOOL

Think Like a Scientist: Studies, Numbers and Headlines

0/15STARS
LEVEL 1 · 0/3LEVEL 2 · 0/3LEVEL 3 · 0/3LEVEL 4 · 0/3LEVEL 5 · 0/3START
0/15 stars lit

Tell strong evidence from weak: study designs, correlations, margins of error, p-values, replication, publication bias, press-release hype and your own blind spots.

2h 59m5 constellations
AT THE SUMMIT, YOU WILL BE ABLE TO

01Rank evidence and explain why randomized trials beat observation for causes

02Read margins of error, effect sizes and p-values correctly

03Spot replication problems, missing studies and retractions

04Follow headlines back to studies, and judge claims with a calibrated verdict

Every lesson of Think Like a Scientist: Studies, Numbers and Headlines

15 lessons in 5 levels, about 3 hours. Level 1 is free.

Level 1How Science Knows ThingsFree · 3 lessons
  1. The ladder of evidenceRank kinds of evidence, and see why a randomized trial overturned decades of observational studies.12 min
  2. Correlation, and three other explanationsBefore accepting “X causes Y”, check for a third factor, reverse causation and chance.12 min
  3. Checkpoint: five questions for any claimQuestion a surprising claim calmly with five checks.12 min
Level 2Numbers in StudiesMembership · 3 lessons
  1. How sure is a survey?Calculate a survey's margin of error and see how sample size changes it.12 min
  2. What a p-value is notRead p-values correctly and ask for effect sizes instead.12 min
  3. Checkpoint: how many findings are false?Estimate what share of “significant” findings are true from power, the threshold and how likely the ideas were.13 min
Level 3When Science Gets It WrongMembership · 3 lessons
  1. The replication testUnderstand what large replication projects found, and what makes a finding more trustworthy.12 min
  2. The file drawerSee how unpublished null results make the published record look more positive than reality.12 min
  3. Checkpoint: peer review isn't a guaranteeCheck a study's status before relying on it, including retractions.11 min
Level 4Read the Headline, Then the StudyMembership · 3 lessons
  1. Where exaggeration startsSee where exaggerated science news comes from, and how to read past it.12 min
  2. In mice, in cells, in peoplePlace a result on the path from cells and animals to people, and weigh it accordingly.11 min
  3. Checkpoint: before you shareCheck a claim before sharing it, and respond to a shared claim without a fight.12 min
Level 5Scientific Habits for LifeMembership · 3 lessons
  1. The ones you don't seeSpot survivorship bias when only the successes are visible.11 min
  2. Consider the oppositeUse the “consider the opposite” strategy to reduce bias when judging evidence.11 min
  3. Capstone: judge a real claimTake one real claim through every tool in the path and reach a calibrated verdict.14 min
FREE

Level 1 is open.

Membership opens every other level of this path.

See membership
AFTER THE CORE

Keep going where this path leads.