Consensus Over Single Studies
Rely on repeated evidence across labs and conditions, not single studies.
This framework emphasizes that scientific truth is best approximated by consensus—repeated findings across multiple independent labs, funding sources, countries, and conditions over time. It counters the common mistake of overvaluing single, dramatic studies. Norton uses creatine monohydrate as a prime example: thousands of experiments over decades show it works for strength, muscle, and cognition. The framework teaches that while individual studies (even RCTs) have limitations and biases, patterns across many studies reveal reliable signals. It's a mental model for navigating noisy scientific information, especially in nutrition and fitness where single studies often get exaggerated.
- A single study, regardless of design, is a data point, not a conclusion.
- Truth emerges from repetition across different labs, researchers, and conditions.
- The more extreme or novel a claim, the more replication it requires.
- Consensus doesn't mean unanimity; it means a strong preponderance of evidence points one way.
- Never turn your brain off just because something is published or comes from a famous researcher.
- Identify the ClaimClearly state the specific health or nutrition claim you're evaluating (e.g., 'X supplement builds muscle').Pro tipBeware of claims using absolute language like 'best,' 'worst,' 'always,' 'never.'WarningDon't get distracted by dramatic headlines or social media posts; dig for the underlying claim.
- Seek Systematic Reviews & Meta-AnalysesLook for high-level evidence syntheses first. These papers aggregate results from many studies, providing a consensus view.Pro tipUse databases like PubMed and search for '[topic] systematic review' or '[topic] meta-analysis.'WarningNot all reviews are equal; check if they are recent, comprehensive, and from reputable sources.
- Check for Independent ReplicationSee if multiple independent research groups have found similar results. Look for studies from different countries, funded by different sources, using slightly different methodologies.Pro tipA finding supported by both academic and industry-funded studies (with transparent funding) is stronger.WarningBe skeptical of findings that only come from one lab or one tightly connected network of researchers.
- Assess the Weight of EvidenceMake a judgment call. If 20 out of 25 quality studies point in one direction, that's a strong consensus. If it's 13 to 12, the evidence is equivocal.Pro tipNorton cites creatine: a search for 'does creatine build muscle' yields ~92% 'yes'—that's a strong consensus.WarningAvoid 'cherry-picking'—selectively citing the few studies that support your pre-existing belief.
- Apply with Appropriate ConfidenceAct on high-consensus findings with high confidence. For low-consensus areas, acknowledge uncertainty and don't plant your flag strongly.Pro tipNorton notes he rarely plants his flag strongly; when he does, it's because the consensus is overwhelming.WarningDon't mistake consensus for infallibility; science updates with new evidence, but consensus changes slowly.
Norton points to creatine as a classic example. Thousands of experiments over decades, from hundreds of labs worldwide, under various conditions, consistently show that 5-10g per day benefits strength and muscle mass.
A single recent study suggested more than 30g of protein per meal can be used for muscle synthesis. While interesting, Norton does not change his overall stance (that total daily protein is primary, distribution secondary) based on this one study, citing the need for more replication and the existing consensus from other human and animal data.
Developed through Norton's PhD training and years of reviewing literature. He observed that many people latch onto single studies (often poorly designed or overhyped) while ignoring the broader body of evidence. His PhD advisor instilled the principle to 'always question everything, even the things we feel most fundamentally are true.' This framework emerged as a practical tool to separate durable knowledge from fleeting findings.