FINANCEOngoing practice87% confidence

Efficient Markets as a Useful Fiction

Act as if markets are efficient — not because they are, but because the assumption protects you.

Problem it solves

Believing markets are so inefficient that you can reliably exploit them without professional-grade resources

Best for

Investors deciding between active and passive strategies, or evaluating claims of market-beating products.

Not ideal for

Professional market participants whose entire role is to find and close specific pricing inefficiencies — the framework is about default behaviour for non-specialists.

Overview

Why this framework exists

The Efficient Markets Hypothesis (EMH) says that prices already reflect all available information, making it impossible to systematically beat the market through analysis. Harford takes a pragmatic position: markets are probably not perfectly efficient, but they are efficient enough that you should act as if they are. This is a subtle but important reframe — he is not defending EMH as literally true, but as a useful operating assumption.

The practical implications of treating markets as efficient are clear: buy an index fund (if markets are efficient, stock picking offers no systematic advantage); reject no-free-lunch products (if something offers exceptional returns with low risk, it isn't safe — the pricing is wrong, not the risk model); and be deeply sceptical of anyone claiming an obvious edge. These are the right defaults for the vast majority of investors.

Harford identifies specific ways markets systematically err — small companies tend to be better value than large ones, certain calendar effects have persisted, valuation-based measures of over- and under-valuation do have predictive power at extremes. These anomalies exist. His point is that identifying and exploiting them reliably enough to overcome transaction costs and fees is a professional endeavour, not a retail one. The correct response to knowing markets are imperfect is not to try to beat them — it is to use the most efficient vehicle available (low-cost index funds) and to exercise scepticism toward any product claiming a costless free lunch.

Core principles

5 total
  1. Markets are not perfectly efficient, but they are efficient enough that the default should be to act as if they are.
  2. If an investment product claims high returns with low risk, the model is wrong — not the risk.
  3. The no-free-lunch principle is one of the most reliable outputs of market efficiency thinking.
  4. You don't need everyone to be a stock-picker to keep prices approximately right — a small minority of active participants does the work for everyone else.
  5. The correct response to market imperfection for a non-specialist is the lowest-cost index fund, not individual stock picking.

Steps

4 steps
  1. Treat the efficient market as your default model
    Before evaluating any investment opportunity, ask: 'If markets were efficient, what would this look like?' That baseline tells you whether the opportunity is plausible or requires you to believe the market has missed something obvious. Most opportunities that look attractive are not obvious market failures — they are priced correctly for a risk you haven't identified.
    Pro tipThe burden of proof belongs to whoever is claiming the inefficiency, not to the sceptic. Ask them to articulate specifically what the market has missed and why others haven't already closed the gap.
  2. Apply the no-free-lunch test to every product claim
    Pre-2008 financial products claimed 10% returns with investment-grade safety. The EMH-informed response is: that is impossible. High returns require high risk — always. Any product claiming otherwise has either mispriced the risk or is misleading you. The mathematical certainty of this principle means it should be a hard filter, not a discussion.
    Pro tipThe phrase 'this is paying 80% a month, why would they be selling it to me?' is the correct intuition. If the deal is that good, why is it available to you?
    WarningThis doesn't mean every legitimate high-return product is a scam — private equity, venture, and small-cap investing do carry higher expected returns alongside genuinely higher risk. The test is whether risk is proportional, not whether returns are high.
  3. Recognise that systematic anomalies exist but are not reliably exploitable
    Academic research has documented real market anomalies — small-cap premium, value factor, calendar effects. Acknowledge these without treating them as a reason to abandon indexing. The question is not whether anomalies exist but whether you can exploit them reliably after costs. The evidence says most people cannot.
    Pro tipEqual-weight index funds are a legitimate response to concentration risk in cap-weighted indexes without abandoning the indexing principle. This is Harford's suggested solution for investors worried about over-concentration in large caps.
  4. Be the informed grocery shopper, not the price-setter
    Harford uses the supermarket analogy: you don't personally check every competitor's price for every product, but you benefit from those who do, because competition keeps prices fair. In markets, a minority of active stock-pickers keeps prices approximately efficient. You can free-ride on their work by buying an index fund without contributing the effort or cost of price discovery yourself.
    Pro tipThis also explains why markets don't collapse even as indexing grows to 50% of assets — you only need a minority actively price-setting to maintain approximate efficiency for everyone.
    WarningIf active participation drops to near-zero, the model breaks down — fundamental analysis would offer extraordinary returns to whoever did it. But that tipping point is far from current market conditions.

Checklist

Saved in your browser

Examples

3 cases
Pre-2008 structured products

Professional investors — pension funds, banks — bought structured products in 2006-7 that promised 10% returns with investment-grade risk ratings. The Efficient Markets Hypothesis, applied correctly, says this is impossible: 10% is not investment-grade risk. The EMH as useful fiction would have been the correct defence.

OutcomeThe products failed catastrophically in 2008. The risk was real; the model was wrong. Investors who had applied the no-free-lunch heuristic would have avoided them.
The Stiglitz paradox

Nobel Prize-winning economist Joe Stiglitz wrote a paper showing that if literally everyone indexed, prices would become random — fundamental analysis would earn extraordinary returns. Harford uses this to show that markets don't require universal active participation to remain efficient — just a small minority doing the price-setting work.

OutcomeAt today's roughly 50% passive penetration, this is not yet a concern — and the self-correcting mechanism (rising returns to active analysis as indexing grows) means the system is stable over a wide range.
The Tesco shopper analogy

Harford describes the 'grandmother in the checkout queue with all her vouchers' — the active shopper who checks competitor prices and uses coupons. Her effort keeps supermarket prices fair for everyone who doesn't bother comparing. Index fund investors free-ride on the stock-pickers who set prices, just as casual shoppers free-ride on the price-conscious grandmother.

OutcomeThe analogy clarifies why markets remain approximately efficient even as indexing grows: you only need a minority doing the active comparison work for the market to function.

Common mistakes

4 traps
Treating occasional market irrationality as systematic exploitability
Markets do sometimes overshoot or undershoot. Identifying that they are overvalued using a cyclically adjusted P/E does not translate into knowing when they will correct or by how much. The evidence suggests timing these corrections is not reliably possible for retail investors.
Using the existence of anomalies to justify active management fees
Small-cap and value premiums exist in academic research but are partially arbitraged away in practice, are volatile over long periods, and are insufficient on their own to justify a 2% active management fee. Anomaly-existence does not equal anomaly-exploitability at that cost level.
Accepting high-return / low-risk products without EMH scrutiny
The pre-financial-crisis structured products sold bank-to-bank promised 10% with AAA safety ratings. EMH says this is impossible. It was impossible. The professionals selling them had temporarily suspended the no-free-lunch principle for career reasons.
Conflating knowing the narrative with knowing the price
Harford is explicit: AI being important, electric cars being important, railways being important does not mean any particular company's stock at any particular price is good value. The market already knows the narrative. The price is the market's bet on the discounted future cash flows — and that bet is harder to beat than the narrative would suggest.

Origin story

How this framework came to be

Harford grounds this discussion in Paul Samuelson's original challenge to active managers — his 'Challenge to Judgment' essay — and in the history of the index fund from Bogle's launch in 1976. He notes that Samuelson described the index fund as equivalent to the invention of the wheel or wine and cheese. The EMH as useful fiction framing is Harford's own synthesis: treating a model as operationally true even when you know it is an approximation is a standard scientific technique, and he applies it to investment behaviour.

Source

Traced to primary
Source · PODCAST
Do We Need To Change Our Minds About Index Funds?
Tim Harford · 2025
Open source →

Related frameworks

Browse all Finance →