Three Data Fallacies Framework
Avoid the data traps that derail innovation decisions
Christensen identifies three systematic ways that data misleads innovation efforts, even when the data itself is accurate. These fallacies explain why companies with more data and better analytics often make worse innovation decisions than entrepreneurs with deep qualitative insight.
The Fallacy of Active vs. Passive Data occurs when companies prioritize the data they actively generate (sales figures, demographics, market share) over the passive data that reveals the job (customer struggles, context of use, emotional dimensions). Active data is loud and structured; passive data is quiet and must be sought. The Fallacy of Surface Growth occurs when companies use data to find ways to sell more products to existing customers without understanding whether those products serve the same job or a different one. The Fallacy of Conforming Data occurs when data is unconsciously filtered and interpreted to support existing beliefs, creating an illusion of evidence-based decision-making.
Together, these three fallacies explain why so much data-driven innovation produces only incremental improvements while missing breakthrough opportunities that would be obvious through a jobs lens.
- Data organized around product categories and customer demographics cannot reveal why customers make choices
- Active data that companies generate naturally drowns out the passive data that reveals actual jobs
- Selling more products to existing customers is not growth if those products do not serve a genuine job
- Confirmation bias causes organizations to unconsciously filter data to support pre-existing beliefs
- Nearly all data is an abstraction of reality and requires interpretation, which introduces human bias
- Audit Your Data Sources for Active vs. Passive BiasExamine what data your organization routinely collects and analyzes. Most of it will be active data: sales numbers, demographics, market share, product performance metrics. Identify what passive data about customer struggles, context, and emotional dimensions is not being captured.Pro tipPassive data about jobs rarely shows up in dashboards. It lives in customer service calls, observational research, and the stories salespeople tell at lunch. Create systems to capture and elevate this data.
- Test for Surface Growth TrapsFor every growth initiative, ask whether it serves a genuine job or simply adds products that happen to be adjacent in your category. Growth that does not align with a clear job will dilute your brand and create complexity without creating customer value.Pro tipV8 fusion drinks and V8 soups were surface growth moves that did not serve the core job. The data said customers bought vegetable products, so more vegetable products should work. But the job was about guilt, not vegetables.WarningSurface growth is seductive because the data supports it. Adjacent products sold to existing customers through existing channels look like safe bets. But they erode focus on the core job.
- Challenge Conforming DataBefore major innovation decisions, actively seek data that contradicts your hypothesis. Assign someone the explicit role of finding disconfirming evidence. Examine whether the data chain from collection to presentation has been filtered toward a predetermined conclusion.Pro tipGerald Zaltman notes that the misuse of data is often not deliberate but reflexive. Executives do not realize their data has been pre-filtered through layers of analysis that each slightly skewed the interpretation toward what leadership wanted to hear.
- Complement Quantitative Data with Job StoriesFor every data-driven decision, ensure you also have rich qualitative narratives about specific customers and their jobs. A single detailed customer story can reveal more about innovation opportunity than a thousand survey responses.Pro tipThe healthiest mindset is that nearly all data, qualitative and quantitative, is built on human decisions about what to capture and how to categorize it. Treat all data as an imperfect proxy for reality, not reality itself.
Campbell's had extensive data showing V8 competed in the juice and beverage category. All their innovation efforts focused on taste improvements and line extensions within that category. But through a jobs lens, V8's real competition was the vague guilt people felt about not eating enough vegetables. The job was not 'drink something tasty' but 'feel virtuous about my vegetable intake without the hassle of preparing actual vegetables.' Framing the competition as other juices led to years of misguided innovation.
A discount retailer noticed through data analysis that a large percentage of shoppers came in to cash their paychecks on Friday evenings and then shopped for groceries. The data suggested optimizing the checkout experience and store layout for efficiency. But the passive data revealed the actual job: these customers, living paycheck to paycheck, needed to stretch every dollar as far as possible while maintaining dignity. The discount retailer was competing not with other grocery stores but with the anxiety of running out of money before the next paycheck.
Christensen developed this framework from observing the persistent paradox that companies with the most sophisticated data and analytics capabilities were often the worst at breakthrough innovation. The V8 juice case was illustrative: Campbell's had mountains of data showing V8 competed in the juice aisle and needed to differentiate on taste and nutrition. But through a jobs lens, V8's real competition was the guilty feeling people had about not eating enough vegetables. The data created a false picture of the competitive landscape because it was organized around product categories rather than customer jobs.
The framework also draws on the work of Gerald Zaltman at Harvard Business School, who demonstrated that 95 percent of our purchase decisions are made unconsciously. If customers cannot articulate their real motivations, then data gathered from surveys and stated preferences will systematically mislead.