Traction Testing Methodology
Run cheap, fast, quantitative tests to find which channel can move the needle
Traction Testing is the systematic experimentation methodology that powers the Bullseye framework. It operates at two levels: middle ring tests that evaluate whether a channel could work, and inner ring tests that optimize a chosen channel for maximum performance.
Middle ring tests are designed to be cheap and fast, typically under $1,000 and one month. They answer three questions: What does it cost to acquire a customer through this channel? How many customers are available? Are these the right customers? The goal is comparison across channels, not optimization within any single one.
Inner ring tests shift to optimization once a core channel is identified. This involves continuous A/B testing of every variable within the channel, from ad copy and landing pages to email sequences and signup flows. The methodology also accounts for the Law of Shitty Click-Throughs: over time all marketing strategies become less effective as they get crowded, so you must constantly discover new strategies and tactics within your core channel to stay ahead.
- Every test should have a specific hypothesis to validate or invalidate, defined before the test begins
- Middle ring tests are for comparison across channels, not optimization within them
- All marketing strategies degrade over time as competitors crowd in (Law of Shitty Click-Throughs)
- A/B testing as a weekly habit can improve channel efficiency by two or three times
- The faster you run high-quality experiments, the more likely you find scalable growth tactics
- Quantify everything: customer acquisition cost, conversion rate, available customers, lifetime value
- Set Up Tracking InfrastructureBefore running any tests, implement tracking and reporting systems. This can be as simple as a spreadsheet or as complex as analytics tools like Mixpanel or Chartbeat. You must be able to detect actual conversions (not just clicks) and attribute them to specific channels and tests. Do not start testing until this is in place.
- Design Middle Ring Tests for Each Promising ChannelFor each channel in your Bullseye middle ring, design a test that costs under $1,000 and takes under one month. The test must answer: What is the customer acquisition cost? How many customers are reachable? Are they the right customers? Examples: spend $250 on AdWords to test SEM, run 4 Facebook ads to test social, contact 10 niche blogs to test blog targeting.
- Run Tests in Parallel and Compare ResultsExecute middle ring tests simultaneously across your 2-3 selected channels. Record results in a comparison spreadsheet with standardized columns: customers available, conversion rate, cost to acquire, lifetime value. Use simple calculations to determine which channel can plausibly move the needle for your traction goal.
- Shift to Inner Ring OptimizationOnce you identify your core channel, shift to continuous optimization through A/B testing. Focus on one major area at a time for weeks (such as signup conversion rate), trying everything you can think of to improve that metric. Then move to the next metric. Run at least one A/B test per week.
- Discover New Strategies to Combat SaturationContinuously brainstorm and test new channel strategies within your core channel. Consider how other traction channels can feed into your core channel in novel ways. The goal is to stay ahead of the Law of Shitty Click-Throughs by finding tactics that have not yet been crowded out.
Zynga dominated Facebook's advertising and sharing features when there was relatively little competition on the platform. They ran aggressive tests on Facebook ads and viral sharing mechanics while competitors were focused on traditional web marketing channels. This early-mover testing gave them deep optimization data that competitors could not replicate.
The testing methodology was shaped by Andrew Chen's observation that all marketing strategies eventually degrade in effectiveness as more companies discover and crowd into them, a pattern he named the Law of Shitty Click-Throughs. Early banner ads had 75%+ click-through rates that eventually plummeted to fractions of a percent. This reality means that static marketing approaches are doomed, and only continuous testing and discovery of new tactics can sustain growth.