swombat.com

daily articles for founders

Dangerous data: three kinds of lies  

Data is a dangerous tool in making decisions. You need to understand the different ways in which it can fail you before you can make good use of it. Otherwise, you might make completely wrong data-driven decisions.

And then, of course, there's also some decisions (for example, high-level design decisions) which must be made based on something other than data.

This article outlines three possible failure modes of data-driven decisions, with Digg's catastrophic failure earlier this year as the backdrop for the points.

  1. Ask boring or loaded questions which can lead to self-fulfilling results;
  2. Get lazy and sample something too small or too favorable to the answers you hope to find;
  3. See patterns and correlations where there are none.
More from the library:
Recruiting programmers to your startup
Hardware startups and quality
Startup vs Lifestyle Business
Google Analytics Alternative