swombat.com

daily articles for founders

Dangerous data: three kinds of lies  

Data is a dangerous tool in making decisions. You need to understand the different ways in which it can fail you before you can make good use of it. Otherwise, you might make completely wrong data-driven decisions.

And then, of course, there's also some decisions (for example, high-level design decisions) which must be made based on something other than data.

This article outlines three possible failure modes of data-driven decisions, with Digg's catastrophic failure earlier this year as the backdrop for the points.

  1. Ask boring or loaded questions which can lead to self-fulfilling results;
  2. Get lazy and sample something too small or too favorable to the answers you hope to find;
  3. See patterns and correlations where there are none.
More from the library:
More on splitting equity 50/50 or not
You should probably send more email than you do
How to run an evening event
Google Analytics Alternative