« Does Nicolas Bourbaki read Charles Dikkens? | Even a googol zeros add up to nothing » |
Here's an interesting way to take metrics dysfunction to an entirely different level. Examples abound of optimizing for only easy-to-measure aspects of an activity and getting, well, what was measured. The new and innovative idea described here is to select among activities based on which of them have easy-to-obtain metrics.
Another way to look at this is to view it as a version of the problem of measuring inputs rather than outputs. Choosing a course of action should be based on some model of expected value -- and metrics should be chosen based on the actionable insight they are likely to yield.