I’ve had a few people e-mail me about a mini-study in the Milwaukee Journal-Sentinel that examines changes in performance by players named in the Mitchell Report. The authors interpret the results as evidence that the performance-enhancing drugs mentioned in the report “boosted” player performances.
This one is a real head-scratcher, because as I read the study it seems indicate the drugs had no effect on performance. This is without even taking into account other methodological problems with the study. Luckily, my buddy Frank Stephenson (economics prof. at Berry College) properly criticizes the study and crunches the numbers at Division of Labour.
The Mitchell Report named 86 players so finding 46 (a mere 54%) that improved might well nothing more than random chance. Indeed, 46 is less than one standard deviation (4.6) away from 43 for a binomial distribution with n=86 and p=.5. Could it be that the Freakonomics guys have been, ahem, fooled by randomness?