The Numbers Guy: Statistics Used and Abused

Carl Bialik via a kind reader's email:

Even when stats are reliable, they may not tell the whole picture. Aldritt pointed to the example of testing results, which may indicate more about success in teaching to a test than in overall education.

The irony of the poor survey results is that, at least according to Mr. Aldritt and independent statisticians, U.K. stats are generally reliable. He says the main problem comes in the beginning and end of the process -- "deciding which statistics should be published, and explaining how they should be used."

However, the authority will have to reserve judgment until it begins issuing its assessments, in the next month or so. And recent statistical snafus elsewhere illustrate that getting the basic numbers right isn't always easy. A government audit of South Korean statistics found that farms with thousands of chickens were reported as lacking the birds, and that unclaimed dead bodies weren't being included in death counts. A spokesman for the National Statistics Office said the office is gathering relevant documents to determine how to punish those at fault.

Posted by Jim Zellmer at June 7, 2009 5:01 AM
Subscribe to this site via RSS/Atom: Newsletter signup | Send us your ideas