Statistics Done Wrong: How scientists abuse statistics

Statistical results are everywhere in science. When the Higgs boson discovery was announced, nearly every news article mentioned how there was just a one in 1.74 million chance that the results were a statistical fluke. Well, that’s not entirely true: some said one in 5 million, others one in 2 million, others one in a million.

All of them were wrong.

The science journalists had fallen into one of the most common statistical traps in modern science. Read through recently-published scientific papers and you will find many other errors, from the subtle to the glaring. Scientists often aren’t formally taught statistics, so data analysis tends to be a seat-of-the-pants affair.

There are many kinds of error and many examples in the literature, so I decided to put together a guide. No prior statistical knowledge required. I hope you’ll read it through, print a copy, and use it to smack people who continue to make statistically unjustified claims.

Link: Statistics Done Wrong, a guide


Shut up and listen to your students

Are conventional lectures the best method of teaching scientific concepts? After all, we’ve been using the same lecture model for hundreds of years — since before books were invented. We have professors concoct their own explanations of scientific concepts, deliver them by lecture, create their own diagrams on the chalkboard, and answer student questions. Surely


Independence Day 2.0

SUPERBOWL SUNDAY, 22,000 MILES ABOVE THE EQUATOR Life as a satellite is disappointing. The first few hours are exhilarating, full of rocket blast, thrusters, and challenging equipment tests, but the average satellite soon settles into a dreary monotony. A well-designed satellite can hope for perhaps a few thruster firings or a large solar flare to


Gnome Physics

All subatomic particles — electrons, protons, neutrons and so on — are composed of extremely small gnomes. While relatively unknown, the gnome theory of matter can successfully explain many physical phenomena, including gravitation, electromagnetism, the photoelectric effect, and the wavelike properties of matter. Gravitation It is widely known that gnomes are a rambunctious species, preferring


Statistical Significance of Doom (part 2)

False positives are somewhat scarier than false negatives. What if my research claims a drug cures cancer, giving thousands of sufferers hope, but it turns out to be useless? (Before you go on, make sure you’ve read part 1 in my series on statistical significance, since it has some important detail.) If we followed the


Statistical Significance of Doom (part 1)

I was recently assigned to give a 25-minute presentation on a subject of my choice. After choosing “scientific dishonesty and fraud,” I happened upon a paper by John Ioannidis claiming that “Most Published Research Findings Are False.” After skimming through Ioannidis’ paper and reading some of the references, I quickly changed my presentation’s title to


Psychic Powers

Skeptics sometimes remark that if psychic powers were real, psychics would have a genuine evolutionary advantage, and so eventually everyone would evolve to be psychic. But we aren’t, they say, so psychic powers must not exist. It is a little-known fact that this evolution already happened. Many animals evolve mechanisms to show off to potential


Breaking News

ATLANTA — In a news conference Saturday, CNN president Ken Jautz announced that CNN’s hyperbole reserves will be empty by the end of next week. “Despite our best efforts, we have depleted our strategic hyperbole reserves and will be unable to continue news broadcasts until we can acquire further reserves,” said Jautz to gathered news


Releasing ipbLatex

At SFN, we use a custom LaTeX solution to render LaTeX equations in Invision’s IP.Board. The implementation is based on Dave’s vbLatex, which produces incredibly nice-looking equations so long as you have LaTeX installed. It also supports inline chemical equations using the mhchem package. Since we moved to IPB over vBulletin, I’ve adapted vbLatex to


Blog Searching

SFN now has global blog searching. Use the search box in the upper right to search for terms in blog posts, or use View New Content or View Active Content to see recent blog posts. Report any bugs you find to me.