Here is an excerpt from the article "Peer review: Trial by Twitter". This article discusses how blogs and tweets are ripping scientific research papers apart.
"Scientists discover keys to long life," proclaimed The Wall Street Journal headline on 1 July last year. "Who will live to be 100? Genetic test might tell," said National Public Radio a day later.
These and hundreds of similarly enthusiastic headlines were touting a paper in Science1 in which researchers claimed to have identified a set of genes that could predict human longevity with 77% accuracy — a finding with potentially huge implications for medicine, health policy and the economy.
But even as the popular media was trumpeting the finding, other researchers were taking to the web to criticize the paper's methodology. "We expect that most of the results of this study will not have the same longevity as its participants," sniped a blog posted by researchers at the personal genomics company 23andMe, based in Mountain View, California.
Critics were particularly perturbed by the genome-wide association study (GWAS) that the authors had used to identify their longevity genes: the centenarians and the controls in the study had been tested with different kinds of DNA chips, which potentially skewed the results.
"Basically anybody that does a lot of GWAS knows this [pitfall], which is why we all said it so fast," says David Goldstein, director of Duke University's Center for Human Genome Variation, who voiced his concerns to a Newsweek blogger the day the study appeared.
This critical onslaught was striking — but not exceptional. Papers are increasingly being taken apart in blogs, on Twitter and on other social media within hours rather than years, and in public, rather than at small conferences or in private conversation. In December, for example, many scientists blogged immediate criticisms of another widely publicized paper2 — this one heralding bacteria that the authors claimed use arsenic rather than phosphorus in their DNA backbone."
http://www.nature.com/news/2011/110119/full/469286a.html?s=news_rss
Ouch! One of the major advantages and disadvantages of technology is that people can tell you what they think of your work very quickly. I believe this trend of near instant criticisms will continue for as long as people Blog and Tweet or whatever they end up evolving into. This means that even if there is nothing really wrong with a paper you have written there is always someone bringing it down.
ReplyDelete