Should you beleive everything on the arXiv?

For those of you who do not know, the arXiv is an online repository of reprints in physics, mathematics, nonlinear science, computer science, qualitative biology, qualitative finance and statistics. In essence it is a place that scientists can share their work and work in progress, but note that it is not peer reviewed. The arXiv is owned and operated by Cornell University and all submissions should be in line with their academic standards.

So, can you believe everything on the arXiv?

In my opinion overall the arXiv is contains good material and is a vital resource for scientists to call upon. Many new works can be made public this way, before being published in a scientific journal. Indeed, most of the published papers I have had call to use have versions on the arXiv. Moreover, the service is free and requires no subscription.

However, there can be errors and mistakes in the preprints, both “editorial” but more importantly scientifically. Interestingly, overall the arXiv is not full of crackpot ideas despite it being quite open. There is a system of endorsement in place meaning that an established scientist should say that the first preprint you place on the arXiv is of general interest to the community. This stops the very eccentric quacks in their tracks.

There has been some widely publicised examples of preprints on the arXiv that have cursed a stir within the scientific community. Two well-known examples include

A. Garrett Lisi, An Exceptionally Simple Theory of Everything arXiv:0711.0770v1 [hep-th],

and more recently

V.G.Gurzadyan and R.Penrose, Concentric circles in WMAP data may provide evidence of violent pre-Big-Bang activity arXiv:1011.3706v1 [astro-ph.CO],

both of which have received a lot of negative criticism. Neither has to date been published in a scientific journal.

Minor errors and editing artefacts can be corrected in updated versions of the preprints. Should preprints on the arXiv be found to be in grave error, the author can withdraw the preprint.

With that in mind, the arXiv can be a great place to generate feedback on your work. I have done this quite successfully in the past. This allowed me to get some useful comments and suggestion on work, errors and all.

My advice is to view all papers and preprints with some scepticism, even full peer review can not rule out errors. Though, always be more confident with published papers and arXiv preprints that have gone under some revision. Note that generally people who place preprints on the arXiv are not trying to con or trick anyone, all errors will be genuine mistakes.

3 thoughts on “Should you beleive everything on the arXiv?”

  1. More specifically what procedures do you follow before releasing a preprint of your own? Do you have an editor of sorts? Doy you have your preprint revised by your peers even before a submission to the ArXiv? How seriously do you take submitting your preprints?

  2. I will tend to send the preprints to experts in the field to get some initial feedback. If they do not spot any huge mistakes and I am happy I will submit it. Of course this is no guarantee that I have not missed something.

    You can trust everything I have on the arXiv at the moment, I hope! I don’t think there are any scientific errors. (Typos and editing artefacts I am sure remain)

    Though, I will confess I have withdrawn one preprint, it was not really ready when I submitted it. Learnt my lesson on that one!

    (arXiv:1010.0544v1 [math-ph] should be officially withdrawn Monday, there are some mistakes in the theorems at the end)

Leave a Reply

Your email address will not be published. Required fields are marked *