Sunday, November 04, 2007

Open access vs. peer review

I wanted to blog about open access issues: I never quite understood what all the hooplah is about - arxiv existed for well over decade, but as any CM physicist can tell you, arxiving a paper doesn't mean much until it went through peer review and got published in at least somewhat respectable journal. To me, peer review combined with some selectivity (not all papers are accepted, even if the work done is correct) is crucial - both in terms of evaluating quality of my own work, but also in trying to keep up with the literature (reading a couple of papers a week from Nature, Science and PRL is a lot easier than combing through hundreds in arxiv or conference proceedings).

But since the peer review process requires participation from editors, they have to be paid somehow - and subscription fees seem as good way as any to do that.

Which brings an interesting questions - how come reviewers don't get paid? Even some nominal amount may be sufficient. Otherwise - and I am not quite sure about how the financial side of this balances out - but it's hard for me to imagine that companies like Elsevier are struggling to break even. Just like with record companies, subscription fees and color print charges (CD sales) don't go back to support hard-working referees and editors (musicians), instead making record executives, err... I mean scientific magazine publishers rich.

Arxiv is a little like napster - a nice concept in theory, but if music (scientific papers) are free, how do we expect musicians (editors/referres) to make an honest living doing their job?

This post was brought in by recent washington post article that argues that all/most papers should be free since taxpayers paid for research to begin with.

I don't have as much problems with this argument, but I do have a lot of problems with the proposed solution - requiring researchers who use taxpayers funds to publish only in open access (=unrefereed) publications means diluting good research with the bad.

A better solution would be to require for the grants to pay publication fees associated with the papers coming out of the research supported by the grant. There obviously have to be an honest cap on the paid amount per paper, otherwise the private journals can arbitrarily jack up the prices. For example, I would gladly pay for editorial (and maybe referee?) contribution, calculated by the amount of time they invested, plus some minimal publication-related charges.

Basically, the model I want is a free, non-for-profit, online journal sort of like elitist section of arxiv, which features a limited number of papers that are carefully selected by editorial staff, and peer-reviewed - perhaps accompanied by a short summary of what was accomplished and why it's an important paper, in broader picture. Because the whole journal is online-only, publication costs are minimal. Costs of maintaining minimal editorial staff that selects the papers and coordinates review process, plus costs of refereeing should be ideally picked up by some government agency. Even though it's not a big deal to ask authors to pay for their papers, I always felt it's backwards - you don't ask for writers to pay additional fees to publish their work, or musicians to pay so that they can perform to a sold-out audience, or professors to pay for a privelege to teach students. So why should scientists pay for having their work known to the world? It's bizarre if you think about it, even though we are all used to it by now.

8 comments:

Anonymous said...

My former adviser is now an editor of a pretty prominent materials science journal from Elsevier. A few things I learned from this:

1. He doesn't get paid *at all*. Elsevier gives the university ~$10k to pay for a half-time editorial assistant.

2. Springer hands out "book points" to reviewers per review. Quite a few people I know have bought a book a year with these points (~$200).

3. Costs of a purely online journal are usually underestimated. Typesetting and running server farms costs $$.

Schlupp said...

"Open access" is not the same us unrefereed! New Journal of Physics is refereed (I think you mentioned being a referee yourself), but open access: Authors pay publication charges, but everyone everywhere can read the papers. At first, I was a bit sceptical, because I was afraid authors might 'buy' publications. But with an impact factor of ~4, it appears to have worked out fine.

Granting agencies in my country prefer open access and pay reasonable publication charges. They permit publication in non-open-acces journals, but want you to make the paper available on preprint servers in addition. Some journals do not allow this, but if, say, all EU and US granting agencies made it mandatory at a similar time, the journals' objections would vanish, I suppose.

How to keep publication charges reasonable is pretty much a similar problem as keeping library subscriptions at a reasonable price. It's true that it seems bizare to have to pay for publication, though ....

sylow said...

The core problem here is that no nonscientist reads scientific articles therefore you are constrained to the academic circles. Even the most popular scientific journals science and nature are not sold in any newsstand. The obvious consequence is that somebody from inside the academic system needs to pay for these costs. This means either scientists will pay to publish in open access refereed journals or the libraries will pay for traditional ones otherwise scientific system will collapse since the profit margin is zero.

The issue that needs to be addressed here is why nobody from outside academia reads scientific articles? Even a better one: How many physicists read articles published in new england journal of medicine which has an impact factor of 55?

BTW, IP, can you explain why it doesnt mean anything to post an article to arxiv? In string theory, that is all they do these days.

When you read a given article you get the message anyway, right? Why do you care where it gets published eventually? If you didnt understand the arxiv version, you are not in that field anyway.

Schlupp said...

sylow, just my 2c about why 'archive only' might mean less: I'm a theorist and it's really hard for me to judge the validity of experimental papers. If I know that referees had at least a qick look at it, it does help me.

You are dead right about the money having to come from SOMEWHERE, and since most of us want to be read at least as much as we want to read, publication charges do perhaps make sense.

sylow said...

Schlupp, btw, thanks for your insight about junior professor issue in the previous post. I was not aware that it remains an exotic thing. I was told that the habilitation was abolished and you can start as a junior prof. instead. I did not realize it was still a rare practice.

Incoherent Ponderer said...

Yes, open access does not mean "no peer review". I would like to see more free, open access online-only journals with peer review.

At the same time requiring that we all publish only in open access (NJP and arxiv - are there any others relevant for physics?) will severely limit choices.

I am not sure what are the costs of running server farm, but who pays for arxiv servers (and mirros) and the time someone must put into it? I just got a bill from PRB for $3+K for color figure charges. I am sure open access online-only journal costs would be at least an order of magnitude less per paper, and even if you had to pay editorial staff and referees, it would still be less than that. Who reads paper edition of PRB anyways?

As to arxiv - I wouldn't say it's completely worthless, it's just that signal to noise there is quite high, as compared to PRL, for example.

I can calibrate arxiv papers from known groups and authors, but when the group is little-known, it is difficult to judge the quality of research, without doing the job of peer-reviewer yourself (which is difficult if I am not a super-technical specialist in a narrow field in which research is done, for example).

Anonymous said...

I noticed this journal from BioMed Central's sister site PhysMath Central is looking for papers for its new open access journal covering cmp & amo - and there isn't even an article charge if it gets submitted this month:
http://www.physmathcentral.com/pmcphysb

Schlupp said...

IP, about your question where the money paid to Elsevier goes: To the share holders of Elsevier, who reap in record profits compared to other media and publishing enterprises. The German version of Wikipedia has a rather detailed article with sources:
http://de.wikipedia.org/wiki/Zeitschriftenkrise
(Unfortunately, the English version is not only shorter, but also lacks citations.) They partly attribute the problem of rising prices for library subscriptions to the fact that many university libraries have to deal with very few publishing houses, giving more negotiating power to the publishers.

Sylow, if your interest in the German system is strong enough, I'd like to invite you over to my place, where I wrote a post about it:
http://unglaschluppe.blogspot.com/2007/11/bit-cynical.html