« Validation of posterior probabilities | Main | Pre-election polls and votes for congress »

October 25, 2006

Advice for referees

Tyler Cowen has some tips here. I disagree with his point 2. I try to do all referee reports within 15 minutes of receiving them. On the other hand, it would probably be a disaster if all referees followed my approach. A diversity of individual strategies probably results in the best collective outcome. I'm often impressed by the elaborate referee reports given for my own articles. On the other hand, my reports are always on time, and my judgments are trustworthy (I think).

Also, my impression is that the referee process is more serious in economics than in other fields, so that might explain some of our differences in approach.

Posted by Andrew at October 25, 2006 1:19 AM

RSS feed for this entry.

Trackback Pings

TrackBack URL for this entry:
http://www.stat.columbia.edu/~cook/movabletype/mt-tb.cgi/663

Comments

Economics has more potential for being politicized, I think. A vast majority of people can't get their heads around what you do so it's safe from blatant partisanship.

Posted by: Gabriel M. at October 24, 2006 6:42 PM.

I reckon I could referee an article in 15 minutes - but only if it is obvious rubbish. The great bulk of papers deserve and require far more attention than this.

Posted by: derrida derider at October 25, 2006 12:18 AM.

Derrida,

I see your point--that's why I said that it would probably be a disaster if all referees followed my approach. But I think it's the best way for me to make a useful contribution to the process. Other people might be better off reviewing fewer papers and taking longer per paper.

Posted by: Andrew [TypeKey Profile Page] at October 25, 2006 7:51 AM.

Interesting! Personally, I adopt the strategy in the second point. I find that a week of letting the paper's ideas rumble around in the background makes it much easier to identify what I do and do not like. Perhaps the papers are more clearly written in your field.

Posted by: Andrew Robinson at October 25, 2006 5:21 PM.

I'm a junior academic who has refereed a fair number of papers. I find myself being very critical of most of what comes across my desk and wonder if there is a life-cycle effect going on here. I've heard several respected "elder statesmen" in my field remark that people starting out always seem more critical than their more experienced colleagues. Those of you who have been doing this for many years, do you find yourselves mellowing as time goes by!? I suppose this goes for marking as well.

Posted by: Daniel at October 26, 2006 8:09 AM.

Daniel,

I think you start to realize how hard it is for journals to find good submissions. Even top journals struggle with this. If you compare a submission with your own favorite work, you'll be inclined to reject, but if you compare with the other stuff being submitted, you'll be more mellow. If all the crappy submissions and all the mediocre submissions got rejected, the journals would be nearly empty.

Posted by: Andrew [TypeKey Profile Page] at October 26, 2006 5:36 PM.

Post a comment




Remember Me?

(you may use HTML tags for style)