A horror story involving the correction of a published scientific article

Lee Sigelman points to this article by physicist Rick Trebino describing his struggles to publish a correction in a peer-reviewed journal. It’s pretty frustrating, and by the end of it–hell, by the first third of it–I share Trebino’s frustration. It would be better, though, if he’d link to his comment and the original article that inspired it. Otherwise, how can we judge his story? Somehow, by the way that it’s written, I’m inclined to side with Trebino, but maybe that’s not fair–after all, I’m only hearing half of the story.

Anyway, reading Trebino’s entertaining rant (and I mean “rant” in a good way, of course) reminded me of my own three stories on this topic. Rest assured, none of them are as horrible as Trebino’s.

1. I did some research with Terry Speed, we published an article in a top journal, the article was cited a bunch of times, and a few years later I got a letter (yes, this was in the days of letters) by a researcher pointing out a counterexample to our theorem. I looked at the example carefully. The theorem was false and there was no way around it, no simple condition to add to make the theorem true, no way out. So I wrote a brief correction. In its entirety:

With regard to the theorem in the paper, the second part is, in general, false, and the proof, given in Section 4.2, is in error. Dr K. W. Ng and Professor A. P. Dawid have pointed out the following simple counter-example for two binary random variables x1, x2: P…(0,0)=0:3, P…(0,1)=0:2, P…(1,0)=0:2 and P…(1,1)=0:3. This joint density is uniquely specified by P(…x1jx2) and P…(x1), in contradiction to the second part of the stated theorem.

2. I read an article in The American Statistician many years ago. I can’t remember who wrote the article or what year it was, but it was something demonstrating Bayesian computation, but using a really ugly and complicated method. I feared that an article like this would just turn readers off from Bayes, so I wrote a letter detailing the mistakes and showing the problem could be solved much more simply. I received a letter from the editor thanking me for my submission and that it would be sent out for review. This was already a surprise to me–I had no idea that letters to the editor were peer-reviewed. I always had assumed they’d just be sent to the associate editor who handled the original paper. Anyway, in due course I received a letter from the editor, I think saying that the author of the original paper didn’t think my letter was worth responding to, so my letter didn’t appear. No big deal, but I thought I was doing a service in writing a letter–I certainly wasn’t going to get fame, fortune, or tenure for letters to the editor of The American Statistician–so it was a little annoying to feel like my time was wasted.

3. A few yeas ago I somehow heard about some articles by some sociologist in London–I think it was actually a reporter who called or emailed me asking for comments–and, well, you know the rest of that story. . . . I did actually have to revise my letter-to-the-editor in response to reviewers’ suggestions, but these comments were fair enough, and they allowed me to make the letter stronger.

4. Once I refereed an article and really hated it. The associate editor still wanted to run the article, but the editor of the journal agreed with me so he allowed me to run a brief comment along with the published article in the journal. Other times I’ve reviewed an article that I’ve liked so much that I’ve suggested it be run as a discussion article, and then I ended up writing one of the discussions.

7 thoughts on “A horror story involving the correction of a published scientific article

  1. I've had only experience like this (not so protracted, but quite unsuccessful), versus three in which the authors of the original papers were cooperative, or at least not obstructive.

    That doesn't mean everything goes well, though! It can still take an inordinate amount of time. And in one case, the authors of the original paper were so appreciative after I told them of an error that they insisted that I ought to be an author of the Corrigendum that they were submitting, so I'd get some credit. Unfortunately, the journal's format for a Corrigendum included only the title, volume, and page references for the original article. So including my name on the Corrigendum made it appear that I was one of the authors of the paper with the error…

  2. Trebino sounds like a kook to me. He complains about the journal not publishing his 3-page comment, but he appears to be not even willing to post it himself on his web page. His rant would be more credible if he named names and linked to sources.

  3. Well, he does have the reply in his webpages, but in his project webpage ("FROG") (it's a 6-page comment, with citations for the journal, the paper in question and its erratum.)

  4. Had a similar but not so extreme experience.

    Submitted a letter to the editor emailing a copy to the authors the day before.

    Editor said it was too long and needed to be dratically shortened.

    In the process of redrafting a much shorter version I discovered a new methodological publication which raised further concerns about the paper and the author's other work.

    Emailed this new issue to the authors to give them a heads up.

    Very soon afterwards the editor contacted me directly declaring the original submission would be printed as is – with no possibilities for modification.

    But the best advice I got regarding this was don't publish a letter to the editor but rather publish a new paper, perhaps in a different journal, using the flawed paper just as a lead in.

    Keith

  5. One of the biggest opportunities for improvements in journal publishing is to move away from the static nature of published documents. In addition to the examples above, one time I published a paper that had formulas that were messed up. (I had about 2 days to review the proofs and I'm not sure the corrections made it to the editor.) Why can't I submit a correction that appears alongside the original article?

    Going forward, I plan to only publish in journals that are set up for comments.

  6. Kevin;
    Your final sentence twanged one of my pet peeves.

    I hereby issue a challenge to anyone to write a sentence in which the phrase "going forward" adds any meaning or information not contained in the sentence with the words omitted.

Comments are closed.