I review a lot of manuscripts. I think it's an important service to the scientific community, and I feel that I don't have the right to expect prompt and thoughtful reviews unless I am willing to provide them myself.
When I am the author, I spend a lot of time thinking about the responses received and do my best to address each comment and incorporate appropriate changes in the manuscript as much as possible. Very rarely, a comment is truly baseless or the referee is in error, but I still make sure I address said comment politely. Overwhelmingly, referee reports are useful and interesting, and result in a better manuscript, one which will be better appreciated by the scientific community.
In my experience as a referee, I find that most authors seem to be like me: they carefully address each item raised by the referee, if they disagree they do so very politely, and generally try really hard to incorporate changes and appreciate constructive feedback.
But...
There are always jerk authors who think their work and presentation are beyond reproach, who act dismissively towards a thoughtful and well-meaning referee report, or even insult the referee. I have an "Author Hall of Shame" with the names of authors who have been exceptionally
a$$holish when responding to one of my referee reports. No, actually I don't, I am too lazy to do that, but I would lie if I said I did not remember the names of some of the worst offenders, in order to ensure that I never ever review anything of theirs again.
The unchallenged champion
a$$hole authors were those on a paper I reviewed a few years back. It was a technically solid, very long manuscript submitted to a society journal. I said that I liked the technical part and that the results were interesting, but that the presentation needed work. My comments were to shorten and tighten up the abstract, to distill some of the key points of the paper (it was all over the place, and it was really not clear what the novelty was until you really carefully went through the very long paper), and I requested that a broader introduction be made, emphasizing that this work may connect to such and such areas (stupid me, actually wanting to help them make the paper accessible to a broader audience).
The response I received was this flaming 6-page diatribe in which they argued how it was trivially obvious that points 1-5 were the novel aspects of the work (none of what they claimed to be novel was obvious, only 2 or 3 out of 5 became obvious to me after a careful reading of the initial manuscript, and they didn't rewrite the paper to make anything clearer or more obvious), that one of the papers I suggested for them to cite had a huge abstract so there was no need for them to shorten theirs (again, idiot me for trying to suggest an improvement in information retrieval and readability), and overall the authors spent a tremendous amount of time basically trying to argue that I was full of $hit, that the paper was absolutely perfect, and that none of the comments had any merit.
I wrote back that I had never in my life received such a disrespectful response and that the authors should have spent the immense amount of time invested in the response letter on improving their manuscript instead. I was pissed for a week after that.
The paper then went back to another referee, who basically reviewed the correspondence and told the authors that they had gone too far with their response letter to me, and that none of what the authors insist on being novel was obvious at all from in the abstract, introduction, conclusion, and to anyone who did not read the paper in detail. After this arbitrator's response, the authors made the requested changes and the paper was published. (I saw all the correspondence after the paper had been accepted and I felt vindicated after the other referee had basically seconded my concerns.)
Fun fact: This paper was, coincidentally, authored by two women. I can only imagine what the editor thought ("Catfight!" "PMS!") reading the correspondence between two female authors and a female referee. I don't know if the corresponding author got the memo that us lady scientists are supposed to be even better behaved than male scientists, because we always run the risk of being labeled emotional/hormonal/crazy...
Today I received another a$$holish response to one of my reports (not sure still if it's "Author Hall of Shame" material), so I am fuming on the intertubes instead of working on a manuscript of my own. I basically recommended publication after minor revisions, but noticed that the authors cited themselves disproportionately much and it skewed the view of the field. I asked that they add more references (did not ask for any specific ones) that put their work in the broader context of the field and connect their work to some of other closely related fields that are very active.
I get a response that they are puzzled by my assertion that there are too many of their own references, and that the connections to the other areas are interesting but that the subject is too broad to reference (so presumably they didn't want to bother looking any up). Yes, referencing a double-digit number of your own papers (although technically clustered under a few references, each reference containing multiple papers) is totally not too many among a total of twenty-ish references (the other ones being mostly single-paper references, and largely written by people you list in the acknowledgments). Yeah. A youngster picking up your paper will totally get a balanced view of the field.
When a nice referee asks that you add some references to more broadly represent the state of the art in the introduction, just fuckin' do it! I did not make anyone perform new and expensive experiments, or even run new simulations, just spend an afternoon on the Web of Science. DO IT! It's for your own paper's good. More often than not, that way you will discover some interesting papers you probably should have discovered previously anyway. Knowing the literature and where the state-of-the-art is in your subfield and closely related ones are important. Ignore them at your own peril.
I have to say one thing: among the authors who are jerks when resubmitting, Europeans make an overwhelming majority (I go by who the corresponding author is, or who signed the response letter, if applicable). In particular, there is a specific country in Europe that seems to breed surprisingly bellicose corresponding authors. Not sure why that is.
WTF people. I invest my time and energy to review manuscripts, and do it for free. If you are dismissive or disrespectful, next time I will simply not review your paper. And if our paths cross at a conference, I will go out of my way to not talk to you because I have it black-on-white that you are an ass.
I welcome you to share your own stories from the reviewer trenches.
10 comments:
I have definitely become a much nicer reviewer over time. I have also a lower tolerance for nasty reviews of my own work, and call it out when I can. I had a recent example where the authors were very rude in their response to my (anonymous review). Definitely gets my goat.
In my other role as editor, I'm learning how to not tolerate this type of behavior from reviewers.
I've been lucky to not have many asshole authors. They haven't always taken my suggestions, but when they don't they usually offer some reasonable justification, and they often find some other way to improve the paper. Even when the authors are delusional and press ahead with a revision to an unfixable paper after I recommend rejection, they are polite in their delusional behavior.
My favorite response to a paper was one that another reviewer made that I saw in the decision letter summary- he/she just said that they'd already reviewed and rejected this paper once, the author had failed to make any changes at all in response to any of the original reviews, and that the reviewer found it rude and offensive that the author had wasted everyone's time like that. Then they cut and pasted their old review at the bottom. I can only imagine it was very satisfying...
I love post like this. I just wish you were more specific about things, such as countries. Was it France? Maybe an eastern European country close to Russia? I also have a theory that the English are not used to being challenged on their beliefs.
My group was talking, amongst ourselves, recently about trying to start a a collaboration with Japanese researchers and my supervisor (who is not originally from N.A.) mentioned that it won't be as easy as in North America, where we have a more openness.
@Yellowfish: that sounds exactly like my supervisor's story when he was a reviewer on a paper.
Yellowfish beat me to the punch - we see this kind of behavior all the time in my sub-field. My PI is a reviewer for two closely-related specialty journals - on multiple occasions, he has reviewed and rejected a paper for the journal with the higher impact-factor, only to be asked by the journal with the lower IF to read the same paper, in which the authors failed to address any reviewers' comments. There is one lab in particular that seems to make a habit of this, and my PI has stopped reviewing their papers on principle.
Haven't reviewed enough to encounter that type of response. (Thank goodness.) However, I'm glad the obnoxious self-referencing thing bothers someone else aside from me. I thought the smart way to do things was to reference other people so that they will see your work and, if relevant, start citing you as well. I keep being told that self-citation is only of limited efficacy in upping one's h-index. Anyway, I had to call someone on it when they had 30 citations and 26 were to their own papers.
I reviewed a paper once for a low end journal because the topic was interesting and the group was one that I (at that time) thought I might collaborate with. The methods had two major flaws (not insurmountable, but enough to render that version useless), and I also tend to spend a fair bit of time suggesting other stuff that I think will be helpful. Anyway, response comes back, several pages long telling me I am stupid because is above reproach etc. etc. The only change made in the entire ms was a single line in the acknowledgments to 'anonymous reviewers'. I still find this hilarious when I think about it. The irony was that it was an invited paper, so even though I told the editor that the paper was unacceptable, it was accepted.
Decided that group wasn't worth collaborating with, and now I never review nor edit any ms coming from them because it left such a bad taste.
GMP your post was a timely one for me because I got a rejection and was very careful how I proceeded. Things worked out well for me. Thanks.
Oh to have gotten that one, the pleasure of replying to the authors, telling them that citation databases all have filters for self-citation that everyone uses when evaluating researchers:) You know, just a friendly warning that they might need to be aware of.
Ooooh. I have done that a couple of times. It's so much fun. Except when the paper then gets published without much revision.
Post a Comment