home

Case Study: Should you listen to a peer reviewer?

ORI will soon release a series of RCR case studies edited by Dr. James Dubois of St. Louis Univerity.  The creation of the case studies was funded through ORI's RCR Resource Development program and involved a team of nearly 20 writers, contributors, and reviewers.  These well-crafted case studies, along with role playing scenarios, will be available for instructors to incorporate into their institutions' RCR training programs. Below is one of many case studies that will be available.
Getting a Fair Shake?
 
Gail is an Associate Professor who has published extensively and rightly considers herself one of the leading experts in her field. She knows the drill for developing and submitting a proposal for funding. Her most recent proposal is based on considerable prior research that she and colleagues have conducted, and it employs methodology that she knows will produce valid findings.
 
Gail is anxious about her proposal being reviewed and funded. Prior to submitting, she ran it by a network of capable colleagues with whom she works collaboratively to develop and critique ideas. They all share the same dedication to medical research with important long-term implications for public health, as well as short-term implications for federal policies and funding.
 
When Gail finally receives the funder’s evaluation, she is happy to see that she received a high score on her proposal. However, the score is below the cut-off point at which it can be funded. Gail turns to see what objections and concerns the reviewers had with her proposal. She plans to revise and resubmit for the next funding cycle.
 
Gail is flabbergasted to read what the reviewers said. In their feedback, they find that her methods are “flawed”. And they suggest changes to the study design that Gail is certain would significantly compromise the quality of the science as well as its impact on the development of her field. They clearly did not understand her approach, which is highly novel.
 
Gail is considering re-submitting the proposal employing the reviewers’ suggested methodology, then actually doing the study as she proposed it in the first place, explaining that “pilot testing” indicated that her methodology would work best.
 
However, Gail worries that this is deceptive. And who knows if the same reviewers would be evaluating her resubmission? Perhaps she is better off proposing her original “flawed” methodology—with a direct response to reviewers—in hopes that she will receive new reviewers or that her reviewers will be unusually open minded. Gail has two months before the revised proposal is due. She feels caught between a rock and a hard place.
 
What should Gail do?
 

Source URL: https://ori.hhs.gov/blog/case-study-should-you-listen-peer-reviewer