Give Young Scientists a Break

I don’t know if I could have even started my career in today’s funding environment.

There is only a rough correlation between the quality of the science in an application and the priority score.

There has been much concern about the impact of tight funding on the careers of young scientists. When only a small percentage of grants are approved, even the smallest problem or error with an application can push it out of the funding range. Unfortunately, the relative lack of grant-writing skills by new investigators often has this effect. To avoid a situation where only experienced investigators with polished writing skills are funded, the National Institutes of Health has instituted a more generous ranking scale for new investigators. Not surprisingly, some senior investigators have protested, calling it reverse discrimination. I say that their anger is misplaced. New investigators do deserve a break.

The argument that grants should be funded only on the basis of priority scores is fallacious. There is only a rough correlation between the quality of the science in an application and the priority score. As anyone who has ever served on a study section will attest, a host of different—and sometimes scientifically irrelevant—criteria can creep into play when arriving at a priority score, such as whether there are lots of typos in a grant (even the most accomplished scientists are not always great spellers). This is not because reviewers are vindictive or evil. Just that they are emotional and human. Until human judgment is perfected, granting agencies will always need to consider more than the priority score in making funding decisions.

I remember the first grant I wrote as a young assistant professor more than 25 years ago. It was an incredibly dense, 45-page tome. This was before NIH had page limits for grants, which were probably instituted after program officers saw my application. I had no real idea how to write a good application and just included all of my best ideas with lots of details so that the reviewers would know how smart I was. Only later, when I started reviewing applications myself and had to wade through a couple of dense, technical proposals, did I realize the pain that I had inflicted. I found myself far more impressed by scientists who could convey a complex idea in a few words than those who tried to overwhelm me with detail. Lesson one in grantsmanship.

Download Flash player to listen to this audio clip.

Deputy Editor Alison McCook moderates a debate about policies at the National Institutes of Health designed to increase success rates on grant applications submitted by young investigators. Discussing the issue are columnist and NIH-funded biologist Steven Wiley and Richard Gallagher, editor of a recent opinion from Les Costello, who argued that current policies discriminate against senior scientists.

I had submitted my grant to three different agencies: the National Science Foundation, the NIH, and the American Cancer Society. When the reviews came back months later, I found that I had scored a #2 ranking from NSF, a 34% score with NIH, and an outright rejection from the ACS. So depending on the study section, my science was either outstanding, mediocre, or terrible. Believe it or not, the NIH actually funded the proposal even though it had a 34% priority score. I would argue that my grant still represented excellent science—I published a dozen papers in top journals from that small first grant.

I don’t know if I could have even started my career in today’s funding environment, and that gives me pause. Most of the scientists I know had similar difficulties with grant writing when they were young. In the past, this has caused reviewers to display a varying degree of favoritism towards grants from new investigators. The slight scoring advantage the NIH is providing to new investigators (see p.ᅠ25) is a way to make this consistent and fair, and to ensure that as experienced investigators retire, we have well-trained people to take their place.

Of course, senior-level investigators have their own set of advantages in the review process, including their track record and experienced grantsmanship. The investigators who are perhaps at the biggest disadvantage are mid-career scientists, who have neither a big reputation nor the forgiveness of youth to see them through.

Unfortunately, the reason why we argue so passionately over the relative merits and fairness of scoring systems is not because we are concerned about the absolutely best science being funded. It is because we worry about our jobs and careers. NIH has been forced to consider career issues in their funding decisions because many universities and research institutes have abandoned their responsibilities. Faulting NIH for trying to support careers and maintain scientific diversity seems misplaced to me. We should all be trying to work together to maintain the fragile research community, not just our own funding levels.

Steven Wiley is Lead Biologist for the Environmental Molecular Sciences Laboratory at Pacific Northwest National Laboratory.



Advertisement


 

Rate this article

Rating: 4.66/5 (62 votes )





Break? How about "Equitable Review"
by null null

[Comment posted 2009-11-17 12:34:38]
Thanks to the author for countering the dismal and generally unsubstantiated screeds that we've seen on this topic. Many forces on study section review, both unintentional and intentional, end up slanting the table unfairly against the truly excellent New Investigator proposals. The NIH payline strategy restores the balance. It does not unfairly benefit the as-yet-unfunded investigators. Experienced investigators would do well to examine the numbers from decades past when making their charges of "undeserving".
Mike Taffe



The Big Crunch - The End of Expansion in Science
by Michael Kolios

[Comment posted 2009-11-17 11:14:17]
The article ?Give Young Scientists a Break? highlights a problem for which I am afraid there is no solution. A good article, written over a decade ago, I think best describes the situation. It is entitled ?The Big Crunch - The End of Expansion in Science?. The most relevant section to this thread is ?Breakdown of institutions evolved for exponential growth?.

http://www.marshall.org/article.php?id=16

Proper mentorship is critical to the young scientist, but even then, this will not change the overall success rates. As Dr. Goodstein states, peer?review ?is a very poor way to adjudicate an intense competition for scarce resources, such as the funds of the government agencies or pages in prestigious journals?. There is no solution to this problem and unfortunately some steady state will be reached, but not by design.



Unconscious questions and decisive answers
by Rafaela Canete-Soler

[Comment posted 2009-11-13 06:10:45]

Hello Graham,

I almost always get confused when the issue at hand appears to be that of grantmanship. I once heard from a wonderful woman advisor: ? What are the 3 nodal issues in writing a research proposal:

1. What?s the question you want to address ?. Why is so important ?.
2. How are you going to tackle your question ?.
3. What if it does not work the way you?ve planned ?. What are your resorts and resources to redirect your efforts ? ?

Unless the applicant sends his application in Japanese, which is the language known by 0.01% of potential reviewers, I can?t see all this weight in constructing a grant application.

What if we (expert judges in a specific field) let our unconscious ask questions for ten minutes:

? Do I understand what s/he is asking ? Sort of? But, is this going ahead of my own questions ?.......Maybe s/he should tackle it with the methods and resources that I know of?S/he has not tried them yet ( no data, not enough publications)??. I?d like him to be in the right track?.MORE OF MY SAME SAME??so that I, I, I and my field colleagues are on top of the game.... This is a nice project written by an accomplished researcher........ Let?s have him back with a stronger proposal???.S/He will not get it anyway?..

This is the never ending story in the field of neurosciences, which is the one I know a little bit..


Thank you.



In an ideal world
by Graham Small

[Comment posted 2009-11-13 03:28:25]
In an ideal world, all grant applications would be assessed purely on scientific merit and the grant application review would be impartial and transparent. Sadly, in my experience, neither of these happens at present and, until they do, the debate will continue. I would also add that the mentoring of postdocs and junior staff by senior staff to raise the quality of their applications is an extremely important one. Their ideas for a study might have real scientific merit but without knowing how to properly construct a grant application, they will always struggle.



Beat
by lati latifah

[Comment posted 2009-11-12 14:50:57]
you seem to be giving real clues about it in this article.




Who carries more weight?
by anonymous poster

[Comment posted 2009-11-10 14:17:03]
In "Instead, Give Young Scientists a Legitimate Opportunity', Dr. Rafaela Canete-Soler made many good points. One more point that I'd like to point out is that senior faculty have the advantage over jr faculty in the review process. This gives them enormous 'hidden' power. Yes, NIH has a special payline for new investigators. But who said that the panel members could not be bias against proposals from these same new investigators? Ideally, the review process should be fair to all. If Dr. Canete-Soler's reaction to some of the well-funded proposals from select established PIs is correct, does it suggest that the established PIs carry more weight toward established PIs? I hope this is not the case.



Spot on!
by anonymous poster

[Comment posted 2009-11-09 20:20:46]
This article clearly articulated what we all know is true. One of the people who commented about the composition of the study section is also correct. I know first hand that less well established investigators that have been successful in obtaining NIH funding ( required for being on study section) have a more unbiased means of scoring and discussing the merit of an application. For example, every verbal review does not start with" I know this person and I can personally confirm their worth!"



I agree; young scientists do need help
by MORGAN GIDDINGS

[Comment posted 2009-11-09 16:04:33]
This article is spot on. Reflecting on my pre-tenure situation, I had no idea what I was doing, despite my pretty good track record at prior grant-getting as a graduate student and post doc. My first few grants as an assistant professor were rejections.

Then, due to a set of coincidences, I had a great mentor who came along at the right time and place to help me clean up my grants, and I've had a tremendous track record since then. If he hadn't come along, I probably wouldn't be tenured right now.

I've thought a lot about how to help other people avoid the mistakes that we all make in our early attempts at grant getting - particularly those who don't happen to have great mentors come along.

I decided to start a page primarily dedicated to helping young scientists figure out grant and paper writing:

http://morganonscience.com/

There are already a few posts there on the subject, and the list will be growing (I have lots of ideas, many of which are coming from a class on grant writing I'm helping with right now).

It still surprises me how little training most people get on these issues, when they are of number one importance for success in a scientific career. Hopefully my little efforts will help.




Let's not forget why the success rate is low
by Michael Holloway

[Comment posted 2009-11-09 12:45:35]
The reason that review is subjective and that the percent accepted is so depressingly low is because those same senior researchers complaining about not getting their R01s were successful in getting too much cheap graduate student and postdoc labor to their lab benches. There are now too many researchers chasing a largely unchanged amount of money. Reviewers can't possibly choose objectively based on the science. And yet, just two weeks ago I saw another crisis alert that we have too few graduate students for our country's security.

Over population denial. Dr. PI meet Dr. Malthus.



Great Editorial.
by anonymous poster

[Comment posted 2009-11-09 11:51:21]
Great insight and well written.



Post your comment where NIH can read it
by Rafaela Canete-Soler

[Comment posted 2009-11-04 11:07:55]


**I believe the current funding situation is extremely frustrating and is preventing young researchers from getting off of the ground and also is turning great scientists away from science.**


Hi anonymous,

I would recommend that you post your comment at http://writedit.wordpress.com/. There is a blog on ?OER strikes back?. NIH is asking for feedback and is very important that your experience is heard.

Rafaela



Agreed!
by anonymous poster

[Comment posted 2009-11-03 14:51:39]
I am a postdoctoral fellow trying to get funding to become an independent scientist and have encountered similar issues. In my case, it is the lack of my mentor's NIH funding that is preventing me from being funded, not my background or scientific ideas. I, too submitted to NIH and ACS. ACS gave me a great score, but then told me they had no money to fund my project, while my NIH score is borderline. Furthermore, as far as I am aware, none of the Recovery Act funds are going into training grants and fellowships. I believe the current funding situation is extremely frustrating and is preventing young researchers from getting off of the ground and also is turning great scientists away from science.



Instead, Give Young Scientists a Legitimate Opportunity
by Rafaela Canete-Soler

[Comment posted 2009-11-02 13:12:21]


Hello Dr Wiley,

I like this article better than other ones in the past months. However, there is still a concept which I perceive as ?factually erroneous?. And that is in the tittle of the article: give young scientists a break. Actually, I would have titled it: ?Give them a legitimate opportunity?.

Dr Wiley, you seem to be giving real clues about it

** Unfortunately, the reason why we argue so passionately over the relative merits and fairness of scoring systems is not because we are concerned about the absolutely best science being funded. It is because we worry about our jobs and careers**.

Well, looking at the composition of Study Sections prior to 2006, the high majority of members (at least in my field) were from high ranking universities. I would dare to correct your statement and say: ?it is because we worry about OUR LEVELS OF FUNDING AND LEVELS OF SALARY ?.

I hope that, having expanded the pool of reviewers with greater diversity in geographical areas, types of institution and so on, ?young? and ?new? scientists are given deserved opportunities. It is not a matter of ?giving a break?. Rather a problem of giving them a Legitimate Opportunity.

In 2007, using the FOIA mechanism, I requested a copy of grants awarded to a number of established investigators, known to be very successful in writing and getting grants. I studied them trying to be as unbiased as possible. Of course, I recognize that eliminating all biases is impossible. Accepting that limitation, I can assure you that, if I had to score those proposals using the NIH criteria: significance, innovation, potential for advancing the field, I would have triaged 98% of them.