US to measure research impact
04 June 2010
A new federal project promises to monitor the impact of the $8.9 billion (£6.1 billion) contribution to US scientific research included in the American Recovery and Reinvestment Act of 2009 stimulus package.
The initiative aims to provide solid evidence on the returns to the US from its recent investment in science research, enabling the federal government to monitor the investment's impact on employment, knowledge generation and health. Following a successful pilot involving seven institutions, the voluntary programme is being rolled out across the US and 60 universities have already expressed interest in taking part.
The venture - Science and technology for America's reinvestment: Measuring the effect of research on innovation, competitiveness and science (Star Metrics) - is a multi-agency venture led by the National Science Foundation (NSF), the National Institutes of Health and the White House Office of Science and Technology Policy.
A multi-agency initiative will monitor the impact of federal science investments
Julia Lane, director of the Science of Science and Innovation Policy programme at the NSF, led the project and believes the key to successful reporting in science is automation. 'Manual reporting is inefficient, produces bad quality data, and puts a high level of burden on academics. We have automated reporting by linking existing databases on publications, citations and patents.'
The Star system takes a similar approach to impact appraisal to the original Research Excellence Framework (REF) proposal in the UK which was driven by bibliometrics but later rejected in favour of a peer review approach. Unlike the REF the US initiative is voluntary, and will focus on both economic and social impacts. The results of Star assessment will not be used to measure the quality of research or drive funding for individual institutions.
It is clear to Clare Grey, a chemist at the University of Cambridge, UK, who worked in the US for many years, that researchers have a responsibility to explain to the public the benefits to the economy and society of the research they perform. 'However, measuring research impact is difficult to do in many cases without metrics. We need to justify the continued funding of research and cast it in the language used by decision makers on Capitol Hill (US) or Whitehall (UK).'
However, the question of how to measure social impact remains unresolved by Star Metrics in the US and the REF in the UK. 'We cannot fully describe impact yet but the measures we are developing are in collaboration with the academic community,' says Lane.
Together, NSF and NIH have committed $1 million to carry out and develop the Star Metrics initiative in the first year.
Interesting? Spread the word using the 'tools' menu on the left.
Also of interest
02 June 2010
US bill that boosts science funding passes on third attempt after Democrats employ unusual procedural tactic
08 January 2010
Independent report calls for flexibility in new research impact assessment as academics threaten to leave the UK if the measures are introduced
29 March 2010
Extensive consultation leads to changes to the proposed Research Excellence Framework, but questions over impact assessment remain
02 February 2010
Despite President Obama's plan to freeze domestic spending, science agencies would get a boost under new budget proposals
Information on the Star Metrics scheme
Comment on this story at the Chemistry World blog
Read other posts and join in the discussion
External links will open in a new browser window