Abstract
The article considers how the past and present tendency to focus on selecting the best projects based on the sole criterion of meritorious science may result in a sub-optimal portfolio. The authors argue that scientists need to proactively engage in the discussion over the need to improve the efficiency and effectiveness of societal investments to ensure that the next generation of the management and decision-making process for our science, technology and innovation system is rooted in sound principles.The classic peer review process tends to provide unintended overlap and allows for an ill fit between some of the pieces and unwanted gaps to occur. Areas of high risk and high return can be missed due to their controversial nature and split decisions typically resulting in negative funding decisions. In general, high risk and a high frequency of split decisions tend to be replaced with lower risk initiatives. The authors propose herein supplementing peer review with research portfolio evaluation approaches and decision-making tools that can better assess research uncertainties and other special features of the transformation of the resulting knowledge into improved social well-being. A coupling of research quality review by peers with more systematic portfolio meta-analysis of recommended projects is both possible and essential.
References
Bhattacharyya P.K. (2011) Fuzzy R&D project selection of interdependent projects // Computers & Mathematics with Applications. № 62. Р. 3857-3870.
Brosch R. (2008) Portfolios of Real Options. Berlin: Springer.
Casault S., Groen A. (2012) Examination of the behavior of R&D returns using a power law // Science and Public Policy. Vol. 40. P. 219-228.
Feller E. (2013) Peer review and expert panels as techniques for evaluating the quality of academic research // Handbook on the Theory and Practice of Program Evaluation / Eds. N. Link, N.S. Vonortas. Cheltenham: Edward Elgar.
Kintisch E. (2006) Ray Orbach asks science to serve society // Science. № 313. Р. 1874.
Lane J. (2009) Assessing the impact of science funding // Science. № 324. P. 1273-1275.
Linquiti P. (2012) Application of Finance Theory and Real Option Techniques to Public Sector Investments Made Under Uncertainty (PhD Thesis). Washington, D.C.: The George Washington University.
Mervis J. (2013) Proposed Change in Awarding Grants at NSF Spurs Partisan Sniping // Science. № 340. P. 670.
Nelson R.R. (1990) Capitalism as an engine of progress // Research Policy. Vol. 19. P. 193-214.
OSTP (1998) The Science of Science Policy: A Federal Research Roadmap. Washington, D.C.: Office of Science and Technology Policy.
Triantis A. (2003) Real Options. Handbook of Modern Finance / Eds. D. Logue, J. Seward. New York: Research Institute of America. P. D1-D32.
Vonortas N.S. (2008) Real Options for Research Investment Portfolio Analysis at the U.S. Department of Energy. Washington, D.C.: Office of Science, US DoE.
Vonortas N.S., Desai C.A. (2007) ‘Real options' framework to assess public research investments // Science and Public Policy. Vol. 34. P. 699-708.
Zapata J.E., Reklaitis G.V. (2010) Valuation of project portfolios: An endogenously discounted method // European Journal of Operational Research. № 206. Р. 653-666.
van Bekkum S., Pennings E. (2009) A real options perspective on R&D portfolio diversification // Research Policy. Vol. 38. P. 1150-1158.

This work is licensed under a Creative Commons Attribution 4.0 International License.