A LITERATURE REVIEW ON IMPACT EVALUATION OF R&D AND INNOVATION SUBSIDIES

Year 2019, Issue: 4, 233 - 258, 01.10.2019

Önder Belgin , Dursun Balkan

Abstract

In
this study, the literature on impact evaluation studies for R&D and
innovation subsidies are reviewed. For this purpose, studies in 2000-2018
period and indexed in Web of Science database are considered. While searching
the paper “R&D”, “Innovation”, “Subsidy” and “Evaluation” keywords are
used. The country of the evaluated program, methods and outcome variables in
the analysis, data gathering types and type of impact are reported in detail.
In the studies ex-post quasi-experimental methods are used and impact on input additionality
is analyzed widely. Since impact evaluation studies spread in Turkey, we think
that our study will be useful for the researchers studying on impact
evaluation. 

Keywords

R&D, Innovation, Subsidy, Impact Evaluation.

AR-GE VE YENİLİK DESTEKLERİNE İLİŞKİN ETKİ DEĞERLENDİRME ÇALIŞMALARI ÜZERİNE BİR LİTERATÜR TARAMASI

Abstract

Bu çalışmada, Ar-Ge ve
yenilik destekleri üzerine yapılan etki değerlendirme çalışmalarına ilişkin bir
literatür taraması gerçekleştirilmiştir. Bu amaçla bu konuda 2000-2018 yılları
arasında yapılmış ve Web of Science Veri Tabanında taranan çalışmalar dikkate
alınmıştır. Yayınlar aranırken “R&D”, “Innovation”, “Subsidy” ve
“Evaluation” anahtar kelimeleri kullanılmıştır. Söz konusu çalışmaların hangi
ülkelerin programlarının değerlendirildiği, analizlerde kullanılan yöntemler ve
değişkenler, veri elde etme yöntemleri ile hangi tür etkilerin dikkate alındığı
detaylı olarak raporlanmıştır. İncelenen çalışmalarda yaygın olarak destek
sonrası yarı-deneysel metotların kullanıldığı ve çalışmaların büyük kısmında
destek programlarının girdi artımsallığı üzerindeki etkilerinin incelendiği
görülmüştür. Türkiye’de etki değerlendirme çalışmalarının yaygınlaşmaya
başlamasıyla birlikte, yapılan derlemenin bu alanda çalışma yapan
araştırmacılara yararlı olacağı düşünülmektedir.

Keywords

Ar-Ge, Yenilik, Destek, Etki Değerlendirme

References

• • AERTS, K. VE SCHMIDT, T., (2008), Two for the Price of one? Additionality Effects of R&D Subsidies: A Comparison Between Flanders and Germany, Research Policy, 37, 806–822.
• • AFCHA, S. VE LÓPEZ, G. L., (2014), Public Funding of R&D and Its Effect on the Composition of Business R&D Expenditure, BRQ Business Research Quarterly, 17, 22-30.
• • AGUIAR, L. VE GAGNEPAIN, P., (2017), European Cooperative R&D and Firm Performance: Evidence Based on Funding Differences in Key Actions, International Journal of Industrial Organization, 53, 1–31.
• • ARALICA, Z. VE BOTRIĆ, V., (2013), Evaluation of Research and Development Tax Incentives Scheme in Croatia, Economic Research-Ekonomska Istraživanja, 26 (3), 63-80.
• • ARISTEI, D., STERLACCHINI, A. VE VENTURINI, F., (2017), Effectiveness of R&D Subsidies During the Crisis: Firm-Level Evidence Across EU Countries, Economics of Innovation and New Technology, 26 (6), 554-573.
• • ARQUÉ-CASTELLS, P. VE MOHNEN, P., (2015), Sunk Costs, Extensive R&D subsidies and Permanent Inducement Effects, The Journal of Industrial Economics, LXIII:3, 458-494.
• • BAKER, J. L., (2000), Evaluating the Impact of Development Projects on Poverty: A Handbook for Practitioners, The World Bank, Washington D. C., ABD.
• • BASIT, S.A. VE KUHN, T., (2018), The Effect of Government Subsidy on Non-Technological Innovation and Firm Performance in the Service Sector: Evidence from Germany, Business Systems Research, 9 (1), 118-137.
• • BECK, M., LOPES-BENTO, C., VE SCHENKER-WICKI, A., (2016), Radical or Incremental: Where Does R&D Policy Hit?, Research Policy, 45, 869–883.
• • BÈRUBÈ, C. VE MOHNEN, P., (2009), Are Firms that Receive R&D Subsidies More Innovative?, Canadian Journal of Economics, 42 (1), 206-225.
• • BLASIO, G., FANTINO, D. VE PELLEGRINI, G., (2014), Evaluating the Impact of Innovation Incentives: Evidence from an Unexpected Shortage of Funds, Industrial and Corporate Change, 24 (6), 1285–1314.
• • BOEING, P., (2016), The Allocation and Effectiveness of China’s R&D Subsidies – Evidence from Listed Firms, Research Policy, 45, 1774–1789.
• • BROEKEL, T., BRACHERT, M., DUSCHL, M. VE BRENNER, T., (2017), Joint R&D Subsidies, Related Variety, and Regional Innovation, International Regional Science Review, 40 (3), 297-326.
• • BROEKEL, T., FORNAHL, D. VE MORRISON, A., (2015), Another Cluster Premium: Innovation Subsidies and R&D Collaboration Networks, Research Policy, 44, 1431–1444.
• • BRONZINI, R. VE LACHINI, E., (2014), Are Incentives for R&D Effective? Evidence from a Regression Discontinuity Approach, American Economic Journal: Economic Policy, 6 (4), 100-134.
• • BRONZINI, R. VE PISELLI, P., (2016), The Impact of R&D Subsidies on Firm Innovation, Research Policy, 45, 442–457.
• • BUSOM, I., (2000), An Empirical Evaluation of the Effects of R&D Subsidies, Economics of Innovation and New Technology, 9 (2), 111-148.
• • BUTLER, I., GALASSI, G. VE RUFFO, H., (2016), Public Funding for Startups in Argentina: An Impact Evaluation, Small Bus Econ, 46, 295–309.
• • ČADIL, J., MIROŠNÍK, K. VE REHÁK, J., (2017), The Lack of Short-Term Impact of Cohesion Policy on the Competitiveness of SMEs, International Small Business Journal: Researching Entrepreneurship, 35 (8), 991–1009.
• • CALOFFI, A., MARIANI, M., ROSSI, F. VE RUSSO, M., (2018), A Comparative Evaluation of Regional Subsidies for Collaborative and Individual R&D in Small and Medium-Sized Enterprises, Research Policy, 47, 1437–1447.
• • CARBONI, O. A., (2011), R&D Subsidies and Private R&D Expenditures: Evidence from Italian Manufacturing Data, International Review of Applied Economics, 25 (4), 419-439.
• • CARBONI, O. A., (2017), The Effect of Public Support on Investment and R&D: An Empirical Evaluation on European Manufacturing Firms, Technological Forecasting & Social Change, 117, 282–295.
• • CASTILLO, V., MAFFIOLI, A., ROJO, S. VE STUCCHI, R., (2014), The Effect of Innovation Policy on SMEs' Employment and Wages in Argentina, Small Business Economics, 42 (2), 387-406.
• • CERULLI, G. VE POTÌ, B., (2012), Evaluating the Robustness of the Effect of Public Subsidies on Firms’ R&D: An Application to Italy, Journal of Applied Economics, 15 (2), 287-320.
• • CHOI, J. VE LEE, J., (2017), Repairing the R&D Market Failure: Public R & D Subsidy and the Composition of Private R&D, Research Policy, 46, 1465–1478.
• • CLARYSSE, B., WRIGHT, M. VE MUSTAR, P., (2009), Behavioural Additionality of R&D Subsidies: A Learning Perspective, Research Policy, 38, 1517–1533.
• • CORCHUELO, M. B. VE MARTÌNEZ-ROS, E., (2009), Who Benefits from R&D Tax Policy?, Cuadernos de Economía y Dirección de la Empresa, 45, 145-170.
• • CRESPI, G., GARONE, L. F. VE MAFFIOLI, A., MELENDEZ, M., (2015), Long-Term Productivity Effects of Public Support to Innovation in Colombia, Emerging Markets Finance and Trade, 51 (1), 48-64.
• • CZARNITZKI, D. VE LOPES-BENTO, C., (2014), Innovation Subsidies: Does the Funding Source Matter for Innovation Intensity and Performance? Empirical Evidence from Germany, Industry and Innovation, 21 (5), 380-409.
• • CZARNITZKI, D. VE DELANOTE, J., (2015), R&D Policies for Young SMEs: Input and Output Effects, Small Business Economics, 45, 465–485.
• • CZARNITZKI, D., EBERSBERGER, B. VE FIER, A., (2007), The Relationship Between R&D Collaboration, Subsidies and R&D Performance: Empirical Evidence from Finland and Germany, Journal of Applied Economics, 22, 1347–1366.
• • CZARNITZKI, D., HANEL, P. VE ROSA, J. M., (2011), Evaluating the Impact of R&D Tax Credits on Innovation: A Microeconometric Study on Canadian Firms, Research Policy, 40, 217–229.
• • CZARNITZKI, D. VE HUSSINGER, K., (2018), Input and Output Additionality of R&D Subsidies, Applied Economics, 50 (12), 1324-1341.
• • CZARNITZKI, D. VE LICHT, G., (2006), Additionality of Public R&D Grants in a Transition Economy: The case of Eastern Germany, Economics of Transition, 14 (1), 101–131.
• • CZARNITZKI, D. VE LOPES-BENTO, C., (2013), Value for Money? New Microeconometric Evidence on Public R&D Grants in Flanders, Research Policy, 42, 76– 89.
• • DAI, X. VE CHENG, L., (2015), Public Selection and Research and Development Effort of Manufacturing Enterprises in China: State Owned Enterprises versus Non-State Owned Enterprises, Innovation, 17 (2), 182-195.
• • DAI, X. VE CHENG, L., (2015), The Effect of Public Subsidies on Corporate R&D Investment: An Application of the Generalized Propensity Score, Technological Forecasting & Social Change, 90, 410–419.
• • DECRAMER, S. VE VANORMELINGEN, S., (2016), The Effectiveness of Investment Subsidies: Evidence from a Regression Discontinuity Design, Small Business Economics, 47, 1007–1032.
• • DUGUET, E., (2012), The Effect of the Incremental R&D Tax Credit on the Private Funding of R&D an Econometric Evaluation on French Firm Level Data, Revue d'économie politique, 122, 405-435.
• • EBERSBERGER, B., (2011), Public Funding for Innovation and the Exit of Firms, Journal of Evolutionary Economics, 21, 519–543.
• • EINIÖ, E., (2014), R&D Subsidies and Company Performance: Evidence from Geographic Variatıon in Government Funding Based on the ERDF Population-Density Rule, The Review of Economics and Statistics, 96 (4), 710–728.
• • ENGEL, D., ROTHGANG, M. VE ECKL, V., (2016), Systemic Aspects of R&D Policy Subsidies for R&D Collaborations and Their Effects on Private R&D, Industry and Innovation, 23 (2), 206-222.
• • FALK, R., (2007), Measuring the Effects of Public Support Schemes on Firms’ Innovation Activities Survey Evidence From Austria, Research Policy, 36, 665–679.
• • FERNÁNDEZ-RIBAS, A. VE SHAPIRA, P., (2007), The Role of National Innovation Programs in Stimulating International Cooperation in Innovation, Forthcoming in International Journal of Technology Management, 1-43.
• • FERNÁNDEZ-SASTRE, J. VE MARTÍN-MAYORAL, F., (2015), The effects of Developing-Countries’ Innovation Support Programs: Evidence from Ecuador, Innovation, 17 (4), 466-484.
• • FORNAHL, D., BROEKEL, T. VE BOSCHMA, R., (2011), What Drives Patent performance of German biotech firms? The impact of R&D Subsidies, Knowledge Networks and Their Location, Papers in Regional Science, 90 (2), 395-419.
• • FREITASA, I. B., CASTELLACCI, F., FONTANA, R., MALERBA, F. VE VEZZULLI, A., (2017), Sectors and the Additionality Effects of R&D Tax Credits: A Cross-Country Microeconometric Analysis, Research Policy, 46, 57–72.
• • GEORGHIOU, L., (2002), Impact and Additionality of Innovation Policy, Six Countries Programme on Innovation, Innovation Policy and Sustainable Development: Can Public Innovation Incentives Make a Difference?, Spring Conference, Brussels, 28 February - 1 March.
• • GERTLER, P. J., MARTINEZ, S., PREMAND, P., RAWLINGS, L. B., VERMEERSCH, C. M. J., (2011), Impact Evaluation in Practice, The World Bank, Washington.
• • GONZÀLEZ, X. VE PAZÒ, C., (2008), Do Public Subsidies Stimulate Private R&D Spending?, Research Policy, 37, 371–389.
• • GUO, D., GUO, Y. VE JIANG, K., (2016), Government-Subsidized R&D and Firm Innovation: Evidence from China, Research Policy, 45, 1129–1144.
• • HENNINGSEN. M. S., HÆGELAND, T. VE MØEN, J., (2014), Estimating the Additionality of R&D Subsidies Using Proposal Evaluation Data to Control for Research Intentions, Journal of Technological Transformation, 40, 227–251.
• • HERRERA, L. VE NIETO, M., (2008), The National Innovation Policy Effect According to Firm Location, Technovation, 28, 540–550.
• • HOTTENROTTA, H. LOPES-BENTO, C. VE VEUGELERS, R., (2017), Direct and Cross Scheme Effects in a Research and Development Subsidy Program, Research Policy, 46, 1118–1132.
• • HOTTENROTTA, H. VE LOPES-BENTO, C., (2014), R&D Collaboration and SMEs: The Effectiveness of Targeted Public R&D Support Schemes, Research Policy, 43, 1055–1066.
• • HSU, F. M., HORNG, D. J. VE HSUEH, C. C., (2009), The Effect of Government-Sponsored R&D Programmes on Additionality in Recipient Firms in Taiwan, Technovation, 29, 204–217.
• • HUD, M. VE HUSSINGER, K., (2015), The Impact of R&D Subsidies During the Crisis, Research Policy, 44, 1844–1855.
• • HUERGO, E. VE MORENO, L., (2017), Subsidies or Loans? Evaluating the Impact of R & D Support Programmes, Research Policy, 46, 1198–1214.
• • HUJER, R. VE RADIC, D., (2005), Evaluating The Impacts of Subsidies on Innovation Activities in Germany, Scottish Journal of Political Economy, 52 (4), 565-586.
• • HUSSINGER, K., (2008), R&D and Subsidies at the Firm Level: An Application of Parametric and Semiparametric Two-Step Selection Models, Journal of Applied Econometrics, 23, 729–747.
• • ITO, A., LI, Z. VE WANG, M., (2017), Multi-level and Multiroute Innovation Policies in China: A Programme Evaluation Based on Firm-level Data, Millennial Asia, 8 (1), 78–107.
• • INANERI, G., (2014), Türkiye’de Ar-Ge Faaliyetlerine Yönelik Kamu Desteğinin Artımsal Etkilerinin İncelenmesi, Galatasaray Üniversitesi Sosyal Bilimler Enstitüsü İşletme Anabilim Dalı Yüksek Lisans Tezi.
• • JAKLIČ, A., BURGER, A. VE ROJEC, M., (2013), The Quest for More Efficient R&D Subsidies, Eastern European Economics, 51 (4), 5-25.
• • KANG, K. N VE PARK, H., (2012), Influence of Government R&D Support and Inter-Firm Collaborations on Innovation in Korean Biotechnology SMEs, Technovation, 32, 68–78.
• • KARHUNEN, H. VE HUOVARI, J., (2015), R&D Subsidies and Productivity in SMEs, Small Business Economics, 45 (4), 805-823.
• • KHANDKER, S. R., KOOLWAL, G. B. VE SAMAD, H. A., (2010), Handbook on Impact Evaluation Quantitative Methods and Practices, The World Bank, Washington D. C., ABD.
• • LEE, C. Y., (2011), The Differential Effects of Public R&D Support on Firm R&D: Theory and Evidence from Multi-Country Data, Technovation, 31, 256–269.
• • LEE, E. Y. VE CIN, B. C., (2010), The Effect of Risk-Sharing Government Subsidy on Corporate R&D Investment: Empirical Evidence from Korea, Technological Forecasting & Social Change, 77, 881–890.
• • LIU, X., LI, X. VE LI, H., (2016), R&D Subsidies and Business R&D: Evidence from High-Tech Manufacturing Firms in Jiangsu, China Economic Review, 41, 1–22.
• • MADSEN, E. L., CLAUSEN, T. H. VE LJUNGGREN, E., (2008), Input, Output and Behavioural Additionality: Concepts and Relationships, Entrepreneurship and Innovation - Organizations, Institutions, Systems and Regions, Copenhagen, CBS, Denmark, Druid, 25th Celebration Conference, June 17 – 20.
• • MARIANI, M. VE MEALLI, F., (2018), The Effects of R&D Subsidies to Small and Medium-Sized Enterprises, Evidence from a Regional Program, Italian Economic Journal, 4, 249–281.
• • MARINOA, M., LHUILLERY, S. VE PARROTTA, P., SALA, D., (2016), Additionality or Crowding-Out? An Overall Evaluation of Public R&D Subsidy on Private R&D Expenditure, Research Policy, 45, 1715–1730.
• • MARTÌNEZ, C., CRUZ-CASTRO, L. VE SANZ-MENÈNDEZ, L., (2016), Innovation Capabilities in the Private Sector: Evaluating Subsidies for Hiring S&T Workers in Spain, Research Evaluation, 25 (2), 196–208.
• • MATEUT, S., (2018), Subsidies, Financial Constraints and Firm Innovative Activities in Emerging Economies, Small Business Economics, 50, 131–162.
• • MEULEMAN, M. VE MAESENEIRE, W., (2012), Do R&D Subsidies Affect SMEs’ Access to External Financing?, Research Policy, 41, 580– 591.
• • MULKAY, B. VE MAIRESSE, J., (2013), The R&D Tax Credit in France: Assessment and Ex Ante Evaluation of the 2008 Reform, Oxford Economic Papers, 746–766.
• • ÖZÇELİK, E. VE TAYMAZ, E., (2008), R&D Support Programs in Developing Countries: The Turkish Experience, Research Policy, 37, 258-275.
• • PATTON, M. QUINN, (1997), Utilization-Focused Evaluation, SAGE Publications, ABD.
• • POLAT, B. VE AKTAKKE, N., (2017), Etki Değerlendirme Yöntemleri: Kalkınma Programlarının Değerlendirmesinde Etki Analizi Yöntemleri ve Türkiye’de Uygulamalar, DAKA.
• • SERGIO, A., (2011), Behavioural Additionality in the Context of Regional Innovation Policy in Spain, Innovation: Management, Policy & Practice, 13, 95–110.
• • ŠIPIKAL, M. VE SIRANOVA, M., (2017), Evaluation of Innovation Support from EU Funds in the manufacturing of Wood and Wood Products in the Slovak Republic, Acta Facultatis Xylologiae Zvolen, 59 (2), 167−180.
• • SVENSSON, R., (2013), Publicly-Funded R&D Programs and Survival of Patents, Applied Economics, 45 (10), 1343-1358.
• • TAKALO, T., TANAYAMA, T. VE TOIVANEN, O., (2013), Estimating the Benefits of Targeted R&D Subsidies, The Review of Economics and Statistics, 95 (1), 255–272.
• • TİMURÇİN, D. VE GENÇ, K., (2014), Değerlendirme Kavramı ve KOBİ’lere Yönelik Devlet Desteklerinin Değerlendirilmesinin Önemi, İktisat Politikası Araştırmaları Dergisi, 1 (2), 31-84.
• • WALLSTEN, S. J., (2000), The Effects of Government-Industry R&D Programs on Private R&D: The Case of the Small Business Innovation Research Program, The RAND Journal of Economics, 31 (1), 82-100.
• • WANG, Y., LI, J. VE FURMAN, J. L., (2017), Firm Performance and State Innovation Funding: Evidence from China’s Innofund Program, Research Policy, 46, 1142–1161.
• • WANZENBOECK, I., SCHERNGELL, T. VE FISCHER, M. M., (2013), How do firm Characteristics Affect Behavioural Additionalities of Public R&D Subsidies? Evidence for the Austrian Transport Sector, Technovation, 33, 66–77.
• • WOKOUN, R., KOLAŘÍK, P. VE KOLAŘÍKOVÁ, J., (2016), Evaluation of Entrepreneurs with a Focus on Operational Programme Enterprise and Innovation (OPEI), Results of a Questionnaire Survey, Economics and Sociology, 9 (4), 272-288.
• • WOLFF, G. B. VE REINTHALER, V., (2008), The Effectiveness of Subsidies Revisited: Accounting for Wage and Employment Effects in Business R&D, Research Policy, 37 (8), 1403-1412.
• • YILDIZ, S. B., (2013), KOBİ’lere Sağlanan Kamu Desteklerinde Etki Değerlendirmesinin Önemi, Manisa Celal Bayar Üniversitesi Sosyal Bilimler Dergisi, 11 (2), 381-390. • YU, F., GUO, Y., LE-NGUYEN, K., BARNES, S. J. VE ZHANG, W., (2016), The Impact of Government Subsidies and Enterprises’ R&D Investment: A Panel Data Study from Renewable Energy in China, Energy Policy, 89, 106-113.