A system dynamic and multi-criteria evaluation of innovations in environmental services

Author/s Kirsi Hyytinen, Sampsa Ruutu, Mika Nieminen, Faiz Gallouj, Marja Toivonen
Publishing Year 2015 Issue 2014/3 Language English
Pages 24 P. 29-52 File size 1583 KB
DOI 10.3280/EFE2014-003003
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

The purpose of this paper is to study the challenge of evaluation in the context of systemic innovations in which services are a core element. The paper argues that the traditional evaluation methods and measures are not able to capture neither the diversity of innovations in services and systems nor the multifaceted dimensions of performance resulting from these innovations. In order to contribute to a more purposeful evaluation practices and methods, a new combinatory approach is suggested based on multi-criteria and system dynamic perspectives. This approach is illustrated in the context of environmental services, using an environmental data platform as a case example.

Keywords: Multi-criteria evaluation, system dynamic, service innovation, systemic innovation, environmental services, environmental data platform

Jel codes: O33, O44, Q56

  1. Adner R. (2012). The Wide Lens. A New Strategy for Innovation. London: Portfolio Penguin.
  2. Ahrweiler P. (Ed.) (2010). Innovation in Complex Social Systems. New York: Routledge.
  3. Arnold E. (2004). Evaluating research and innovation policy: a systems world needs systems evaluations. Research Evaluation, 13 (1): 3-17. DOI: 10.3152/147154404781776509
  4. Auvinen H., Ruutu S., Tuominen A., Ahlqvist T. and Oksanen J. (2014). Process supporting strategic decision-making in systemic transitions. Technological Forecasting and Social Change. DOI: 10.1016/j.techfore.2014.07.011(InPress)
  5. Boltanski L. and Thévenot L. (1991). De la justification. Les économies de la grandeur. Paris: Gallimard.
  6. Brax S. and Jonsson K. (2009). Developing integrated solution offerings for remote diagnostics: a comparative case study of two manufacturers. International Journal of Operations and Production Management, 29 (5): 539-560. DOI: 10.1108/01443570910953621
  7. Bryman A. and Bell E. (2011). Business Research Methods. 3rd Ed. New York: Oxford University Press.
  8. Cabrera D., Colosi L. and Lobdell C. (2008). Systems thinking. Evaluation and Program Planning, 31 (2): 299-310. DOI: 10.1016/j.evalprogplan.2007.12.001
  9. Carayannis E.G. and Cambell D.F.J. (2009). Mode3 and Quadruple Helix: Toward a 21st century fractal innovation ecosystem. International Journal of Technology Management, 46 (3-4): 201-234. DOI: 10.1504/ijtm.2009.023374
  10. Chen M., Mao S. and Liu Y. (2014). Big Data: A Survey. Mobile Netw Appl, 19: 171-209. DOI: 10.1007/s11036-013-0489-0
  11. Coombs R. and Miles I. (2000). Innovation, measurement and services: the new problematique. In: Metcalfe J.S. and Miles I. (Eds.), Innovation Systems in the Service Economy – Measurement and Case Study Analysis. Boston, Dordrecht and London: Kluwer Academic Publishers.
  12. Djellal F. and Gallouj F. (1999), Services and the search for relevant innovation indicators: a review of national and international surveys. Science and Public Policy, 26 (4), Août: 218-232. DOI: 10.3152/147154399781782400
  13. Djellal F. and Gallouj F. (2010). The Innovation gap and the performance gap in the service economies: a problem for public policy. In: Gallouj F. and Djellal F. (Eds.), The handbook of innovation in services. A multi-disciplinary perspective. Cheltenham, UK: Edward Elgar: 653-673. Djellal F. and Gallouj F. (2013a). The Productivity in services: Measurement and strategic perspectives. The Service Industries Journal, 33 (3-4): 282-299. DOI: 10.1080/02642069.2013.747519
  14. Djellal F. and Gallouj F. (2013b). How public-private innovation networks in services (ServPPINs) differ from other innovation networks: what lesson for theory? In: Gallouj F., Rubalcaba L. and Windrum P. (Eds.), Public-private innovation networks in services, Cheltenham, UK: Edward Elgar.
  15. Djellal F. and Gallouj F. (2015). Green and sustainable innovation in a service economy. In: Bryson J.R. and Daniels P. (Eds.), The handbook of service business: Management, marketing, innovation and internationalization. New York: Springer (under press).
  16. Dosi G. (1999). Some notes on national systems of innovation and production, and their implications for economic analysis. In: Archibugi D., Howells J. and Michie J. (Eds.), Innovation policy in a global economy. Cambridge: Cambridge University Press.
  17. Dosi G., Freeman C., Nelson R., Silverberg G. and Soete L. (1988). Technical change and economic theory. London and New York: Pinter Publishers.
  18. Dyehouse M., Bennett D., Harbor J., Childress A. and Dark M. (2009). A comparison of linear and systems thinking approaches for program evaluation illustrated using Indiana Interdisciplinary GK-12. Evaluation and Program Planning, 32: 187-196. DOI: 10.1016/j.evalprogplan.2009.03.001
  19. Edquist C. (2005). Reflections on the systems of innovation approach. Science and Public Policy, 31 (6): 485-489. DOI: 10.3152/147154304781779741
  20. Elzen B., Geels F.W. and Green K. (2004). System innovation and the transition to sustainability. Cheltenham, UK: Edward Elgar.
  21. Gadrey J. (1996). L’économie des services. 2nd ed. Paris: La Découverte, coll. Repères.
  22. Gadrey J. (2010). The environmental crisis and the economics of services: The need for revolution. In: Gallouj F. and Djellal F. (Eds.), The handbook of innovation in services. A multi-disciplinary perspective. Cheltenham, UK: Edward Elgar: 653-673.
  23. Gallouj F. (1994). Economie de l’innovation dans les services. Paris: Éditions L’Harmattan (Logiques économiques).
  24. Gallouj F. (2002). Innovation in the service economy: The new wealth of nations. Cheltenham, UK: Edward Elgar.
  25. Gallouj F. and Weinstein O. (1997). Innovation in services. Research Policy, 26 (4/5): 537-556. DOI: 10.1016/s0048-7333(97)00030-9
  26. Gallouj F., Rubalcaba L. and Windrum P. (2013). Public-private innovation networks in services. Cheltenham, UK: Edward Elgar.
  27. Gallouj F., Weber M., Stare M. and Rubalcaba L. (2014). The future of the service economy in Europe: a foresight analysis. Technological Forecasting and Social Change (available online). DOI: 10.1016/j.techfore.2014.06.009
  28. Geels F.W. (2002). Technological transitions as evolutionary reconfiguration processes: A multi-level perspective and a case-study. Research Policy, 31: 1257-1274. DOI: 10.1016/s0048-7333(02)00062-8
  29. Geels F.W. (2004). From sectoral systems of innovation to socio-technical systems. Insights about dynamics and change from sociology and institutional theory. Research Policy, 33: 897-920. DOI: 10.1016/j.respol.2004.01.01
  30. Geels F.W. (2010). Ontologies, socio-technical transitions (to sustainability), and the multilevel perspective. Research Policy, 39: 495-510. DOI: 10.1016/j.respol.2010.01.022
  31. Giddens A. (1987). Social Theory and Modern Sociology. Cambridge: Polity Press.
  32. Harrison D., Klein J.-L. and Browne P.L. (2010). Social innovation, social enterprise and services. In: Gallouj F. and Djellal F. (Eds.), The handbook of innovation and services. Cheltenham, UK: Edward Elgar: 197-281. Heller P.R. (2013). The Russian innovation ecosystem 2013. International Journal of Innovation Science, 5 (2): 119-130.
  33. Henderson R.M. and Clark K.B. (1990), Architectural innovation: the reconfiguration of existing product technologies and the failure of established firms. Administrative Science Quarterly, March, 35 (1): 9-30. DOI: 10.2307/2393549
  34. Kalambokis E., Tambouris E. and Tarabanis K. (2012). A classification scheme for open government data: towards linking decentralised data. International Journal of Web Engineering and Technology, 6/3, June: 266-285. DOI: 10.1504/ijwet.2011.040725
  35. Kim W.C. and Mauborgne R. (1999). Strategy, value innovation, and the knowledge economy. MIT Sloan Management Review, Spring: 41-54.
  36. Kline S.J. and Rosenberg N. (1986). An Overview of Innovation. In: Landau R. and Rosenberg N. (Eds.), The positive sum strategy – Harnessing technology for economic growth. Washington D.C.: National Academy Press.
  37. Lundvall B.-Å. (1992). National systems of innovation: Towards a theory of innovation and interactive learning. London and New York: Pinter Publishers.
  38. Lundvall B.-Å. (2007). National innovation systems – Analytical concept and development tool. Industry and Innovation, 14 (1): 95-119. DOI: 10.1080/13662710601130863
  39. Malerba F. (2002). Sectoral systems of innovation and production. Research Policy, 31 (2): 247-264. DOI: 10.1016/s0048-7333(01)00139-1
  40. Nelson S. and Winter R. (1982). An evolutionary theory of economic change. Cambridge (Mass.): Belknap Press/Harvard University Press.
  41. Patton M.Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford.
  42. Preissl B. (2000). Service Innovation: What makes it different? Empirical Evidence from Germany. In: Metcalfe J.S. and Miles I. (Eds.), Innovation systems in the service economy – Measurement and case study analysis. Boston, Dordrecht and London: Kluwer Academic Publishers.
  43. Rossi P.H., Freeman H.E. and Lipsey M.W. (1999). Evaluation. A systematic approach. 6th Ed., Thousand Oaks: Sage.
  44. Rubalcaba L., Michel S., Sundbo J., Brown S.W. and Reynoso J. (2012). Shaping, organizing and rethinking service innovation: A multidimensional framework. Journal of Service Management, 23 (5): 696-715. DOI: 10.1108/09564231211269847
  45. Schumpeter J.A. (1934). The Theory of Economic Development – An Inquiry into Profits, Capital, Credit, Interest, and the Business Cycle. Cambridge (Mass.): Harvard University Press.
  46. Schumpeter J.A. (1942). Capitalism, Socialism and Democracy. New York and London: Harper & Brothers Publishers.
  47. Smith A., Voss J.-P. and Grin J. (2010). Innovation studies and sustainability transitions: The allure of the multi-level perspective and its challenges. Research Policy, 39: 435-448. DOI: 10.1016/j.respol.2010.01.023
  48. Smith K.R. (2000). Innovation as a systemic phenomenon: Rethinking the role of policy. Enterprise and Innovation Management Studies, 1 (1): 73-102. DOI: 10.1080/146324400363536
  49. Smits R. and Kuhlmann S. (2004). The rise of systemic instruments in innovation policy.
  50. Journal of Foresight and Innovation Policy, 1 (1/2): 4. DOI: 10.1504/ijfip.2004.004621
  51. Späth P. and Rohracher H. (2010). Energy regions: The transformative power of regional discourses on socio-technical futures. Research Policy, 39: 449-458. DOI: 10.1016/j.respol.2010.01.017
  52. Sterman J.D. (2000). Business dynamics: Systems thinking and modeling for a complex world. Boston: Irwin McGraw-Hill. Toivonen M. (2010). Different types of innovation processes in services and their organizational implications. In: Gallouj F. and Djellal F. (Eds.), The handbook of innovation in services. A multi-disciplinary perspective. Cheltenham, UK: Edward Elgar: 653-673.
  53. Toivonen M. and Tuominen T. (2009). Emergence of innovations in services. The Service Industries Journal, 29 (7): 887-902. DOI: 10.1080/02642060902749492
  54. Vargo S. and Lusch R. (2004). Evolving to a New Dominant Logic for Marketing. Journal of Marketing, 68 (1): 1-17. DOI: 10.1509/jmkg.
  55. Vargo S. and Lusch R. (2008). Service-dominant logic: continuing the evolution. Journal of the Academy of Marketing Science, 36 (1): 1-10. DOI: 10.1007/s11747-007-0069-6
  56. Vedung E. (2006). Evaluation Research. In: Peters B.G. and Pierre J. (Eds.), Handbook of Public Policy. London: Sage: 397-416.
  57. Weber M. and Hemmelskamp J. (Eds.) (2005), Towards Environmental Innovation Systems. Heidelberg: Springer.
  58. Williams B. and Imam I. (Eds.) (2007). Systems Concepts in Evaluation: An Expert Anthology. Point Reyes: EdgePress of Inverness.
  59. Windrum P. and García-Goñi M. (2008). A neo-Schumpeterian model of health services innovation. Research Policy, 37 (4): 649-672. DOI: 10.1016/j.respol.2007.12.011
  60. Zuiderwijk A. and Janssen M. (2014). Open data policies, their implementation and impact: A framework for comparison. Government Information Quarterly, 31: 17-29. DOI: 10.1016/j.giq.2013.04.003

Kirsi Hyytinen, Sampsa Ruutu, Mika Nieminen, Faiz Gallouj, Marja Toivonen, A system dynamic and multi-criteria evaluation of innovations in environmental services in "ECONOMICS AND POLICY OF ENERGY AND THE ENVIRONMENT" 3/2014, pp 29-52, DOI: 10.3280/EFE2014-003003