Abstract
This chapter develops a human-centered co-evaluation method for the evaluation of service innovations in the context of digital services. The method derives from two different theoretical approaches. It integrates a multi-criteria evaluation framework to evaluate multiple impacts of innovations and a process of developmental evaluation to support multivoiced evaluation and continuous learning throughout their development process. The new method emphasizes human and societal impacts, which are analyzed parallel with the traditional techno-economic characteristics of innovations. It makes human-centeredness and sustainability more visible as values than traditional evaluations and thus guides the development toward more inclusive and ethical digitalization.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aalto-Kallio, M., & Hakulinen, H. (2009). Arviointiakvaario – osallistuva menetelmä kaikkien hyödyksi (Terveyden edistämisen lehti Promo 59) (p. 36). (in Finnish).
Arntz, M., Gregory, T., & Zierahn, U. (2016). The risk of automation for jobs in OECD countries: A comparative analysis (OECD social, employment and migration working papers) (Vol. 189, p. 16, June). Paris: OECD Publishing. https://doi.org/10.1787/5jlz9h56dvq7-en.
Banerjee, S. B. (2008). Corporate social responsibility: The good, the bad and the ugly. Critical Sociology, 34(1), 51–79.
Berger, J. B., Hertzum, M., & Schreiber, T. (2016). Does local government staff perceive digital communication with citizens as improved service? Government Information Quarterly, 33, 258–269.
Boltanski, L., & Thévenot, L. (1991). De la justification. Les économies de la grandeur. Paris: Gallimard.
Bovaird, T. (2007). Beyond engagement and participation: User and community coproduction of public services. Public Administration Review, 67(5), 846–860.
Bowen, D. E. (2016). The changing role of employees in service theory and practice: An interdisciplinary view. Human Resource Management Review, 26, 4–13.
Breit, E., & Salomon, R. (2015). Making the technological transition – Citizens’ encounters with digital pension services. Social Policy & Administration, 49(3), 299–315.
Brulin, G., & Svensson, L. (2012). Managing sustainable development programmes: A learning approach to change. London: Gower Publishing.
Dahlberg, K. (2018). The art of understanding. In M. Visse & T. Abma (Eds.), Evaluation for a caring society (pp. 51–79). Charlotte: Information Age Publishing.
Dahler-Larsen, P. (2019). The sceptical turn in evaluation. In J.-E. Furubo & N. Stame (Eds.), The evaluation enterprise. A critical view (pp. 58–80). New York/London: Routledge.
den Hertog, P. (2010). Managing the soft side of innovation: How the practitioners, researchers and policymakers deal with service innovation? In R. E. Smits, S. Kuhlmann, & P. Shapira (Eds.), The theory and practice of innovation policy. An international research handbook (pp. 303–331). Cheltenham/Northampton: Edward Elgar.
Djellal, F., & Gallouj, F. (2010). The Innovation gap and the performance gap in the service economies: A problem for public policy. In F. Gallouj & F. Djellal (Eds.), The handbook of innovation in services. A multi-disciplinary perspective (pp. 653–673). Cheltenham: Edward Elgar.
Djellal, F., & Gallouj, F. (2013). The Productivity in services: Measurement and strategic perspectives. The Service Industries Journal, 33(3-4), 282–299.
Dosi, G. (1988). The nature of the innovative process. In G. Dosi, C. Freeman, R. Nelson, G. Silverberg, & L. Soete (Eds.), Technical change and economic theory. London/New York: Pinter Publishers.
Dyehouse, M., Bennett, D., Harbor, J., Childress, A., & Dark, M. (2009). A comparison of linear and systems thinking approaches for program evaluation illustrated using Indiana Interdisciplinary GK-12. Evaluation and program planning, 32, 187–196.
Elg, M., Ellström, P. E., Klofsten, M., & Tillmar, M. (2015). Sustainable development in organizations. Sustainable development in organizations: Studies on innovative practices (pp. 1–15). Cheltenham: Edward Elgar.
Elzen, B., Geels, F. W., & Green, K. (2004). System innovation and the transition to sustainability. Cheltenham/Northampton: Edward Elgar.
Engeström, Y. (1999). Expansive visibilization of work: An activity-theoretical perspective. Computer-Supported Cooperative Work, 8, 63–93.
Engeström, Y. (2001a). Making expansive decisions. An activity-theoretical study of practitioners building collaborative medical care for children. In C. M. Allwood & M. Selart (Eds.), Decision making: Social and creative dimensions (pp. 281–301). Dordrecht: Kluwer.
Engeström, Y. (2001b). Expansive learning at work: Toward an activity theoretical reconceptualization. Journal of Education and Work, 14(1), 129–152.
Ensminger, D. C., Kellemeyn, L. M., Rempert, T., Wade, J., & Polanin, M. (2015). Case study of an evaluation coaching model: Exploring the role of the evaluator. Evaluation and Program Planning, 49, 124–136.
Flyvbjerg, B., Bruzelius, N., & Rothengatter, W. (2003). Megaprojects and risk: An anatomy of ambition. Cambridge: Cambridge University Press.
Geels, F. W. (2002). Technological transitions as evolutionary reconfiguration processes: A multi-level perspective and a case-study. Research Policy, 31, 1257–1274.
Geels, F. W. (2004). From sectoral systems of innovation to socio-technical systems. Insights about dynamics and change from sociology and institutional theory. Research Policy, 33, 897–920.
Geels, F. W. (2010). Ontologies, socio-technical transitions (to sustainability), and the multi-level perspective. Research Policy, 39, 495–510.
Gendron, C. (2013). Sustainable development through innovation? A social challenge. In J. R. McIntyre, S. Ivanaj, & V. Ivanaj (Eds.), Strategies for sustainable technologies and innovations (pp. 51–73). Cheltenham: Edward Elgar.
Harrisson, D. (2012). Social innovation: What is coming apart and what is being rebuilt? In H.-W. Franz, J. Hochgerner, & J. Howaldt (Eds.), Challenge social innovation potentials for business, social entrepreneurship, welfare and civil society (pp. 73–86). Heidelberg/New York: Springer.
Harrisson, D., Klein, J.-L., & Browne, P. L. (2010). Social innovation, social enterprise and services. In F. Gallouj & F. Djellal (Eds.), The Handbook of innovation and services (pp. 197–281). Cheltenham/Northampton: Edward Elgar.
Hartley, J. (2005). Innovation in governance and public services: Past and present. Public Money and Management, 25(January), 35–42.
Hasu, M., Honkaniemi, L., Saari, E., Mattelmäki, T., & Koponen, L. (2014). Learning employee-driven innovating: Towards sustained practice through multi-method evaluation. Journal of Workplace Learning, 26(5), 310–330.
Honkaniemi, L., Lehtonen, M. H., & Hasu, M. (2015). Wellbeing and innovativeness: Motivational trigger points for mutual enhancement. European Journal of Training and Development, 39(5), 393–408.
Høyrup, S., Bonnafous-Boucher, M., Hasse, C., Lotz, M., & Møller, M. (2012). Employee-driven innovation: A new approach. Basingstoke: Palgrave Macmillan.
Hyytinen, K. (2017). Supporting service innovation via evaluation: A future oriented, systemic and multi-actor approach. Doctoral dissertation 14/2017, Aalto University publication series. VTT Science 146. http://www.vtt.fi/inf/pdf/science/2017/S146.pdf
Kahnert, D., Menez, R., & Blättel-Mink, B. (2012). Coordination and motivation of customer contribution as social innovation: The case of Crytek. In H.-W. Franz, J. Hochgerner, & J. Howaldt (Eds.), Challenge social innovation potentials for business, social entrepreneurship, welfare and civil society (pp. 293–306). Heidelberg/New York: Springer.
Kemp, R., Loorbach, D., & Rotmans, J. (2009). Transition management as a model for managing processes of co-evolution towards sustainable development. International Journal of Sustainable Development & World Ecology, 14, 78–91.
Kivimaa, P., & Mickwitz, P. (2011). Public policy as a part of transforming energy systems: framing bioenergy in Finnish energy policy. Journal of Cleaner Production, 19, 1812–1821.
Kline, S. J., & Rosenberg, N. (1986). An overview of innovation. In R. Landau & N. Rosenberg (Eds.), The positive sum strategy – Harnessing technology for economic growth. Washington, DC: National Academy Press.
Komiyama, H., & Takeuchi, K. (2006). Sustainability science: Building a new discipline. Sustainability Science, 1(1), 1–6.
Korvela, P., & Tuomi-Gröhn, T. (Eds.). (2014). Arjen rakentuminen ja rytmit perhe-elämän käännekohdissa (Kuluttajatutkimuksen kirjoja 9). Tampere: Tampereen yliopistopaino.
Kroeger, A., & Weber, C. (2014). Developing a conceptual framework for comparing social value creation. Academy of Management Review, 39(4), 513–540.
Lévesque, B. (2013). Social Innovation in governance and public management systems: Toward a new paradigm? In F. Moulaer, D. Mac Callum, A. Mehmood, & A. Hamdouch (Eds.), The international handbook of social innovation. Collective Action, social learning and transdisciplinary research (pp. 25–39). Cheltenham: Edward Elgr.
Lundvall, B.-Å. (1992). National systems of innovation: Towards a theory of innovation and interactive learning. London/New York: Pinter Publishers.
Lusch, R., Vargo, S. L., & Tanniru, M. (2010). Service, value networks and learning. Journal of the academic marketing science, 38, 19–31.
Mickwitz, P., Hildén, M., Seppälä, J., & Melanen, M. (2011). Sustainability through system transformation: Lessons from Finnish efforts. Journal of Cleaner Production, 19, 1779–1787.
Moulaert, F., MacCallum, D., & Hillier, J. (2013). Social innovation: Intuition, precept, concept, theory and practice. In F. Moulaert, D. MacCallum, A. Mehmood, & A. Hamdouch (Eds.), The international handbook of social innovation. Collective action, social learning and transdisciplinary research (pp. 13–24). Cheltenham: Edward Elgar.
Mulgan, G. (2007). Social Silicon Valleys. The Young Foundation. London: The Basingstoke Press.
Nelson, S., & Winter, R. (1982). An evolutionary theory of economic change. Cambridge: Belknap Press/Harvard University Press.
Ostrom, A. L., Parasuraman, A., Bowen, D. E., Patricio, L., & Voss, C. A. (2015). Service research priorities in a rapidly changing context. Journal of Service Research, 18(2), 127–159.
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford.
Pol, E., & Ville, S. (2009). Social innovation: Buzz word or enduring term? The Journal of Socio-Economics, 38(6), 878–885.
Pope, J., Annandale, D., & Morrison-Saunders, A. (2004). Conceptualising sustainability assessment. Environmental Impact Assessment Review, 24(6), 595–616.
Rubalcaba, L. (2006). Which policy for innovation in services? Science and Public Policy, 33(10), 745–756.
Rubalcaba, L., Michel, S., Sundbo, J., Brown, S. W., & Reynoso, J. (2012). Shaping, organizing and rethinking service innovation: A multidimensional framework. Journal of Service Management, 23(5), 696–715.
Rubalcaba, L., Di Meglio, G., & Gallego, J. (2013). Public-private innovation networks and social innovation in the service economy. In C. R. Viñals & C. P. Rodríguez (Eds.), Social innovation: New forms of organization in knowledge-based societies (pp. 188–205). New York: Routledge.
Saari, E., & Kallio, K. (2011). Developmental impact evaluation facilitating learning in innovation networks. American Journal of Evaluation, 32(2), 227–245.
Smith, A., Voß, J.-P., & Grin, J. (2010). Innovation studies and sustainability transitions: The allure of the multi-level perspective and its challenges. Research Policy, 39, 435–448.
Smits, R., Kuhlmann, S., & Shapira, P. (Eds.). (2010). The theory and practice of innovation policy: An international research handbook. Cheltenham: Edward Elgar.
Toivonen, M. (2010). Different types of innovation processes in services and their organizational implications. In F. Gallouj & F. Djellal (Eds.), The Handbook of innovation in services. A multi-disciplinary perspective (pp. 653–673). Cheltenham: Edward Elgar.
Toivonen, M. (2015). Introduction to the session Hand in hand: Innovating meaningful services in digital and human networks. Presentation. HSSE conference. Las Vegas 30.7.2015.
van de Klundert, A., & Anschutz, J. (2001). Integrated sustainable waste management – The concept; tools for decision-makers – Experiences from the urban waste expertise programme (pp. 1005–2001). Gouda, The Netherlands: WASTE.
Vargo, S., & Lusch, R. (2004). Evolving to a new dominant logic for marketing. Journal of Marketing, 68(1), 1–17.
Vargo, S., & Lusch, R. (2008). Service-dominant logic: Continuing the evolution. Journal of the Academy of Marketing Science, 36(1), 1–10.
Visse, M., & Abma, T. (2018). Evaluation for a caring society. Charlotte: Information Age Publishing.
WCED (World Commission for Economic Development). (1987). Our common future. New York: Oxford University Press.
Weber, M., & Hemmelskamp, J. (Eds.). (2005). Towards environmental innovation systems. Heidelberg: Springer.
Williams, B., & Imam, I. (Eds.). (2007). Systems concepts in evaluation: An expert anthology. Point Reyes: Edge Press of Inverness.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Hyytinen, K., Saari, E., Elg, M. (2019). Human-Centered Co-evaluation Method as a Means for Sustainable Service Innovations. In: Toivonen, M., Saari, E. (eds) Human-Centered Digitalization and Services. Translational Systems Sciences, vol 19. Springer, Singapore. https://doi.org/10.1007/978-981-13-7725-9_4
Download citation
DOI: https://doi.org/10.1007/978-981-13-7725-9_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-7724-2
Online ISBN: 978-981-13-7725-9
eBook Packages: Business and ManagementBusiness and Management (R0)