Elsevier

Research Policy

Volume 39, Issue 3, April 2010, Pages 313-322
Research Policy

Experimental methods in innovation research

https://doi.org/10.1016/j.respol.2010.01.006Get rights and content

Abstract

This paper discusses the possible applications of different types of experiment methods in innovation research. The paper argues that the experiment as a research method has been a largely missed opportunity in innovation research, in particular for creating applicable knowledge for businesses and organisations in the shape of new innovation tools and methods. The paper applies an analytically based limitation of the experiment method which includes an array of both quantitative and qualitative approaches. The use of experiments for such purposes is illustrated through a comparative study of four experiments concerning open innovation in service businesses and organisations. The case studies show how different experiment methods provide new opportunities for innovation research and how they can create new and applicable knowledge about open innovation. Thus the paper argues for applying experiments as an addition to other research methods in innovation research.

Introduction

This paper argues that the experiment as a research method has been given too small a role in innovation research and that the method may present an important avenue for attaining knowledge complementary to that which is provided by the traditionally applied methods in innovation research, i.e. survey methods and (to a certain degree) case studies. Surveys and other quantitative approaches have proved adequate to measure and understand innovation processes following fixed patterns and case studies have succeeded in providing prescriptive models of how to design and control relatively simple consecutive stages of innovation processes. However, recent theories of, for example, open innovation (Chesbrough, 2003) and innovation systems (Carlsson et al., 2002) indicate that innovation processes consist of complex social interactions which these earlier models cannot embrace. Open innovation can be defined as an interactive process where ideas and inputs to innovation come from many sources: users, suppliers, competitors, spin-offs from large firms, knowledge intensive service firms or other services (Chesbrough, 2003). Therefore new and practically applicable knowledge about complex open and interactive innovation processes is needed. The paper argues that the experiment is a promising approach to gain such practically applicable knowledge.

The paper approaches the experiment not as one method in the form of a positivist laboratory experiment, but rather as a particular analytical approach which includes an array of methods and data collection techniques. The benefits of experiments in innovation research are discussed against the background of case studies of four different types of experiments concerning innovation in service organisations. These experiments formed part of a larger innovation research project. This so-called ICE (Innovation-Customers-Employees) project involves researchers from Roskilde and Aalborg Universities in Denmark. In this research project a number of experiments using new tools and procedures, hypothesised to improve service companies’ innovation processes, are being carried out. The aim of this is to test and develop such innovation tools and procedures that service companies will be able to apply in the future (ICE, 2008). The companies in question are varied—they provide different kinds of services; they are large and small, and they work with local and international markets. Thus the paper discusses and exemplifies the application of the experiment method at a general service company level.

The paper is structured as follows: first, the nature of innovation and innovation research is briefly discussed. This is followed by an outline and discussion of the experiment method as it has been applied in social science which leads to an alternative analytically based delimitation of the method. This is followed by a discussion of how experiments may be applied to study innovation processes and by the presentation of the experiment cases. The paper finalises with a discussion of the findings and their implications for innovation research.

Section snippets

The nature of innovation and innovation research

Innovation is here understood as new products or services, production processes, marketing procedures or organisational set-ups (e.g. Trott, 2005). Innovation processes include the search for, discovery of, experimentation with, development of, imitation, and adaptation of such new products, services, production processes, etc. (Dosi, 1988). Characteristic of early theoretical approaches to innovation such as Schumpeter's (1969 [1934]) entrepreneur theory and the technology-push and demand pull

Experiments and social science research

Experiments in social sciences are (with clear reference to experiments as carried out in natural science) typically confined to actions undertaken to test hypotheses in a laboratory setting detached from the rest of society (Gross and Krohn, 2005, Neuman, 2000). Effects upon a dependent variable caused by an investigator-controlled change of an independent variable within a controlled context are investigated by assigning individuals randomly to two or more groups which are treated

Experiments and innovation research

The restricted amount of literature concerning innovation experiments indicates that experiment methods may represent a missed opportunity in innovation research. Inspiration can mainly be found in related subjects such as ‘experimental economics’ (Kagel and Roth, 1995) and ‘experimental business research’ (Zwick and Rapoport, 2002). These areas applying quantitative laboratory experiments have developed around topics from which simple cause–effect relations can be extracted and simulated in

Exemplary innovation experiments

In the following four experiments are presented which illustrate how and with what results different types of experiments can be applied in innovation research. The experiments reported concern different aspects of open innovation including the interaction with users, with actors in the value chain as well as interactions within a more complex innovation milieu. Thus, the experiments illustrate how different and more or less complex aspects of open innovation may be analysed in experiments

Discussion: practical and methodological benefits of innovation experiments

The four innovation experiments described represent different cases regarding control versus lack of control and quantitative versus qualitative measures and, thus, they represent the four corners of Fig. 1 (however all but the city innovation experiment applied different quantitative and qualitative data collection techniques simultaneously). The cases illustrate how different experimental set-ups provide both similar and varying types of benefits, and how these set-ups provide an alternative

Conclusion

Open innovation involves new actors and new processes and thus begs new models and methods of innovation. The cases presented in this paper show how innovation experiments can cast light on these processes, on different actors’ roles and, not least, on how different actions can sustain open innovation, while creating practically applicable knowledge about how to utilise open innovation. Open innovation on the one hand provides a whole new array of experimental possibilities. On the other hand,

References (54)

  • H. Chesbrough

    Open Innovation: The New Imperative for Creating and Profiting from Technology

    (2003)
  • R.G. Cooper

    Winning at New Products

    (1986)
  • R.G. Cooper et al.

    Product Development for the Service Sector

    (1999)
  • G. Dosi

    The nature of the innovative process

  • T. Dunning

    Improving causal inference: strengths and limitations of natural experiments

    Political Research Quarterly

    (2008)
  • Eurostat

    Innovation in Europe

    (2004)
  • M. Fischer

    The innovation process and network activities of manufacturing firms

  • L. Fuglsang et al.

    Dynamics of experience service innovation: Innovation as a guided activity. Results from a Danish survey

    Service Industries Journal

    (2011)
  • D. Gefen et al.

    The relative importance of perceived ease of use in IS adoption: a study of E-commerce adoption

    Journal of the Association for Information Systems 1

    (2000)
  • D. Green et al.

    The underprovision of experiments in political science

    The Annals of the American Academy of Political and Social Science

    (2003)
  • M. Gross et al.

    Society as experiment: sociological foundations for a self-experimental society

    History of Human Sciences

    (2005)
  • E. Gummesson

    Qualitative Methods in Management Research

    (1988)
  • H. Håkansson

    Industrial Technological Development. A Network Approach

    (1987)
  • C. Holt

    Industrial organisation: a survey of laboratory research

  • ICE, 2008. When the customer encounters the employee–Interactive user-based innovation in service....
  • J. Kagel et al.

    The Handbook of Experimental Economics

    (1995)
  • A. Kumar et al.

    Webpage background and viewer attitudes

    Journal of Advertising Research

    (2000)
  • Cited by (76)

    • What drives innovative behavior?- An experimental analysis on risk attitudes, creativity and performance

      2022, Journal of Behavioral and Experimental Economics
      Citation Excerpt :

      In other words, a failure perceived as a personal inadequacy can weaken the subject’s self-esteem (Rosi et al., 2019), thereby reducing the psychological “motivating” effect in improving their performance (Baumeister, Campbell, Krueger, & Vohs, 2003) observed in the Lottery treatment. With this study, we answered Sørensen et al. (2010)’s request to adopt experiments in innovation research. It is important to highlight that our proposed approach aims to complement other research methods, such as qualitative case studies or surveys.

    View all citing articles on Scopus
    1

    Tel.: +45 4674 2506; fax: +45 4674 3081.

    2

    Tel.: +45 4674 2161; fax: +45 4674 3081.

    View full text