Experimental methods in innovation research
Introduction
This paper argues that the experiment as a research method has been given too small a role in innovation research and that the method may present an important avenue for attaining knowledge complementary to that which is provided by the traditionally applied methods in innovation research, i.e. survey methods and (to a certain degree) case studies. Surveys and other quantitative approaches have proved adequate to measure and understand innovation processes following fixed patterns and case studies have succeeded in providing prescriptive models of how to design and control relatively simple consecutive stages of innovation processes. However, recent theories of, for example, open innovation (Chesbrough, 2003) and innovation systems (Carlsson et al., 2002) indicate that innovation processes consist of complex social interactions which these earlier models cannot embrace. Open innovation can be defined as an interactive process where ideas and inputs to innovation come from many sources: users, suppliers, competitors, spin-offs from large firms, knowledge intensive service firms or other services (Chesbrough, 2003). Therefore new and practically applicable knowledge about complex open and interactive innovation processes is needed. The paper argues that the experiment is a promising approach to gain such practically applicable knowledge.
The paper approaches the experiment not as one method in the form of a positivist laboratory experiment, but rather as a particular analytical approach which includes an array of methods and data collection techniques. The benefits of experiments in innovation research are discussed against the background of case studies of four different types of experiments concerning innovation in service organisations. These experiments formed part of a larger innovation research project. This so-called ICE (Innovation-Customers-Employees) project involves researchers from Roskilde and Aalborg Universities in Denmark. In this research project a number of experiments using new tools and procedures, hypothesised to improve service companies’ innovation processes, are being carried out. The aim of this is to test and develop such innovation tools and procedures that service companies will be able to apply in the future (ICE, 2008). The companies in question are varied—they provide different kinds of services; they are large and small, and they work with local and international markets. Thus the paper discusses and exemplifies the application of the experiment method at a general service company level.
The paper is structured as follows: first, the nature of innovation and innovation research is briefly discussed. This is followed by an outline and discussion of the experiment method as it has been applied in social science which leads to an alternative analytically based delimitation of the method. This is followed by a discussion of how experiments may be applied to study innovation processes and by the presentation of the experiment cases. The paper finalises with a discussion of the findings and their implications for innovation research.
Section snippets
The nature of innovation and innovation research
Innovation is here understood as new products or services, production processes, marketing procedures or organisational set-ups (e.g. Trott, 2005). Innovation processes include the search for, discovery of, experimentation with, development of, imitation, and adaptation of such new products, services, production processes, etc. (Dosi, 1988). Characteristic of early theoretical approaches to innovation such as Schumpeter's (1969 [1934]) entrepreneur theory and the technology-push and demand pull
Experiments and social science research
Experiments in social sciences are (with clear reference to experiments as carried out in natural science) typically confined to actions undertaken to test hypotheses in a laboratory setting detached from the rest of society (Gross and Krohn, 2005, Neuman, 2000). Effects upon a dependent variable caused by an investigator-controlled change of an independent variable within a controlled context are investigated by assigning individuals randomly to two or more groups which are treated
Experiments and innovation research
The restricted amount of literature concerning innovation experiments indicates that experiment methods may represent a missed opportunity in innovation research. Inspiration can mainly be found in related subjects such as ‘experimental economics’ (Kagel and Roth, 1995) and ‘experimental business research’ (Zwick and Rapoport, 2002). These areas applying quantitative laboratory experiments have developed around topics from which simple cause–effect relations can be extracted and simulated in
Exemplary innovation experiments
In the following four experiments are presented which illustrate how and with what results different types of experiments can be applied in innovation research. The experiments reported concern different aspects of open innovation including the interaction with users, with actors in the value chain as well as interactions within a more complex innovation milieu. Thus, the experiments illustrate how different and more or less complex aspects of open innovation may be analysed in experiments
Discussion: practical and methodological benefits of innovation experiments
The four innovation experiments described represent different cases regarding control versus lack of control and quantitative versus qualitative measures and, thus, they represent the four corners of Fig. 1 (however all but the city innovation experiment applied different quantitative and qualitative data collection techniques simultaneously). The cases illustrate how different experimental set-ups provide both similar and varying types of benefits, and how these set-ups provide an alternative
Conclusion
Open innovation involves new actors and new processes and thus begs new models and methods of innovation. The cases presented in this paper show how innovation experiments can cast light on these processes, on different actors’ roles and, not least, on how different actions can sustain open innovation, while creating practically applicable knowledge about how to utilise open innovation. Open innovation on the one hand provides a whole new array of experimental possibilities. On the other hand,
References (54)
- et al.
Knowledge bases and regional innovation systems: comparing Nordic clusters
Research Policy
(2005) - et al.
Innovation systems: analytical and methodological issues
Research Policy
(2002) The origins and dynamics of production networks in Silicon Valley
Research Policy
(1991)An exploratory investigation of user involvement in new service development
Journal of the Academy of Marketing Science
(2002)Industrial districts
- et al.
A Taxonomy of Action Research Methods, Working Paper
(1996) Innovations in organizations: appropriateness of perspectives from small group studies for strategy formulation
Human Relations
(1981)Stories and experiments as social inquiry
Organization Studies
(1997)Global network and local milieu: towards a theory of economic space
- et al.
Make your service fail-safe
Sloan Management Review
(1994)
Open Innovation: The New Imperative for Creating and Profiting from Technology
Winning at New Products
Product Development for the Service Sector
The nature of the innovative process
Improving causal inference: strengths and limitations of natural experiments
Political Research Quarterly
Innovation in Europe
The innovation process and network activities of manufacturing firms
Dynamics of experience service innovation: Innovation as a guided activity. Results from a Danish survey
Service Industries Journal
The relative importance of perceived ease of use in IS adoption: a study of E-commerce adoption
Journal of the Association for Information Systems 1
The underprovision of experiments in political science
The Annals of the American Academy of Political and Social Science
Society as experiment: sociological foundations for a self-experimental society
History of Human Sciences
Qualitative Methods in Management Research
Industrial Technological Development. A Network Approach
Industrial organisation: a survey of laboratory research
The Handbook of Experimental Economics
Webpage background and viewer attitudes
Journal of Advertising Research
Cited by (76)
Editorial: Experimentation for knowledge creation in hospitality & tourism
2023, Journal of Hospitality and Tourism ManagementWhat drives innovative behavior?- An experimental analysis on risk attitudes, creativity and performance
2022, Journal of Behavioral and Experimental EconomicsCitation Excerpt :In other words, a failure perceived as a personal inadequacy can weaken the subject’s self-esteem (Rosi et al., 2019), thereby reducing the psychological “motivating” effect in improving their performance (Baumeister, Campbell, Krueger, & Vohs, 2003) observed in the Lottery treatment. With this study, we answered Sørensen et al. (2010)’s request to adopt experiments in innovation research. It is important to highlight that our proposed approach aims to complement other research methods, such as qualitative case studies or surveys.
Digitally situated knowledge: Connectivism, anthropology and epistemological pluralism
2022, International Journal of Educational ResearchOpen innovation and organizational features: An experimental investigation
2021, European Management Journal