Skip to main content
Article thumbnail
Location of Repository

Predictive performance of front-loaded experimentation strategies in pharmaceutical discovery: a Bayesian perspective

By Walter van Dyck


Experimentation is a significant innovation process activity and its design is fundamental to the learning and knowledge build-up process. Front-loaded experimentation is known as a strategy seeking to improve innovation process performance; by exploiting early information to spot and solve problems as upstream as possible, costly overruns in subsequent product development are avoided. Although the value of search through front-loaded experimentation in complex and novel environments is recognized, the phenomenon has not been studied in the highly relevant pharmaceutical R&D context, where typically lots of drug candidates get killed very late in the innovation process when potential problems are insufficiently anticipated upfront. In pharmaceutical research the initial problem is to discover a “drug-like” complex biological or chemical system that has the potential to affect a biological target on a disease pathway. My case study evidence found that the discovery process is managed through a front-loaded experimentation strategy. The research team gradually builds a mental model of the drug’s action in which the solution of critical design problems can be initiated at various moments in the innovation process. The purpose of this research was to evaluate the predictive performance of frontloaded experimentation strategies in the discovery process. Because predictive performance necessitates conditional probability thinking, a Bayesian methodology is proposed and a rationale is given to develop research propositions using Monte Carlo simulation. An adaptive system paradigm, then, is the basis for designing the simulation model used for top-down theory development. My simulation results indicate that front-loaded strategies in a pharmaceutical discovery context outperform other strategies on positive predictive performance. Frontloaded strategies therefore increase the odds for compounds succeeding subsequent development testing, provided they were found positive in discovery. Also, increasing the number of parallel concept explorations in discovery influences significantly the negative predictive performance of experimentation strategies, reducing the probability of missed opportunities in development. These results are shown to be robust for varying degrees of predictability of the discovery process. The counterintuitive business implication of my research findings is that the key to further reduce spend and overruns in pharmaceutical development is to be found in discovery, where efforts to better understand drug candidates lead to higher success rates later in the innovation process

Publisher: Cranfield School of Management
Year: 2004
OAI identifier:
Provided by: Cranfield CERES

Suggested articles


  1. (2001a) A complex systems approach to learning in adaptive networks.
  2. (2001b) The dynamics of knowledge and ignorance: Learning the new systems science. In: doi
  3. (2001c) Knowledge, ignorance, and learning. doi
  4. (2003). A Bayesian model for prelaunch sales forecasting of recorded music. doi
  5. (1992). A behavioral theory of the firm, Second edn. doi
  6. (2001). A framework for project management under uncertainty. doi
  7. (1972). A garbage can model of organizational choice. doi
  8. (2003). A hierarchy machine: learning to optimize from nature and humans. doi
  9. (1997). A model based framework to overlap product development activities. doi
  10. (1997). A prediction model of sequential iteration in engineering design. doi
  11. (2001). A revolution in R&D. How genomics and genetics are transforming the biopharmaceutical industry. The Boston Consulting Group.
  12. (2004). Academy of Management Review, Revised and resubmitted
  13. (1995). Accelerating adaptive processes: Product innovation in the global computer industry. doi
  14. (1992). Adaptation in natural and artificial systems, doi
  15. (2003). ADME-Tox in drug discovery: Integration of experimental and computational technologies. Drug Discovery Today 8(18), 852-861. 187 APPENDIX A: Exploratory case studies visual mapping and temporal bracketing results Case statistics Case study doi
  16. (2001). ADME/Tox models can speed develoment.
  17. (1992). An empirical evaluation of the internal corporate venturing process. doi
  18. (2002). An evaluation of research on integrated product development. doi
  19. (2001). An extreme-value model of concept testing. doi
  20. (1989). An introduction to chaotic dynamical systems, doi
  21. (2001). An introduction to genetic algorithms, doi
  22. (1997). An organizational assessment of interfirm coordination modes. doi
  23. (1992). An organizational learning approach to product innovation. doi
  24. (1986). and the PDP Research Group doi
  25. (1993). Approaches to social enquiry, doi
  26. (1990). Architectural innovation: The reconfiguration of existing product technologies and the failure of established firms. doi
  27. (2003). Artificial intelligence, doi
  28. (2003). Attrition and translation.
  29. (2001). Bayesian networks and decision graphs, doi
  30. (2001). Bayesian statistical modelling, doi
  31. (1989). Beyond garbage cans: An AI model of organizational choice. doi
  32. (2003). Bioinformatics computing, Upper Saddle River,
  33. (1978). Bounded rationality, ambiguity, and the engineering of choice. doi
  34. (2000). Breaking the development speed barrier: Assessing successful practices of the fastest drug development companies. doi
  35. (2000). Building grounded theories of management action. doi
  36. (1989). Building theories from case study research. doi
  37. (1989). Case study research. Design and methods,
  38. (2000). Causality: Models, reasoning, and inference, Cambridge: doi
  39. (2000). Causation, prediction, and search, Second edn. doi
  40. (1992). Choice over uncertainty and ambiguity in technical problem solving. doi
  41. (1998). Communication and uncertainty in concurrent engineering. doi
  42. (2001). Complex responsive processes in organizations: Learning and knowledge creation, doi
  43. (1997). Complex thinking about organizational complexity: The appeal of a narrative approach to complexity theory. doi
  44. (2002). Complexity and innovation in organizations, doi
  45. (2000). Complexity and management, doi
  46. (1998). Complexity and post-modernism: Understanding complex systems, doi
  47. (1987). Complexity: A definition by construction of a conceptual framework. doi
  48. (2002). Computational tools that identify drug likeness.
  49. (1976). Computer science as empirical enquiry: Symbols and search. doi
  50. (1992). Computer simulation in management science, 3rd edn.
  51. (1992). Core capabilities and core rigidities: A paradox in managing new product development. doi
  52. (1998). Creativity and improvisation in Jazz and organizations: Implications for organizational learning. doi
  53. (2000). Critical success factors for radical technological innovation: A five case study . doi
  54. (1973). Cybernetics of cybernetics (physiology of revolution). doi
  55. (1943). Das Glasperlenspiel, doi
  56. (1999). Decision analysis by augmented probability simulation. doi
  57. (1988). Decision analysis: Practice and promise. doi
  58. (1997). Design and analysis of experiments, doi
  59. (2003). Design for Six Sigma: A roadmap for product development, doi
  60. (1990). Designing the design process. doi
  61. (1994). Determinants of technical success in product development when innovation radicalness is considered. doi
  62. (2003). Differentiating Inherent Risks Between Novel Targets. In:
  63. (1998). Discontinuous innovation and the new product development process. doi
  64. (2004). Drug Administration doi
  65. (2000). Drug Discovery: A historical perspective. doi
  66. (2003). Drug research: Myths, hype and reality. doi
  67. (1992). Dual Technology Trees: Assessing the intensity and strategic significance of technological change. doi
  68. (2000). During Phase A you select a concept, in the second step you optimize your concept”
  69. (1992). Dynamics of innovation idea generation in organizations: Randomness and chaos in the development of a new medical device.
  70. (1998). Emergence: From chaos to order, doi
  71. (2001). Enlightened experimentation: The new imperative for innovation. Harvard Business Review
  72. (2002). Exchanging preliminary information in concurrent engineering: Alternative coordination strategies. doi
  73. (2003). Experience, experimentation, and the accumulation of knowledge: The evolution of R&D in the semiconductor industry. doi
  74. (1997). Experimental designs for selecting molecules from large chemical databases. doi
  75. (2003). Experimentation matters: Unlocking the potential of new technologies for innovation, doi
  76. (1995). Explaining development and change in organizations. doi
  77. (1995). Explaining the attacker's advantage: Technological paradigms, organizational dynamics, and the value network. doi
  78. (1991). Exploration and exploitation in organizational learning. doi
  79. (2002). Focusing the fuzzy front-end in new product development. doi
  80. (2002). Foundations for growth: How to identify and build disruptive new business. Sloan Management Review 43(Spring),
  81. (1989). Genetic Algorithms in search, optimization and machine learning, doi
  82. (2001). Global best practice: Direct compression formulation development flow chart’, internal confidential publication.
  83. (2001). HS Marston report: An evolutionary model of the product design process. Innovative Manufacturing Initiative: The complexities of product definition.
  84. (1967). Human information processing, doi
  85. (1997). Identifying controlling features of engineering design iterations. doi
  86. (1989). Influence diagrams for Bayesian decision analysis. doi
  87. (1995). Information space: A framework for learning in organizations, institutions and culture, doi
  88. (2002). Initial compound selection for sequential screening.
  89. (1998). Innovation deficit revisited: Reflections on the productivity of pharmaceutical R&D. doi
  90. (2000). Innovation process and techno-scientific doi
  91. (1985). Innovation: Mapping the winds of creative destruction. doi
  92. (1997). Integrating the fuzzy front end of new product development. Sloan Management Review (Winter), doi
  93. (1994). Integration and dynamic capability: Evidence from product development in automobiles and mainframe computers. doi
  94. (1995). Interdepartmental interdependence and coordination: The case of the design/manufacturing interface. doi
  95. (2004). Introducing advanced technology in pharmaceutical R&D: The need for a new paradigm? In: Pacl, H., (Ed.) The future of pharmaceutical R&D: Challenges and trends, Frankfurt: Festel Capital,
  96. (1999). Introduction to the special issue: Applications of complexity theory to organization science. doi
  97. (2001). Is there a difference between leads and drugs? A historical perspective. doi
  98. (2004). Knowledge for science and practice.
  99. (1994). Knowledge, integration, and the locus of learning: An empirical analysis of process development. doi
  100. (1996). Learning before doing in the development of new process technology. doi
  101. (1996). Learning the innovation journey: Order out of chaos. doi
  102. (1992). Learning while innovating. doi
  103. (1991). Lessons from the non-linear paradigm: Applications of the theory of dissipative structures in the social sciences.
  104. (1997). Leveraging on systemic learning to manage the early phases of product innovation projects. doi
  105. (2003). Making a difference: Organization as design. doi
  106. (2004). Management research based on the paradigm of the design sciences: The quest for field-tested and grounded technological rules . doi
  107. (2004). Managing complexity in fuzzy front-end innovation: The need for a paradigm shift? Cranfield School of Management Working Paper Series, paper submitted. 186
  108. (1998). Managing experimentation in the design of new products. doi
  109. (1994). Managing innovation in the information age.
  110. (2001). Managing innovation: Integrating technologicl, market and organizational change, Second edn.
  111. (2004). Managing open innovation. doi
  112. (2002). Managing project uncertainty: From variation to chaos. Sloan Management Review 43(Winter), doi
  113. (1997). Managing the drug discovery/development interface. doi
  114. (2003). Managing the sources of uncertainty: Matching process and context in software development. doi
  115. (1998). Market learning and radical innovation: A cross-case comparison of eight radical innovation projects. doi
  116. (2002). Market orientation, learning orientation and product innovation: Delving into the organization's black box.
  117. (1996). Marketing and discontinuous innovation: The Probe and Learn process. doi
  118. (1994). Measuring competence? Exploring firm effects in pharmaceutical research. doi
  119. (2000). Meeting the challenge of disruptive change. Harvard Business Review (March-April).
  120. (2002). Modeling in medical decision making: A Bayesian approach, doi
  121. (2003). Modern biomedical research: An internally self-consistent universe with little contact with medical reality? doi
  122. (1997). Modern strategy for preclinical pharmaceutical R&D: Towards the virtual research company, doi
  123. (1998). Modes of experimentation: An innovation process - and competitive variable. doi
  124. (2001). Molecular complexity and its impact on the probability of finding leads for drug discovery. doi
  125. (2004). Networking for innovation: Exploring a dynamic capabilities perspective. R&D Management Special Issue on Innovation and Intangible Assets, Extended abstract submitted.
  126. (2002). On experimental design in drug discovery. Current Drug Discovery doi
  127. (2002). On uncertainty, ambiguity and complexity in project management. doi
  128. (2003). Open innovation: The new imperative for creating and profiting from technology, doi
  129. (2000). Optimizing the science of drug development: Opportunities for better candidate selection and accelerated evaluation in humans. doi
  130. (1997). Optimum utilization of a compound collection or chemical library for Drug Discovery. doi
  131. (2000). Organizational change and innovation processes,
  132. (1997). Organizational conditions and levels of creativity. doi
  133. (1999). Organizations as adaptive systems in complex environments: The case of China. doi
  134. (1998). Organizing for radical product innovation. doi
  135. (1968). Parallel and sequential R&D strategies: Application of a simple model. doi
  136. (2001). Parallel and sequential testing of design alternatives. doi
  137. (2002). Pharma 2010: The threshold of innovation. IBM Business Consulting Services Futures Series.
  138. (2001). Pharmaceutical Development facts & figures’, internal publication.
  139. (1999). Planned flexibility: Linking anticipation and reaction in product development projects. doi
  140. (2002). Pre-clinical expertise in drug discovery: Changing the paradigm’, internal publication for presentation.
  141. (1986). Probabilistic analysis of decision trees using Monte Carlo simulation. doi
  142. (2001). Problem solving, cognition and complex systems: Differences between experts and novices. doi
  143. (2003). Problem-solving oscillations in complex engineering projects. doi
  144. (2001). Project [Gamma] formulation development rationale’, internal confidential publication.
  145. (1996). Project management and organization structure in drug development. doi
  146. (2000). Project Omega: DNAzymes – How do they work?’, internal confidential publication. 188 (9) PharmaCo Molecular Oncology Group
  147. (2000). Project uncertainty and management styles. INSEAD Working Paper
  148. (2001). Project visioning: It's components and impact on new product success. doi
  149. (1995). Representation and solution of decision problems using sequential decision diagrams. doi
  150. (1992). Revolutionizing product development: Quantum leaps in speed, efficiency, and quality , doi
  151. (1996). Scale, scope and spillovers: The determinants of research productivity in Drug Discovery. doi
  152. (2002). SCF technology in combination with meltextrusion: Timeline of SCF activities’, internal confidential presentation.
  153. (1986). Scientific realism and human emancipation, doi
  154. (1995). Sensemaking in organizations, doi
  155. (1994). Simulating societies: The computer simulation of social phenomena, doi
  156. (1999). Simulation-based optimal design. In: doi
  157. (1998). Simulation, learning and R&D performance: Evidence from automotive development. doi
  158. (1997). Sociotechnical constituencies, game theory, and the diffusion of compact discs: An interdisciplinary investigation into the market for recorded music. doi
  159. (2003). Sources and assessment of complexity in NPD projects. doi
  160. (1990). Stage-gate systems: A new tool for managing new products. doi
  161. (1988). Strategic management of technology and innovation,
  162. (2003). Strategic trends in the drug industry. doi
  163. (1989). Strategies for drug discovery: Structuring serendipity.
  164. (1999). Strategies for theorizing from process data. doi
  165. (1966). Studies of the problem-solving process in engineering design. doi
  166. (2000). Studying radical organizational innovation through grounded theory. doi
  167. (1988). Task complexity: A review and analysis. doi
  168. (1998). Technology integration: Making critical choices in a dynamic world ,
  169. (2000). Technology novelty, project complexity, and product development execution success. doi
  170. (1979). Technology transfer as a function of position in the spectrum from research through development and technical services. doi
  171. (2000). The "Can you trust it?" problem of simulation science in the design of sociotechnical systems.
  172. (2000). The design of innovation: Lessons from genetic algorithms, lessons for the real world.
  173. (1997). The development factory: Unlocking the potential of process innovation, doi
  174. (1967). The discovery of grounded theory: Strategies for qualitative research , doi
  175. (2002). The drug discovery challenge: Better targets, better compounds, better processes’, internal publication for presentation.
  176. (2000). The effect of 'front-loading' problem-solving on product development performance. doi
  177. (1992). The effects of cognitive problem-solving orientation and technological familiarity on faster new product development. doi
  178. (2003). The era of open innovation. doi
  179. (1994). The evolution of integrative capability: Innovation in cardiovascular drug discovery. doi
  180. (2004). The field-tested and grounded technological rule as product of Mode 2 management research. doi
  181. (1997). The impact of technological complexity and interfirm cooperation on business survival. doi
  182. (1997). The innovator's dilemma: When new technologies cause great firms to fail, doi
  183. (2003). The innovator's solution: Creating and sustaining successful growth, doi
  184. (1959). The logic of scientific discovery, doi
  185. (1994). The new production of knowledge: The dynamics of science and research in contemporary societies, doi
  186. (1993). The origins of order: Self-organization and selection in evolution, Oxford: doi
  187. (1995). The quark and the jaguar: Adventures in the simple and the complex, doi
  188. (1995). The science of complexity: An alternative perspective for strategic change processes. doi
  189. (1980). The scientific image, doi
  190. (1998). The structure of high-performing project management organizations. doi
  191. (1996). The structure of scientific revolutions, 3rd edn. doi
  192. (1985). The use of participant recollection in the modeling of organizational processes. doi
  193. (1994). Third-generation new product processes. doi
  194. (2000). Time-cost trade-offs in overlapped product development. doi
  195. (1988). Towards a heuristic theory of problem structuring. doi
  196. (1998). Towards holistic "front-ends" in new product development. doi
  197. (1999). Toyota's principles of set-based concurrent engineering. Sloan Management Review (Winter),
  198. (1990). Transputers and transputer-based parallel computers: Sociotechnical constituencies and the build-up of British-European capabilities in information technologies. doi
  199. (1994). Typologies as a unique form of theory building: Toward improved understanding and modeling . doi
  200. (2000). Understanding human competence at work: An interpretative approach. doi
  201. (1998). Use of novel microemulsions for the formulation of hydrophobic drugs: Proposal for a research grant for funding from the Excellence
  202. (1998). Use of supercritical fluid technology to broaden applicability of melt extrusion: Proposal for a research grant for funding from the Excellence
  203. (2001). Validation of trace-driven simulation models: Bootstrap tests. doi
  204. (1992). Valuation-based systems for Bayesian decision analysis. doi
  205. (2002). Virtual screening in lead discovery: A viewpoint. doi
  206. (1995). Wellsprings of knowledge: Building and sustaining the sources of innovation, doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.