Engineering AI Systems: A Research Agenda

Artificial intelligence (AI) and machine learning (ML) are increasingly broadly adopted in industry, However, based on well over a dozen case studies, we have learned that deploying industry-strength, production quality ML models in systems proves to be challenging. Companies experience challenges related to data quality, design methods and processes, performance of models as well as deployment and compliance. We learned that a new, structured engineering approach is required to construct and evolve systems that contain ML/DL components. In this paper, we provide a conceptualization of the typical evolution patterns that companies experience when employing ML as well as an overview of the key problems experienced by the companies that we have studied. The main contribution of the paper is a research agenda for AI engineering that provides an overview of the key engineering challenges surrounding ML solutions and an overview of open items that need to be addressed by the research community at large.Comment: 8 pages, 4 figure

Case Study Method and Research Design: Flexibility or Availability for the Novice Researcher?

Case study is prominent in qualitative research literature, yet the methodologists do not have a full consensus on whether it is an approach, a method, a methodology or a design. Perhaps this flexibility contributes to ambiguity for the burgeoning researcher. The works of prominent methodologists, namely Robert Yin, Sharan Merriam, Robert Stake are explored as I attempt define case study and then explain how I have utilised ‘An Interactive Model of Research Design’ (Maxwell, 2009) as a ‘road map’ for engaging case study to investigate current practices in inclusivity and wellbeing. My contribution is to be a provocateur and explore the question: how do you surface deep knowledge in your interview participants? This chapter is designed to contribute knowledge to the field of research, specifically methodological information for the novice researcher considering using case study as a research method. Dually this chapter seeks to bring into focus examples of case study method applied to explore inclusion and wellbeing