Understanding user requirements in context: A case study of developing a visualisation tool to map skills in an engineering organisation

We provide a case study of understanding the environment and work context of a visualisation tool used in a collaborative engineering organisation, in order to inform the design, development and evaluation of a software network tool that uses a novel algorithm to search knowledge topics in a document corpus. We utilise focus group and qualitative interview data to understand the dynamics of existing knowledge searches and the visual analytics process of collaborative working environments in an engineering domain. We discuss the enablers and functionality needed in the network tool, and the envisaged challenges in its implementation. These challenges and enablers of a knowledge management visualisation software are then discussed in relation to evaluating the tool in a way that is grounded in the contextual working environment in which it will be used

Are you in or not? A study into student intention to use immersive metaverse for learning

Learning and teaching have been transformed by technologies in the last few decades. The rise of immersive technologies, such as the metaverse, has started gaining educators’. This phenomenon brings the need for a thorough understanding of how the metaverse could be adopted effectively for learning purposes. This study applied the Technology Acceptance Model (TAM) and Diffusion of Innovation (DoI) to investigate the variables affecting student intention of using immersive metaverse for learning purposes. An online survey was conducted to collect student responses from a US university. A sample of 81 responses was analysed using Structural Equation Modelling (SEM). The results indicate that compatibility and perceived risk influence perceived ease of use and usefulness. Perceived usefulness influences attitudes which consequently influence the intention to use. However, personal innovativeness was not found to influence perceived ease of use and usefulness. The perceived ease of use was not found to impact attitudes

Automatic design structure matrices: A comparison of two formula student projects

Design Structure Matrices have become a fundamental tool to support engineers in their handling and management of interactions across product & organisational architectures. Recent work in the field has exploited the opportunity afforded by Product Lifecycle Management systems, which capture the digital footprint of engineering projects to generate Design Structure Matrices in real-time through the co-occurrence of edits to product models. Given the systematic and more objective nature of the generation of these DSMs as well as being able to monitor their evolution throughout engineering projects, there now lies an opportunity in comparing projects/products using DSMs. To investigate this and the potential insights that could be generated, this paper presents the automatic generation of DSMs for two Formula Student projects. These have then been compared with respect to the end-of-project, change propagation characteristics and evolution of the DSMs. From this analysis, six insights have been generated that map the characteristics of the DSMs to the performance of the project/product and highlights the potential of automatic DSMs to further support engineering project management

Identifying the influences on performance of engineering design and development projects

Performance of engineering design and development projects depends on myriad factors, creating challenges in implementation and management. These are compounded by potential for high variation across contexts. This work investigates influencers upon performance and contextual variation through relationship between real industry issues and factors that influence project performance. Through survey, interview, and network analysis, issue-causing groups of features in each specific case are identified and compared. The results find a majority of issues arising from person-centric sources. They also identify both discrete groups of issues with narrow source and influence, and with broad ties across the project context; forms which may stem from conditions of the scenario. Finally, they show similarity in the influences on performance across contexts with a caveat that, while the influential area remains, the structure to be taken within may vary. General analysis clarifies performance in engineering and highlights those areas in which support-system development is of most use, and specific analysis gives areas in which industry managers should focus for best benefit to the project

Are you in or not? A study into student intention to use immersive metaverse for learning

Learning and teaching have been transformed by technologies in the last few decades. The rise of immersive technologies, such as the metaverse, has started gaining educators’. This phenomenon brings the need for a thorough understanding of how the metaverse could be adopted effectively for learning purposes. This study applied the Technology Acceptance Model (TAM) and Diffusion of Innovation (DoI) to investigate the variables affecting student intention of using immersive metaverse for learning purposes. An online survey was conducted to collect student responses from a US university. A sample of 81 responses was analysed using Structural Equation Modelling (SEM). The results indicate that compatibility and perceived risk influence perceived ease of use and usefulness. Perceived usefulness influences attitudes which consequently influence the intention to use. However, personal innovativeness was not found to influence perceived ease of use and usefulness. The perceived ease of use was not found to impact attitudes

Defining Functional Illiteracy to Empower Inclusive Technology Design

Limited literacy presents a significant challenge in HCI research, yet the field lacks consistent definitions and measurement criteria. Researchers often interchange terms such as 'functional illiterates,' 'low literates,' and 'semi-literates,' further complicating the field. This paper conducts a systematic literature review (SLR) of 33 HCI studies, revealing concerns about the absence of a definition in 41% of the studies and the lack of measurement technique in 74%. Based on the results from our SLR and relevant research beyond HCI, we propose the following work-in-progress definition. 'Functional illiterates are motivated adults with some familiarity with text but insufficient to fully comprehend meanings and low skills in the measured digital skill, with enough language proficiency in the study language if they are literate in their native language. This understanding, coupled with addressing the identified issues, will empower the HCI4D community to design more inclusive technology solutions for functionally illiterate users in developing countries

Embedding transparency in artificial intelligence machine learning models: managerial implications on predicting and explaining employee turnover

Employee turnover (ET) is a major issue faced by firms in all business sectors. Artificial intelligence (AI) machine learning (ML) prediction models can help to classify the likelihood of employees voluntarily departing from employment using historical employee datasets. However, output responses generated by these AI-based ML models lack transparency and interpretability, making it difficult for HR managers to understand the rationale behind the AI predictions. If managers do not understand how and why responses are generated by AI models based on the input datasets, it is unlikely to augment data-driven decision-making and bring value to the organisations. The main purpose of this article is to demonstrate the capability of Local Interpretable Model-Agnostic Explanations (LIME) technique to intuitively explain the ET predictions generated by AI-based ML models for a given employee dataset to HR managers. From a theoretical perspective, we contribute to the International Human Resource Management literature by presenting a conceptual review of AI algorithmic transparency and then discussing its significance to sustain competitive advantage by using the principles of resource-based view theory. We also offer a transparent AI implementation framework using LIME which will provide a useful guide for HR managers to increase the explainability of the AI-based ML models, and therefore mitigate trust issues in data-driven decision-making

Event chains triggering or hindering the emergence of shared leadership in project teams

Project leadership literature has traditionally focused on project manager driven leadership practices. Recently the emphasis has shifted towards understanding project team dynamics and the collective leadership practices that contribute to project success, indicating a transition from leader behaviors to a broader team-centric perspective. Our qualitative research contributes to project leadership literature by exploring the event chains which lead to emergence of shared leadership (SL). Activity Theory (AT) was chosen as an analytical lens to explore the event chains identified from interview data (n=30). According to AT, contradictions are triggering development or change, not referring to problems or conflicts but rather chains of actions which disturb the prevailing practices enabling the evolvement of new ones. Our study refers to these chains of actions simply events, and we found more than 400 examples from the interview data. The events occasionally break down the existing procedures but embed a possibility for cyclic development, such as changes in project team’s leadership practices. The aim of our research was to identify what kind of event chains trigger or hinder the emergence of SL. This study is the first qualitative analysis of data collected in research project in 2022 from 30 interviews among project teams at industry and public sector in Finland to explore the emergence of SL. This paper comprehended teams as an entity. We found multifaceted and overlapping event chains triggering the emergence of SL, namely competences and experience, engagement in shared goals and event chains featuring the specific characteristics of project work. Multiple project environments and vertical leadership culture were found to hinder the emergence of SL. Our research contributes to the research of SL, as the multifaceted event chains create alternative approach for understanding the emergence of SL. Our practical contribution highlights the importance of including team members from diverse backgrounds in regard to experience and competences. We also emphasize the actions for engaging team members in shared project goals to facilitate the emergence of SL

How can frontline expertise and new models of care best contribute to safely reducing avoidable acute admissions? A mixed-methods study of four acute hospitals

BackgroundHospital emergency admissions have risen annually, exacerbating pressures on emergency departments (EDs) and acute medical units. These pressures have an adverse impact on patient experience and potentially lead to suboptimal clinical decision-making. In response, a variety of innovations have been developed, but whether or not these reduce inappropriate admissions or improve patient and clinician experience is largely unknown.AimsTo investigate the interplay of service factors influencing decision-making about emergency admissions, and to understand how the medical assessment process is experienced by patients, carers and practitioners.MethodsThe project used a multiple case study design for a mixed-methods analysis of decision-making about admissions in four acute hospitals. The primary research comprised two parts: value stream mapping to measure time spent by practitioners on key activities in 108 patient pathways, including an embedded study of cost; and an ethnographic study incorporating data from 65 patients, 30 carers and 282 practitioners of different specialties and levels. Additional data were collected through a clinical panel, learning sets, stakeholder workshops, reading groups and review of site data and documentation. We used a realist synthesis approach to integrate findings from all sources.FindingsPatients’ experiences of emergency care were positive and they often did not raise concerns, whereas carers were more vocal. Staff’s focus on patient flow sometimes limited time for basic care, optimal communication and shared decision-making. Practitioners admitted or discharged few patients during the first hour, but decision-making increased rapidly towards the 4-hour target. Overall, patients’ journey times were similar, although waiting before being seen, for tests or after admission decisions, varied considerably. The meaning of what constituted an ‘admission’ varied across sites and sometimes within a site. Medical and social complexity, targets and ‘bed pressure’, patient safety and risk, each influenced admission/discharge decision-making. Each site responded to these pressures with different initiatives designed to expedite appropriate decision-making. New ways of using hospital ‘space’ were identified. Clinical decision units and observation wards allow potentially dischargeable patients with medical and/or social complexity to be ‘off the clock’, allowing time for tests, observation or safe discharge. New teams supported admission avoidance: an acute general practitioner service filtered patients prior to arrival; discharge teams linked with community services; specialist teams for the elderly facilitated outpatient treatment. Senior doctors had a range of roles: evaluating complex patients, advising and training juniors, and overseeing ED activity.ConclusionsThis research shows how hospitals under pressure manage complexity, safety and risk in emergency care by developing ‘ground-up’ initiatives that facilitate timely, appropriate and safe decision-making, and alternative care pathways for lower-risk, ambulatory patients. New teams and ‘off the clock’ spaces contribute to safely reducing avoidable admissions; frontline expertise brings value not only by placing senior experienced practitioners at the front door of EDs, but also by using seniors in advisory roles. Although the principal limitation of this research is its observational design, so that causation cannot be inferred, its strength is hypothesis generation. Further research should test whether or not the service and care innovations identified here can improve patient experience of acute care and safely reduce avoidable admissions.FundingThe National Institute for Health Research (NIHR) Health Services and Delivery Research programme (project number 10/1010/06). This research was supported by the NIHR Collaboration for Leadership in Applied Health Research and Care South West Peninsula