Studying technology use as social practice: the untapped potential of ethnography

Information and communications technologies (ICTs) in healthcare are often introduced with expectations of higher-quality, more efficient, and safer care. Many fail to meet these expectations. We argue here that the well-documented failures of ICTs in healthcare are partly attributable to the philosophical foundations of much health informatics research. Positivistic assumptions underpinning the design, implementation and evaluation of ICTs (in particular the notion that technology X has an impact which can be measured and reproduced in new settings), and the deterministic experimental and quasi-experimental study designs which follow from these assumptions, have inherent limitations when ICTs are part of complex social practices involving multiple human actors. We suggest that while experimental and quasi-experimental studies have an important place in health informatics research overall, ethnography is the preferred methodological approach for studying ICTs introduced into complex social systems. But for ethnographic approaches to be accepted and used to their full potential, many in the health informatics community will need to revisit their philosophical assumptions about what counts as research rigor

Integration of a nationally procured electronic health record system into user work practices

BACKGROUND: Evidence suggests that many small- and medium-scale Electronic Health Record (EHR) implementations encounter problems, these often stemming from users' difficulties in accommodating the new technology into their work practices. There is the possibility that these challenges may be exacerbated in the context of the larger-scale, more standardised, implementation strategies now being pursued as part of major national modernisation initiatives. We sought to understand how England's centrally procured and delivered EHR software was integrated within the work practices of users in selected secondary and specialist care settings. METHODS: We conducted a qualitative longitudinal case study-based investigation drawing on sociotechnical theory in three purposefully selected sites implementing early functionality of a nationally procured EHR system. The complete dataset comprised semi-structured interview data from a total of 66 different participants, 38.5 hours of non-participant observation of use of the software in context, accompanying researcher field notes, and hospital documents (including project initiation and lessons learnt reports). Transcribed data were analysed thematically using a combination of deductive and inductive approaches, and drawing on NVivo8 software to facilitate coding. RESULTS: The nationally led "top-down" implementation and the associated focus on interoperability limited the opportunity to customise software to local needs. Lack of system usability led users to employ a range of workarounds unanticipated by management to compensate for the perceived shortcomings of the system. These had a number of knock-on effects relating to the nature of collaborative work, patterns of communication, the timeliness and availability of records (including paper) and the ability for hospital management to monitor organisational performance. CONCLUSIONS: This work has highlighted the importance of addressing potentially adverse unintended consequences of workarounds associated with the introduction of EHRs. This can be achieved with customisation, which is inevitably somewhat restricted in the context of attempts to implement national solutions. The tensions and potential trade-offs between achieving large-scale interoperability and local requirements is likely to be the subject of continuous debate in England and beyond with no easy answers in sight

Data quality up to the third observing run of Advanced LIGO: Gravity Spy glitch classifications

Understanding the noise in gravitational-wave detectors is central to detecting and interpreting gravitational-wave signals. Glitches are transient, non-Gaussian noise features that can have a range of environmental and instrumental origins. The Gravity Spy project uses a machine-learning algorithm to classify glitches based upon their time–frequency morphology. The resulting set of classified glitches can be used as input to detector-characterisation investigations of how to mitigate glitches, or data-analysis studies of how to ameliorate the impact of glitches. Here we present the results of the Gravity Spy analysis of data up to the end of the third observing run of Advanced LIGO. We classify 233981 glitches from LIGO Hanford and 379805 glitches from LIGO Livingston into morphological classes. We find that the distribution of glitches differs between the two LIGO sites. This highlights the potential need for studies of data quality to be individually tailored to each gravitational-wave observatory

Volunteer satisfaction in sports clubs: A multilevel analysis in 10 European countries

Regular voluntary engagement is a basic resource for sports clubs that may also promote social cohesion and active citizenship. The satisfaction of volunteers is an imperative factor in this engagement, and the purpose of this article is to explore individual and organizational determinants of volunteer satisfaction in sports clubs. Theoretically, our study builds on the actor-theory concepts where volunteer satisfaction depends on subjective evaluations of expectations and experiences in a sports club (‘logic of situation’), so that positive evaluations lead to higher satisfaction and, hopefully, retention of volunteers. This research uses a sample of 8131 volunteers from 642 sports clubs in 10 European countries, and is the first analysis to combine determinants at the level of the club and the volunteer (multilevel). Results show that the most important determinants of satisfaction are the conditions of volunteering (recognition, support, leadership and material incentives) and the workload of volunteers. Surprisingly, club characteristics, size or having paid staff are not significant determinants of volunteer satisfaction. The results of this analysis can assist more effective volunteer management in sports clubs that are facing challenges of individualization and professionalization

Classifying the unknown: Discovering novel gravitational-wave detector glitches using similarity learning

The observation of gravitational waves from compact binary coalescences by LIGO and Virgo has begun a new era in astronomy. A critical challenge in making detections is determining whether loud transient features in the data are caused by gravitational waves or by instrumental or environmental sources. The citizen-science project Gravity Spy has been demonstrated as an efficient infrastructure for classifying known types of noise transients (glitches) through a combination of data analysis performed by both citizen volunteers and machine learning. We present the next iteration of this project, using similarity indices to empower citizen scientists to create large data sets of unknown transients, which can then be used to facilitate supervised machine-learning characterization. This new evolution aims to alleviate a persistent challenge that plagues both citizen-science and instrumental detector work: the ability to build large samples of relatively rare events. Using two families of transient noise that appeared unexpectedly during LIGO’s second observing run, we demonstrate the impact that the similarity indices could have had on finding these new glitch types in the Gravity Spy program

Documenting Work: From Participant Observation to Participant Tracing

This paper explores the methodological aspects of studying distributed work by focusing on the more tangible aspects of this work, namely documents. We show how 1) researchers should engage in an initial mapping of documents before starting to track them; 2) the ongoing flow of virtual organizing only becomes apparent by triangulating the digital flow of documents, observation of tangible documents (e.g., paper) and repeated behavioral inquiries; 3), documents supporting distributed organizing do not serve as stable information artifacts, but rather become snapshots in time, part of the general flow of work across numerous documents and applications. We evaluate how best to combine document tracking with interviews and participant observation, and discuss the challenges and benefits associated with digital instrumentation, practicality, privacy, and the production of knowledge