30 research outputs found
Human-centred artificial intelligence for mobile health sensing:challenges and opportunities
Advances in wearable sensing and mobile computing have enabled the collection of health and well-being data outside of traditional laboratory and hospital settings, paving the way for a new era of mobile health. Meanwhile, artificial intelligence (AI) has made significant strides in various domains, demonstrating its potential to revolutionize healthcare. Devices can now diagnose diseases, predict heart irregularities and unlock the full potential of human cognition. However, the application of machine learning (ML) to mobile health sensing poses unique challenges due to noisy sensor measurements, high-dimensional data, sparse and irregular time series, heterogeneity in data, privacy concerns and resource constraints. Despite the recognition of the value of mobile sensing, leveraging these datasets has lagged behind other areas of ML. Furthermore, obtaining quality annotations and ground truth for such data is often expensive or impractical. While recent large-scale longitudinal studies have shown promise in leveraging wearable sensor data for health monitoring and prediction, they also introduce new challenges for data modelling. This paper explores the challenges and opportunities of human-centred AI for mobile health, focusing on key sensing modalities such as audio, location and activity tracking. We discuss the limitations of current approaches and propose potential solutions
FairComp: Workshop on Fairness and Robustness in Machine Learning for Ubiquitous Computing
How can we ensure that Ubiquitous Computing (UbiComp) research outcomes are
both ethical and fair? While fairness in machine learning (ML) has gained
traction in recent years, fairness in UbiComp remains unexplored. This workshop
aims to discuss fairness in UbiComp research and its social, technical, and
legal implications. From a social perspective, we will examine the relationship
between fairness and UbiComp research and identify pathways to ensure that
ubiquitous technologies do not cause harm or infringe on individual rights.
From a technical perspective, we will initiate a discussion on data practices
to develop bias mitigation approaches tailored to UbiComp research. From a
legal perspective, we will examine how new policies shape our community's work
and future research. We aim to foster a vibrant community centered around the
topic of responsible UbiComp, while also charting a clear path for future
research endeavours in this field
Beyond Accuracy: A Critical Review of Fairness in Machine Learning for Mobile and Wearable Computing
The field of mobile, wearable, and ubiquitous computing (UbiComp) is
undergoing a revolutionary integration of machine learning. Devices can now
diagnose diseases, predict heart irregularities, and unlock the full potential
of human cognition. However, the underlying algorithms are not immune to biases
with respect to sensitive attributes (e.g., gender, race), leading to
discriminatory outcomes. The research communities of HCI and AI-Ethics have
recently started to explore ways of reporting information about datasets to
surface and, eventually, counter those biases. The goal of this work is to
explore the extent to which the UbiComp community has adopted such ways of
reporting and highlight potential shortcomings. Through a systematic review of
papers published in the Proceedings of the ACM Interactive, Mobile, Wearable
and Ubiquitous Technologies (IMWUT) journal over the past 5 years (2018-2022),
we found that progress on algorithmic fairness within the UbiComp community
lags behind. Our findings show that only a small portion (5%) of published
papers adheres to modern fairness reporting, while the overwhelming majority
thereof focuses on accuracy or error metrics. In light of these findings, our
work provides practical guidelines for the design and development of ubiquitous
technologies that not only strive for accuracy but also for fairness
The State of Algorithmic Fairness in Mobile Human-Computer Interaction
This paper explores the intersection of Artificial Intelligence and Machine
Learning (AI/ML) fairness and mobile human-computer interaction (MobileHCI).
Through a comprehensive analysis of MobileHCI proceedings published between
2017 and 2022, we first aim to understand the current state of algorithmic
fairness in the community. By manually analyzing 90 papers, we found that only
a small portion (5%) thereof adheres to modern fairness reporting, such as
analyses conditioned on demographic breakdowns. At the same time, the
overwhelming majority draws its findings from highly-educated, employed, and
Western populations. We situate these findings within recent efforts to capture
the current state of algorithmic fairness in mobile and wearable computing, and
envision that our results will serve as an open invitation to the design and
development of fairer ubiquitous technologies.Comment: arXiv admin note: text overlap with arXiv:2303.1558
Sounds of COVID-19: exploring realistic performance of audio-based digital testing.
To identify Coronavirus disease (COVID-19) cases efficiently, affordably, and at scale, recent work has shown how audio (including cough, breathing and voice) based approaches can be used for testing. However, there is a lack of exploration of how biases and methodological decisions impact these tools' performance in practice. In this paper, we explore the realistic performance of audio-based digital testing of COVID-19. To investigate this, we collected a large crowdsourced respiratory audio dataset through a mobile app, alongside symptoms and COVID-19 test results. Within the collected dataset, we selected 5240 samples from 2478 English-speaking participants and split them into participant-independent sets for model development and validation. In addition to controlling the language, we also balanced demographics for model training to avoid potential acoustic bias. We used these audio samples to construct an audio-based COVID-19 prediction model. The unbiased model took features extracted from breathing, coughs and voice signals as predictors and yielded an AUC-ROC of 0.71 (95% CI: 0.65-0.77). We further explored several scenarios with different types of unbalanced data distributions to demonstrate how biases and participant splits affect the performance. With these different, but less appropriate, evaluation strategies, the performance could be overestimated, reaching an AUC up to 0.90 (95% CI: 0.85-0.95) in some circumstances. We found that an unrealistic experimental setting can result in misleading, sometimes over-optimistic, performance. Instead, we reported complete and reliable results on crowd-sourced data, which would allow medical professionals and policy makers to accurately assess the value of this technology and facilitate its deployment
Recommended from our members
Human-centred artificial intelligence for mobile health sensing: challenges and opportunities
Peer reviewed: TruePublication status: PublishedAdvances in wearable sensing and mobile computing have enabled the collection of health and well-being data outside of traditional laboratory and hospital settings, paving the way for a new era of mobile health. Meanwhile, artificial intelligence (AI) has made significant strides in various domains, demonstrating its potential to revolutionize healthcare. Devices can now diagnose diseases, predict heart irregularities and unlock the full potential of human cognition. However, the application of machine learning (ML) to mobile health sensing poses unique challenges due to noisy sensor measurements, high-dimensional data, sparse and irregular time series, heterogeneity in data, privacy concerns and resource constraints. Despite the recognition of the value of mobile sensing, leveraging these datasets has lagged behind other areas of ML. Furthermore, obtaining quality annotations and ground truth for such data is often expensive or impractical. While recent large-scale longitudinal studies have shown promise in leveraging wearable sensor data for health monitoring and prediction, they also introduce new challenges for data modelling. This paper explores the challenges and opportunities of human-centred AI for mobile health, focusing on key sensing modalities such as audio, location and activity tracking. We discuss the limitations of current approaches and propose potential solutions