SpecTracle: Wearable Facial Motion Tracking from Unobtrusive Peripheral Cameras

Facial motion tracking in head-mounted displays (HMD) has the potential to enable immersive "face-to-face" interaction in a virtual environment. However, current works on facial tracking are not suitable for unobtrusive augmented reality (AR) glasses or do not have the ability to track arbitrary facial movements. In this work, we demonstrate a novel system called SpecTracle that tracks a user's facial motions using two wide-angle cameras mounted right next to the visor of a Hololens. Avoiding the usage of cameras extended in front of the face, our system greatly improves the feasibility to integrate full-face tracking into a low-profile form factor. We also demonstrate that a neural network-based model processing the wide-angle cameras can run in real-time at 24 frames per second (fps) on a mobile GPU and track independent facial movement for different parts of the face with a user-independent model. Using a short personalized calibration, the system improves its tracking performance by 42.3% compared to the user-independent model

Dynamic evaluation of blood immune cells predictive of response to immune checkpoint inhibitors in NSCLC by multicolor spectrum flow cytometry

IntroductionImmune checkpoint inhibitors (ICIs) only benefit a subset of cancer patients, underlining the need for predictive biomarkers for patient selection. Given the limitations of tumor tissue availability, flow cytometry of peripheral blood mononuclear cells (PBMCs) is considered a noninvasive method for immune monitoring. This study explores the use of spectrum flow cytometry, which allows a more comprehensive analysis of a greater number of markers using fewer immune cells, to identify potential blood immune biomarkers and monitor ICI treatment in non-small-cell lung cancer (NSCLC) patients.MethodsPBMCs were collected from 14 non-small-cell lung cancer (NSCLC) patients before and after ICI treatment and 4 healthy human donors. Using spectrum flow cytometry, 24 immune cell markers were simultaneously monitored using only 1 million PBMCs. The results were also compared with those from clinical flow cytometry and bulk RNA sequencing analysis. ResultsOur findings showed that the measurement of CD4+ and CD8+ T cells by spectrum flow cytometry matched well with those by clinical flow cytometry (Pearson R ranging from 0.75 to 0.95) and bulk RNA sequencing analysis (R=0.80, P=1.3 x 10-4). A lower frequency of CD4+ central memory cells before treatment was associated with a longer median progression-free survival (PFS) [Not reached (NR) vs. 5 months; hazard ratio (HR)=8.1, 95% confidence interval (CI) 1.5–42, P=0.01]. A higher frequency of CD4-CD8- double-negative (DN) T cells was associated with a longer PFS (NR vs. 4.45 months; HR=11.1, 95% CI 2.2–55.0, P=0.003). ICIs significantly changed the frequency of cytotoxic CD8+PD1+ T cells, DN T cells, CD16+CD56dim and CD16+CD56- natural killer (NK) cells, and CD14+HLDRhigh and CD11c+HLADR + monocytes. Of these immune cell subtypes, an increase in the frequency of CD16+CD56dim NK cells and CD14+HLADRhigh monocytes after treatment compared to before treatment were associated with a longer PFS (NR vs. 5 months, HR=5.4, 95% CI 1.1-25.7, P=0.03; 7.8 vs. 3.8 months, HR=5.7, 95% CI 169 1.0-31.7, P=0.04), respectively. ConclusionOur preliminary findings suggest that the use of multicolor spectrum flow cytometry helps identify potential blood immune biomarkers for ICI treatment, which warrants further validation

“So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy

Transformative artificially intelligent tools, such as ChatGPT, designed to generate sophisticated text indistinguishable from that produced by a human, are applicable across a wide range of contexts. The technology presents opportunities as well as, often ethical and legal, challenges, and has the potential for both positive and negative impacts for organisations, society, and individuals. Offering multi-disciplinary insight into some of these, this article brings together 43 contributions from experts in fields such as computer science, marketing, information systems, education, policy, hospitality and tourism, management, publishing, and nursing. The contributors acknowledge ChatGPT’s capabilities to enhance productivity and suggest that it is likely to offer significant gains in the banking, hospitality and tourism, and information technology industries, and enhance business activities, such as management and marketing. Nevertheless, they also consider its limitations, disruptions to practices, threats to privacy and security, and consequences of biases, misuse, and misinformation. However, opinion is split on whether ChatGPT’s use should be restricted or legislated. Drawing on these contributions, the article identifies questions requiring further research across three thematic areas: knowledge, transparency, and ethics; digital transformation of organisations and societies; and teaching, learning, and scholarly research. The avenues for further research include: identifying skills, resources, and capabilities needed to handle generative AI; examining biases of generative AI attributable to training datasets and processes; exploring business and societal contexts best suited for generative AI implementation; determining optimal combinations of human and generative AI for various tasks; identifying ways to assess accuracy of text produced by generative AI; and uncovering the ethical and legal issues in using generative AI across different contexts

“So what if ChatGPT wrote it?”:Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy

Transformative artificially intelligent tools, such as ChatGPT, designed to generate sophisticated text indistinguishable from that produced by a human, are applicable across a wide range of contexts. The technology presents opportunities as well as, often ethical and legal, challenges, and has the potential for both positive and negative impacts for organisations, society, and individuals. Offering multi-disciplinary insight into some of these, this article brings together 43 contributions from experts in fields such as computer science, marketing, information systems, education, policy, hospitality and tourism, management, publishing, and nursing. The contributors acknowledge ChatGPT’s capabilities to enhance productivity and suggest that it is likely to offer significant gains in the banking, hospitality and tourism, and information technology industries, and enhance business activities, such as management and marketing. Nevertheless, they also consider its limitations, disruptions to practices, threats to privacy and security, and consequences of biases, misuse, and misinformation. However, opinion is split on whether ChatGPT’s use should be restricted or legislated. Drawing on these contributions, the article identifies questions requiring further research across three thematic areas: knowledge, transparency, and ethics; digital transformation of organisations and societies; and teaching, learning, and scholarly research. The avenues for further research include: identifying skills, resources, and capabilities needed to handle generative AI; examining biases of generative AI attributable to training datasets and processes; exploring business and societal contexts best suited for generative AI implementation; determining optimal combinations of human and generative AI for various tasks; identifying ways to assess accuracy of text produced by generative AI; and uncovering the ethical and legal issues in using generative AI across different contexts

Augmenting Telepostpartum Care With Vision-Based Detection of Breastfeeding-Related Conditions: Algorithm Development and Validation.

Breastfeeding benefits both the mother and infant and is a topic of attention in public health. After childbirth, untreated medical conditions or lack of support lead many mothers to discontinue breastfeeding. For instance, nipple damage and mastitis affect 80% and 20% of US mothers, respectively. Lactation consultants (LCs) help mothers with breastfeeding, providing in-person, remote, and hybrid lactation support. LCs guide, encourage, and find ways for mothers to have a better experience breastfeeding. Current telehealth services help mothers seek LCs for breastfeeding support, where images help them identify and address many issues. Due to the disproportional ratio of LCs and mothers in need, these professionals are often overloaded and burned out.This study aims to investigate the effectiveness of 5 distinct convolutional neural networks in detecting healthy lactating breasts and 6 breastfeeding-related issues by only using red, green, and blue images. Our goal was to assess the applicability of this algorithm as an auxiliary resource for LCs to identify painful breast conditions quickly, better manage their patients through triage, respond promptly to patient needs, and enhance the overall experience and care for breastfeeding mothers.We evaluated the potential for 5 classification models to detect breastfeeding-related conditions using 1078 breast and nipple images gathered from web-based and physical educational resources. We used the convolutional neural networks Resnet50, Visual Geometry Group model with 16 layers (VGG16), InceptionV3, EfficientNetV2, and DenseNet169 to classify the images across 7 classes: healthy, abscess, mastitis, nipple blebs, dermatosis, engorgement, and nipple damage by improper feeding or misuse of breast pumps. We also evaluated the models' ability to distinguish between healthy and unhealthy images. We present an analysis of the classification challenges, identifying image traits that may confound the detection model.The best model achieves an average area under the receiver operating characteristic curve of 0.93 for all conditions after data augmentation for multiclass classification. For binary classification, we achieved, with the best model, an average area under the curve of 0.96 for all conditions after data augmentation. Several factors contributed to the misclassification of images, including similar visual features in the conditions that precede other conditions (such as the mastitis spectrum disorder), partially covered breasts or nipples, and images depicting multiple conditions in the same breast.This vision-based automated detection technique offers an opportunity to enhance postpartum care for mothers and can potentially help alleviate the workload of LCs by expediting decision-making processes

Smartphone camera oximetry in an induced hypoxemia study

Hypoxemia, a medical condition that occurs when the blood is not carrying enough oxygen to adequately supply the tissues, is a leading indicator for dangerous complications of respiratory diseases like asthma, COPD, and COVID-19. While purpose-built pulse oximeters can provide accurate blood-oxygen saturation (SpO2) readings that allow for diagnosis of hypoxemia, enabling this capability in unmodified smartphone cameras via a software update could give more people access to important information about their health. Towards this goal, we performed the first clinical development validation on a smartphone camera-based SpO2 sensing system using a varied fraction of inspired oxygen (FiO2) protocol, creating a clinically relevant validation dataset for solely smartphone-based contact PPG methods on a wider range of SpO2 values (70-100%) than prior studies (85-100%). We built a deep learning model using this data to demonstrate an overall MAE = 5.00% SpO2 while identifying positive cases of low SpO2 < 90% with 81% sensitivity and 79% specificity. We also provide the data in open-source format, so that others may build on this work

Dynamic evaluation of blood immune cells predictive of response to immune checkpoint inhibitors in NSCLC by multicolor spectrum flow cytometry.

INTRODUCTION: Immune checkpoint inhibitors (ICIs) only benefit a subset of cancer patients, underlining the need for predictive biomarkers for patient selection. Given the limitations of tumor tissue availability, flow cytometry of peripheral blood mononuclear cells (PBMCs) is considered a noninvasive method for immune monitoring. This study explores the use of spectrum flow cytometry, which allows a more comprehensive analysis of a greater number of markers using fewer immune cells, to identify potential blood immune biomarkers and monitor ICI treatment in non-small-cell lung cancer (NSCLC) patients. METHODS: PBMCs were collected from 14 non-small-cell lung cancer (NSCLC) patients before and after ICI treatment and 4 healthy human donors. Using spectrum flow cytometry, 24 immune cell markers were simultaneously monitored using only 1 million PBMCs. The results were also compared with those from clinical flow cytometry and bulk RNA sequencing analysis. RESULTS: Our findings showed that the measurement of CD4+ and CD8+ T cells by spectrum flow cytometry matched well with those by clinical flow cytometry (Pearson R ranging from 0.75 to 0.95) and bulk RNA sequencing analysis (R=0.80, P=1.3 x 10-4). A lower frequency of CD4+ central memory cells before treatment was associated with a longer median progression-free survival (PFS) [Not reached (NR) vs. 5 months; hazard ratio (HR)=8.1, 95% confidence interval (CI) 1.5-42, P=0.01]. A higher frequency of CD4-CD8- double-negative (DN) T cells was associated with a longer PFS (NR vs. 4.45 months; HR=11.1, 95% CI 2.2-55.0, P=0.003). ICIs significantly changed the frequency of cytotoxic CD8+PD1+ T cells, DN T cells, CD16+CD56dim and CD16+CD56- natural killer (NK) cells, and CD14+HLDRhigh and CD11c+HLADR + monocytes. Of these immune cell subtypes, an increase in the frequency of CD16+CD56dim NK cells and CD14+HLADRhigh monocytes after treatment compared to before treatment were associated with a longer PFS (NR vs. 5 months, HR=5.4, 95% CI 1.1-25.7, P=0.03; 7.8 vs. 3.8 months, HR=5.7, 95% CI 169 1.0-31.7, P=0.04), respectively. CONCLUSION: Our preliminary findings suggest that the use of multicolor spectrum flow cytometry helps identify potential blood immune biomarkers for ICI treatment, which warrants further validation

Variability of temperature measurements recorded by a wearable device by biological sex.

BACKGROUND: Females have been historically excluded from biomedical research due in part to the documented presumption that results with male subjects will generalize effectively to females. This has been justified in part by the assumption that ovarian rhythms will increase the overall variance of pooled random samples. But not all variance in samples is random. Human biometrics are continuously changing in response to stimuli and biological rhythms; single measurements taken sporadically do not easily support exploration of variance across time scales. Recently we reported that in mice, core body temperature measured longitudinally shows higher variance in males than cycling females, both within and across individuals at multiple time scales. METHODS: Here, we explore longitudinal human distal body temperature, measured by a wearable sensor device (Oura Ring), for 6 months in females and males ranging in age from 20 to 79 years. In this study, we did not limit the comparisons to female versus male, but instead we developed a method for categorizing individuals as cyclic or acyclic depending on the presence of a roughly monthly pattern to their nightly temperature. We then compared structure and variance across time scales using multiple standard instruments. RESULTS: Sex differences exist as expected, but across multiple statistical comparisons and timescales, there was no one group that consistently exceeded the others in variance. When variability was assessed across time, females, whether or not their temperature contained monthly cycles, did not significantly differ from males both on daily and monthly time scales. CONCLUSIONS: These findings contradict the viewpoint that human females are too variable across menstrual cycles to include in biomedical research. Longitudinal temperature of females does not accumulate greater measurement error over time than do males and the majority of unexplained variance is within sex category, not between them