18 research outputs found

    Affect-driven Engagement Measurement from Videos

    Full text link
    In education and intervention programs, person's engagement has been identified as a major factor in successful program completion. Automatic measurement of person's engagement provides useful information for instructors to meet program objectives and individualize program delivery. In this paper, we present a novel approach for video-based engagement measurement in virtual learning programs. We propose to use affect states, continuous values of valence and arousal extracted from consecutive video frames, along with a new latent affective feature vector and behavioral features for engagement measurement. Deep learning-based temporal, and traditional machine-learning-based non-temporal models are trained and validated on frame-level, and video-level features, respectively. In addition to the conventional centralized learning, we also implement the proposed method in a decentralized federated learning setting and study the effect of model personalization in engagement measurement. We evaluated the performance of the proposed method on the only two publicly available video engagement measurement datasets, DAiSEE and EmotiW, containing videos of students in online learning programs. Our experiments show a state-of-the-art engagement level classification accuracy of 63.3% and correctly classifying disengagement videos in the DAiSEE dataset and a regression mean squared error of 0.0673 on the EmotiW dataset. Our ablation study shows the effectiveness of incorporating affect states in engagement measurement. We interpret the findings from the experimental results based on psychology concepts in the field of engagement.Comment: 13 pages, 8 figures, 7 table

    FedSL: Federated Split Learning on Distributed Sequential Data in Recurrent Neural Networks

    Full text link
    Federated Learning (FL) and Split Learning (SL) are privacy-preserving Machine-Learning (ML) techniques that enable training ML models over data distributed among clients without requiring direct access to their raw data. Existing FL and SL approaches work on horizontally or vertically partitioned data and cannot handle sequentially partitioned data where segments of multiple-segment sequential data are distributed across clients. In this paper, we propose a novel federated split learning framework, FedSL, to train models on distributed sequential data. The most common ML models to train on sequential data are Recurrent Neural Networks (RNNs). Since the proposed framework is privacy preserving, segments of multiple-segment sequential data cannot be shared between clients or between clients and server. To circumvent this limitation, we propose a novel SL approach tailored for RNNs. A RNN is split into sub-networks, and each sub-network is trained on one client containing single segments of multiple-segment training sequences. During local training, the sub-networks on different clients communicate with each other to capture latent dependencies between consecutive segments of multiple-segment sequential data on different clients, but without sharing raw data or complete model parameters. After training local sub-networks with local sequential data segments, all clients send their sub-networks to a federated server where sub-networks are aggregated to generate a global model. The experimental results on simulated and real-world datasets demonstrate that the proposed method successfully train models on distributed sequential data, while preserving privacy, and outperforms previous FL and centralized learning approaches in terms of achieving higher accuracy in fewer communication rounds

    MAISON -- Multimodal AI-based Sensor platform for Older Individuals

    Full text link
    There is a global aging population requiring the need for the right tools that can enable older adults' greater independence and the ability to age at home, as well as assist healthcare workers. It is feasible to achieve this objective by building predictive models that assist healthcare workers in monitoring and analyzing older adults' behavioral, functional, and psychological data. To develop such models, a large amount of multimodal sensor data is typically required. In this paper, we propose MAISON, a scalable cloud-based platform of commercially available smart devices capable of collecting desired multimodal sensor data from older adults and patients living in their own homes. The MAISON platform is novel due to its ability to collect a greater variety of data modalities than the existing platforms, as well as its new features that result in seamless data collection and ease of use for older adults who may not be digitally literate. We demonstrated the feasibility of the MAISON platform with two older adults discharged home from a large rehabilitation center. The results indicate that the MAISON platform was able to collect and store sensor data in a cloud without functional glitches or performance degradation. This paper will also discuss the challenges faced during the development of the platform and data collection in the homes of older adults. MAISON is a novel platform designed to collect multimodal data and facilitate the development of predictive models for detecting key health indicators, including social isolation, depression, and functional decline, and is feasible to use with older adults in the community

    Evaluation of Knowledge and Belief on False Reports and Misinformation from Social Media in COVID-19 Pandemic: A Web Based Cross-Sectional Survey in Karachi, Pakistan

    Get PDF
    COVID-19 has become a global pandemic declared by World Health Organization (WHO) on March 11, 2020. This has put drastic impact on the world and many lives have been affected globally. As the cases of COVID-19 infected are increasing, the spread of fake news related to treatment and its prevention have led to a very difficult situation in controlling and containing the COVID-19 infection. It seems that general public tend to belief in rumors and share them on social media platforms that lead to misinformation which go viral and has created chaos among the general masses. The study evaluated the role of social media in false reporting and spreading misinformation in COVID-19 pandemic. Study also evaluated the knowledge, belief and awareness among general population of the Karachi city to provide insights and to enable ministries and policy makers to take suitable measures. This is a cross sectional study which was conducted from June to July 2020 in Karachi, Pakistan. A self-structured questionnaire was administered through Facebook and Whatsapp due to lockdown and increase risk of exposure from COVID-19 to the research assistants. Data collected was analyzed using descriptive and inferential statistics of frequency counts, and percentages of quantitative variables and Chi square for the inferential variable at 0.05 level of significance. A total of 267 participants were sampled for the study. The study indicates that majority of the participants believed in the myths and false reports circulated on social media and usually share and forward such news without authentic references

    Rehabilitation Exercise Repetition Segmentation and Counting using Skeletal Body Joints

    Full text link
    Physical exercise is an essential component of rehabilitation programs that improve quality of life and reduce mortality and re-hospitalization rates. In AI-driven virtual rehabilitation programs, patients complete their exercises independently at home, while AI algorithms analyze the exercise data to provide feedback to patients and report their progress to clinicians. To analyze exercise data, the first step is to segment it into consecutive repetitions. There has been a significant amount of research performed on segmenting and counting the repetitive activities of healthy individuals using raw video data, which raises concerns regarding privacy and is computationally intensive. Previous research on patients' rehabilitation exercise segmentation relied on data collected by multiple wearable sensors, which are difficult to use at home by rehabilitation patients. Compared to healthy individuals, segmenting and counting exercise repetitions in patients is more challenging because of the irregular repetition duration and the variation between repetitions. This paper presents a novel approach for segmenting and counting the repetitions of rehabilitation exercises performed by patients, based on their skeletal body joints. Skeletal body joints can be acquired through depth cameras or computer vision techniques applied to RGB videos of patients. Various sequential neural networks are designed to analyze the sequences of skeletal body joints and perform repetition segmentation and counting. Extensive experiments on three publicly available rehabilitation exercise datasets, KIMORE, UI-PRMD, and IntelliRehabDS, demonstrate the superiority of the proposed method compared to previous methods. The proposed method enables accurate exercise analysis while preserving privacy, facilitating the effective delivery of virtual rehabilitation programs.Comment: 8 pages, 1 figure, 2 table

    Misuse of Antibiotics in Poultry Threatens Pakistan Communitys Health

    Full text link
    A survey was conducted from February 2022 to May 2022 on the usage of antibiotics at a poultry farm in different areas of Multan, Punjab Pakistan. A well-organized questionnaire was used for the collection of data. Sixty poultry farms were surveyed randomly in the Multan district. All of these Farms were using antibiotics. Antibiotics are commonly used for the treatment of diseases. Some are used as preventive medicine and a few are used as growth promotors. neomycin, erythromycin, oxytetracycline, streptomycin, and colistin are the broad-spectrum antibiotics that are being used commercially. Enrofloxacin and Furazolidone are the common antibiotics that are being used in Studies these days. The class of Fluoroquinolones is commonly used in poultry farms. Thirty-three patterns of antibiotic usage were observed at poultry farms. multi-drug practices were also observed on various farms. In this study, 25% of antibiotics are prescribed by the veterans while more than 90 % were acquired from the veterinary store. This study provides information about the antibiotics which are commonly being used in the study location district Multan. It is expected that the finding of this survey will be helpful in the development of new strategies against the misuse of antibiotics on farms

    Proteome level analysis of drug-resistant Prevotella melaninogenica for the identification of novel therapeutic candidates

    Get PDF
    The management of infectious diseases has become more critical due to the development of novel pathogenic strains with enhanced resistance. Prevotella melaninogenica, a gram-negative bacterium, was found to be involved in various infections of the respiratory tract, aerodigestive tract, and gastrointestinal tract. The need to explore novel drug and vaccine targets against this pathogen was triggered by the emergence of antimicrobial resistance against reported antibiotics to combat P. melaninogenica infections. The study involves core genes acquired from 14 complete P. melaninogenica strain genome sequences, where promiscuous drug and vaccine candidates were explored by state-of-the-art subtractive proteomics and reverse vaccinology approaches. A stringent bioinformatics analysis enlisted 18 targets as novel, essential, and non-homologous to humans and having druggability potential. Moreover, the extracellular and outer membrane proteins were subjected to antigenicity, allergenicity, and physicochemical analysis for the identification of the candidate proteins to design multi-epitope vaccines. Two candidate proteins (ADK95685.1 and ADK97014.1) were selected as the best target for the designing of a vaccine construct. Lead B- and T-cell overlapped epitopes were joined to generate potential chimeric vaccine constructs in combination with adjuvants and linkers. Finally, a prioritized vaccine construct was found to have stable interactions with the human immune cell receptors as confirmed by molecular docking and MD simulation studies. The vaccine construct was found to have cloning and expression ability in the bacterial cloning system. Immune simulation ensured the elicitation of significant immune responses against the designed vaccine. In conclusion, our study reported novel drug and vaccine targets and designed a multi-epitope vaccine against the P. melaninogenica infection. Further experimental validation will help open new avenues in the treatment of this multi-drug-resistant pathogen

    Impact of opioid-free analgesia on pain severity and patient satisfaction after discharge from surgery: multispecialty, prospective cohort study in 25 countries

    Get PDF
    Background: Balancing opioid stewardship and the need for adequate analgesia following discharge after surgery is challenging. This study aimed to compare the outcomes for patients discharged with opioid versus opioid-free analgesia after common surgical procedures.Methods: This international, multicentre, prospective cohort study collected data from patients undergoing common acute and elective general surgical, urological, gynaecological, and orthopaedic procedures. The primary outcomes were patient-reported time in severe pain measured on a numerical analogue scale from 0 to 100% and patient-reported satisfaction with pain relief during the first week following discharge. Data were collected by in-hospital chart review and patient telephone interview 1 week after discharge.Results: The study recruited 4273 patients from 144 centres in 25 countries; 1311 patients (30.7%) were prescribed opioid analgesia at discharge. Patients reported being in severe pain for 10 (i.q.r. 1-30)% of the first week after discharge and rated satisfaction with analgesia as 90 (i.q.r. 80-100) of 100. After adjustment for confounders, opioid analgesia on discharge was independently associated with increased pain severity (risk ratio 1.52, 95% c.i. 1.31 to 1.76; P < 0.001) and re-presentation to healthcare providers owing to side-effects of medication (OR 2.38, 95% c.i. 1.36 to 4.17; P = 0.004), but not with satisfaction with analgesia (beta coefficient 0.92, 95% c.i. -1.52 to 3.36; P = 0.468) compared with opioid-free analgesia. Although opioid prescribing varied greatly between high-income and low- and middle-income countries, patient-reported outcomes did not.Conclusion: Opioid analgesia prescription on surgical discharge is associated with a higher risk of re-presentation owing to side-effects of medication and increased patient-reported pain, but not with changes in patient-reported satisfaction. Opioid-free discharge analgesia should be adopted routinely

    Artificial intelligence-driven virtual rehabilitation for people living in the community: A scoping review

    Full text link
    Abstract Virtual Rehabilitation (VRehab) is a promising approach to improving the physical and mental functioning of patients living in the community. The use of VRehab technology results in the generation of multi-modal datasets collected through various devices. This presents opportunities for the development of Artificial Intelligence (AI) techniques in VRehab, namely the measurement, detection, and prediction of various patients’ health outcomes. The objective of this scoping review was to explore the applications and effectiveness of incorporating AI into home-based VRehab programs. PubMed/MEDLINE, Embase, IEEE Xplore, Web of Science databases, and Google Scholar were searched from inception until June 2023 for studies that applied AI for the delivery of VRehab programs to the homes of adult patients. After screening 2172 unique titles and abstracts and 51 full-text studies, 13 studies were included in the review. A variety of AI algorithms were applied to analyze data collected from various sensors and make inferences about patients’ health outcomes, most involving evaluating patients’ exercise quality and providing feedback to patients. The AI algorithms used in the studies were mostly fuzzy rule-based methods, template matching, and deep neural networks. Despite the growing body of literature on the use of AI in VRehab, very few studies have examined its use in patients’ homes. Current research suggests that integrating AI with home-based VRehab can lead to improved rehabilitation outcomes for patients. However, further research is required to fully assess the effectiveness of various forms of AI-driven home-based VRehab, taking into account its unique challenges and using standardized metrics

    Recapitulation of Peste des Petits Ruminants (PPR) Prevalence in Small Ruminant Populations of Pakistan from 2004 to 2023: A Systematic Review and Meta-Analysis

    Full text link
    Peste des petits ruminants (PPR) is an extremely transmissible viral disease caused by the PPR virus that impacts domestic small ruminants, namely sheep and goats. This study aimed to employ a methodical approach to evaluate the regional occurrence of PPR in small ruminants in Pakistan and the contributing factors that influence its prevalence. A thorough search was performed in various databases to identify published research articles between January 2004 and August 2023 on PPR in small ruminants in Pakistan. Articles were chosen based on specific inclusion and exclusion criteria. A total of 25 articles were selected from 1275 studies gathered from different databases. The overall pooled prevalence in Pakistan was calculated to be 51% (95% CI: 42–60), with heterogeneity I2 = 100%, τ2 = 0.0495, and p = 0. The data were summarized based on the division into five regions: Punjab, Baluchistan, KPK, Sindh, and GB and AJK. Among these, the pooled prevalence of PPR in Sindh was 61% (95% CI: 46–75), I2 = 100%, τ2 = 0.0485, and p = 0, while in KPK, it was 44% (95% CI: 26–63), I2 = 99%, τ2 = 0.0506, and p < 0.01. However, the prevalence of PPR in Baluchistan and Punjab was almost the same. Raising awareness, proper surveillance, and application of appropriate quarantine measures interprovincially and across borders must be maintained to contain the disease
    corecore