92 research outputs found

    Robust Latent Representations via Cross-Modal Translation and Alignment

    Full text link
    Multi-modal learning relates information across observation modalities of the same physical phenomenon to leverage complementary information. Most multi-modal machine learning methods require that all the modalities used for training are also available for testing. This is a limitation when the signals from some modalities are unavailable or are severely degraded by noise. To address this limitation, we aim to improve the testing performance of uni-modal systems using multiple modalities during training only. The proposed multi-modal training framework uses cross-modal translation and correlation-based latent space alignment to improve the representations of the weaker modalities. The translation from the weaker to the stronger modality generates a multi-modal intermediate encoding that is representative of both modalities. This encoding is then correlated with the stronger modality representations in a shared latent space. We validate the proposed approach on the AVEC 2016 dataset for continuous emotion recognition and show the effectiveness of the approach that achieves state-of-the-art (uni-modal) performance for weaker modalities

    Unsupervised cross-modal deep-model adaptation for audio-visual re-identification with wearable cameras

    Get PDF
    Model adaptation is important for the analysis of audio-visual data from body worn cameras in order to cope with rapidly changing scene conditions, varying object appearance and limited training data. In this paper, we propose a new approach for the on-line and unsupervised adaptation of deep-learning models for audio-visual target re-identification. Specifically, we adapt each mono-modal model using the unsupervised labelling provided by the other modality. To limit the detrimental effects of erroneous labels, we use a regularisation term based on the Kullback-Leibler divergence between the initial model and the one being adapted. The proposed adaptation strategy complements common audio-visual late fusion approaches and is beneficial also when one modality is no longer reliable. We show the contribution of the proposed strategy in improving the overall re-identification performance on a challenging public dataset captured with body worn cameras

    Improving filling level classification with adversarial training

    Full text link
    We investigate the problem of classifying - from a single image - the level of content in a cup or a drinking glass. This problem is made challenging by several ambiguities caused by transparencies, shape variations and partial occlusions, and by the availability of only small training datasets. In this paper, we tackle this problem with an appropriate strategy for transfer learning. Specifically, we use adversarial training in a generic source dataset and then refine the training with a task-specific dataset. We also discuss and experimentally evaluate several training strategies and their combination on a range of container types of the CORSMAL Containers Manipulation dataset. We show that transfer learning with adversarial training in the source domain consistently improves the classification accuracy on the test set and limits the overfitting of the classifier to specific features of the training data.Comment: Accepted to the 28th IEEE International Conference on Image Processing (ICIP) 202

    Affordance segmentation of hand-occluded containers from exocentric images

    Full text link
    Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this paper, we focus on occlusions of an object that is hand-held by a person manipulating it. To address this challenge, we propose an affordance segmentation model that uses auxiliary branches to process the object and hand regions separately. The proposed model learns affordance features under hand-occlusion by weighting the feature map through hand and object segmentation. To train the model, we annotated the visual affordances of an existing dataset with mixed-reality images of hand-held containers in third-person (exocentric) images. Experiments on both real and mixed-reality images show that our model achieves better affordance segmentation and generalisation than existing models.Comment: Paper accepted to Workshop on Assistive Computer Vision and Robotics (ACVR) in International Conference on Computer Vision (ICCV) 2023; 10 pages, 4 figures, 2 tables. Data, code, and trained models are available at https://apicis.github.io/projects/acanet.htm

    Potential probiotic approaches to control Legionella in engineered aquatic ecosystems

    Full text link
    Opportunistic pathogens belonging to the genus Legionella are among the most reported waterborne-associated pathogens in industrialized countries. Legionella colonize a variety of engineered aquatic ecosystems and persist in biofilms where they interact with a multitude of other resident microorganisms. In this review, we assess how some of these interactions could be used to develop a biological-driven "probiotic" control approach against Legionella. We focus on: (i) mechanisms limiting the ability of Legionella to establish and replicate within some of their natural protozoan hosts; (ii) exploitative and interference competitive interactions between Legionella and other microorganisms; and (iii) the potential of predatory bacteria and phages against Legionella. This field is still emergent, and we therefore specifically highlight research for future investigations, and propose perspectives on the feasibility and public acceptance of a potential probiotic approach. Keywords: Legionella; antagonism; biofilm; competition; pathogen–host interaction; predation; probiotics; protozoa

    A Snapshot on the On-Label and Off-Label Use of the Interleukin-1 Inhibitors in Italy among Rheumatologists and Pediatric Rheumatologists: A Nationwide Multi-Center Retrospective Observational Study.

    Get PDF
    Background: Interleukin (IL)-1 inhibitors have been suggested as possible therapeutic options in a large number of old and new clinical entities characterized by an IL-1 driven pathogenesis. Objectives: To perform a nationwide snapshot of the on-label and off-label use of anakinra (ANA) and canakinumab (CAN) for different conditions both in children and adults. Methods: We retrospectively collected demographic, clinical, and therapeutic data from both adult and pediatric patients treated with IL-1 inhibitors from January 2008 to July 2016. Results: Five hundred and twenty-six treatment courses given to 475 patients (195 males, 280 females; 111 children and 364 adults) were evaluated. ANA was administered in 421 (80.04%) courses, CAN in 105 (19.96%). Sixty-two (32.1%) patients had been treated with both agents. IL-1 inhibitors were employed in 38 different indications (37 with ANA, 16 with CAN). Off-label use was more frequent for ANA than CAN (p < 0.0001). ANA was employed as first-line biologic approach in 323 (76.7%) cases, while CAN in 37 cases (35.2%). IL-1 inhibitors were associated with corticosteroids in 285 (54.18%) courses and disease modifying anti-rheumatic drugs (DMARDs) in 156 (29.65%). ANA dosage ranged from 30 to 200 mg/day (or 1.0-2.0 mg/kg/day) among adults and 2-4 mg/kg/day among children; regarding CAN, the most frequently used posologies were 150mg every 8 weeks, 150mg every 4 weeks and 150mg every 6 weeks. The frequency of failure was higher among patients treated with ANA at a dosage of 100 mg/day than those treated with 2 mg/kg/day (p = 0.03). Seventy-six patients (14.4%) reported an adverse event (AE) and 10 (1.9%) a severe AE. AEs occurred more frequently after the age of 65 compared to both children and patients aged between 16 and 65 (p = 0.003 and p = 0.03, respectively). Conclusions: IL-1 inhibitors are mostly used off-label, especially ANA, during adulthood. The high frequency of good clinical responses suggests that IL-1 inhibitors are used with awareness of pathogenetic mechanisms; adult healthcare physicians generally employ standard dosages, while pediatricians are more prone in using a weight-based posology. Dose adjustments and switching between different agents showed to be effective treatment strategies. Our data confirm the good safety profile of IL-1 inhibitors

    Prescription appropriateness of anti-diabetes drugs in elderly patients hospitalized in a clinical setting: evidence from the REPOSI Register

    Get PDF
    Diabetes is an increasing global health burden with the highest prevalence (24.0%) observed in elderly people. Older diabetic adults have a greater risk of hospitalization and several geriatric syndromes than older nondiabetic adults. For these conditions, special care is required in prescribing therapies including anti- diabetes drugs. Aim of this study was to evaluate the appropriateness and the adherence to safety recommendations in the prescriptions of glucose-lowering drugs in hospitalized elderly patients with diabetes. Data for this cross-sectional study were obtained from the REgistro POliterapie-Società Italiana Medicina Interna (REPOSI) that collected clinical information on patients aged ≥ 65 years acutely admitted to Italian internal medicine and geriatric non-intensive care units (ICU) from 2010 up to 2019. Prescription appropriateness was assessed according to the 2019 AGS Beers Criteria and anti-diabetes drug data sheets.Among 5349 patients, 1624 (30.3%) had diagnosis of type 2 diabetes. At admission, 37.7% of diabetic patients received treatment with metformin, 37.3% insulin therapy, 16.4% sulfonylureas, and 11.4% glinides. Surprisingly, only 3.1% of diabetic patients were treated with new classes of anti- diabetes drugs. According to prescription criteria, at admission 15.4% of patients treated with metformin and 2.6% with sulfonylureas received inappropriately these treatments. At discharge, the inappropriateness of metformin therapy decreased (10.2%, P &lt; 0.0001). According to Beers criteria, the inappropriate prescriptions of sulfonylureas raised to 29% both at admission and at discharge. This study shows a poor adherence to current guidelines on diabetes management in hospitalized elderly people with a high prevalence of inappropriate use of sulfonylureas according to the Beers criteria

    Clinical features and outcomes of elderly hospitalised patients with chronic obstructive pulmonary disease, heart failure or both

    Get PDF
    Background and objective: Chronic obstructive pulmonary disease (COPD) and heart failure (HF) mutually increase the risk of being present in the same patient, especially if older. Whether or not this coexistence may be associated with a worse prognosis is debated. Therefore, employing data derived from the REPOSI register, we evaluated the clinical features and outcomes in a population of elderly patients admitted to internal medicine wards and having COPD, HF or COPD + HF. Methods: We measured socio-demographic and anthropometric characteristics, severity and prevalence of comorbidities, clinical and laboratory features during hospitalization, mood disorders, functional independence, drug prescriptions and discharge destination. The primary study outcome was the risk of death. Results: We considered 2,343 elderly hospitalized patients (median age 81 years), of whom 1,154 (49%) had COPD, 813 (35%) HF, and 376 (16%) COPD + HF. Patients with COPD + HF had different characteristics than those with COPD or HF, such as a higher prevalence of previous hospitalizations, comorbidities (especially chronic kidney disease), higher respiratory rate at admission and number of prescribed drugs. Patients with COPD + HF (hazard ratio HR 1.74, 95% confidence intervals CI 1.16-2.61) and patients with dementia (HR 1.75, 95% CI 1.06-2.90) had a higher risk of death at one year. The Kaplan-Meier curves showed a higher mortality risk in the group of patients with COPD + HF for all causes (p = 0.010), respiratory causes (p = 0.006), cardiovascular causes (p = 0.046) and respiratory plus cardiovascular causes (p = 0.009). Conclusion: In this real-life cohort of hospitalized elderly patients, the coexistence of COPD and HF significantly worsened prognosis at one year. This finding may help to better define the care needs of this population

    Antidiabetic Drug Prescription Pattern in Hospitalized Older Patients with Diabetes

    Get PDF
    Objective: To describe the prescription pattern of antidiabetic and cardiovascular drugs in a cohort of hospitalized older patients with diabetes. Methods: Patients with diabetes aged 65 years or older hospitalized in internal medicine and/or geriatric wards throughout Italy and enrolled in the REPOSI (REgistro POliterapuie SIMI—Società Italiana di Medicina Interna) registry from 2010 to 2019 and discharged alive were included. Results: Among 1703 patients with diabetes, 1433 (84.2%) were on treatment with at least one antidiabetic drug at hospital admission, mainly prescribed as monotherapy with insulin (28.3%) or metformin (19.2%). The proportion of treated patients decreased at discharge (N = 1309, 76.9%), with a significant reduction over time. Among those prescribed, the proportion of those with insulin alone increased over time (p = 0.0066), while the proportion of those prescribed sulfonylureas decreased (p &lt; 0.0001). Among patients receiving antidiabetic therapy at discharge, 1063 (81.2%) were also prescribed cardiovascular drugs, mainly with an antihypertensive drug alone or in combination (N = 777, 73.1%). Conclusion: The management of older patients with diabetes in a hospital setting is often sub-optimal, as shown by the increasing trend in insulin at discharge, even if an overall improvement has been highlighted by the prevalent decrease in sulfonylureas prescription
    • …
    corecore