Reproducibility in Machine Learning-Driven Research

Research is facing a reproducibility crisis, in which the results and findings of many studies are difficult or even impossible to reproduce. This is also the case in machine learning (ML) and artificial intelligence (AI) research. Often, this is the case due to unpublished data and/or source-code, and due to sensitivity to ML training conditions. Although different solutions to address this issue are discussed in the research community such as using ML platforms, the level of reproducibility in ML-driven research is not increasing substantially. Therefore, in this mini survey, we review the literature on reproducibility in ML-driven research with three main aims: (i) reflect on the current situation of ML reproducibility in various research fields, (ii) identify reproducibility issues and barriers that exist in these research fields applying ML, and (iii) identify potential drivers such as tools, practices, and interventions that support ML reproducibility. With this, we hope to contribute to decisions on the viability of different solutions for supporting ML reproducibility.Comment: This research is supported by the Horizon Europe project TIER2 under grant agreement No 10109481

Going beyond your personal learning network, using recommendations and trust through a multimedia question-answering service for decision-support: A case study in the healthcare.

Social learning networks enable the sharing, transfer and enhancement of knowledge in the workplace that builds the ground to exchange informal learning practices. In this work, three healthcare networks are studied in order to understand how to enable the building, maintaining and activation of new contacts at work and the exchange of knowledge between them. By paying close attention to the needs of the practitioners, we aimed to understand how personal and social learning could be supported by technological services exploiting social networks and the respective traces reflected in the semantics. This paper presents a case study reporting on the results of two co-design sessions and elicits requirements showing the importance of scaffolding strategies in personal and shared learning networks. Besides, the significance of these strategies to aggregate trust among peers when sharing resources and decision-support when exchanging questions and answers. The outcome is a set of design criteria to be used for further technical development for a social semantic question and answer tool. We conclude with the lessons learned and future work

Prevalence and incidence of iron deficiency in European community-dwelling older adults : An observational analysis of the DO-HEALTH trial

Background and aim Iron deficiency is associated with increased morbidity and mortality in older adults. However, data on its prevalence and incidence among older adults is limited. The aim of this study was to investigate the prevalence and incidence of iron deficiency in European community-dwelling older adults aged ≥ 70 years. Methods Secondary analysis of the DO-HEALTH trial, a 3-year clinical trial including 2157 community-dwelling adults aged ≥ 70 years from Austria, France, Germany, Portugal and Switzerland. Iron deficiency was defined as soluble transferrin receptor (sTfR) > 28.1 nmol/L. Prevalence and incidence rate (IR) of iron deficiency per 100 person-years were examined overall and stratified by sex, age group, and country. Sensitivity analysis for three commonly used definitions of iron deficiency (ferritin  1.5) were also performed. Results Out of 2157 participants, 2141 had sTfR measured at baseline (mean age 74.9 years; 61.5% women). The prevalence of iron deficiency at baseline was 26.8%, and did not differ by sex, but by age (35.6% in age group ≥ 80, 29.3% in age group 75–79, 23.2% in age group 70–74); P  1.5. Occurrences of iron deficiency were observed with IR per 100 person-years of 9.2 (95% CI 8.3–10.1) and did not significantly differ by sex or age group. The highest IR per 100 person-years was observed in Austria (20.8, 95% CI 16.1–26.9), the lowest in Germany (6.1, 95% CI 4.7–8.0). Regarding the other definitions of iron deficiency, the IR per 100 person-years was 4.5 (95% CI 4.0–4.9) for ferritin  1.5. Conclusions Iron deficiency is frequent among relatively healthy European older adults, with people aged ≥ 80 years and residence in Austria and Portugal associated with the highest risk

DO-HEALTH: Vitamin D3 - Omega3 - Home exercise - Healthy aging and longevity trial - Design of a multinational clinical trial on healthy aging among European seniors

DO-HEALTH is a multi-center clinical trial among 2157 community-dwelling European men and women age 70 and older. The 2x2x2 randomized-control factorial design trial tested the individual and additive benefit, as well as the cost-effectiveness, of 3 interventions: vitamin D 2000 IU/day, omega-3 fatty acids 1000 mg/day (EPA + DHA, ratio 1:2), and a 30-minute 3 times/week home exercise (strength versus flexibility). Each treatment tested has shown considerable prior promise from mechanistic studies, small clinical trials, or large cohort studies, in the prevention of common age-related chronic diseases, but definitive data are missing. DO-HEALTH will test these interventions in relation to 6 primary endpoints (systolic and diastolic blood pressure, non-vertebral fractures, Short Physical Performance Battery score, the Montreal Cognitive Assessment, and risk of infections), plus several secondary endpoints explored in ancillary studies (i.e. rate of any falls and injurious falls, joint pain, oral health, quality of life, and incident frailty). As the 3 interventions have distinct mechanisms of action for each of the 6 primary endpoints, a maximum benefit is expected for their additive benefit as a "multi-modal" intervention. The trial duration is 3 years with in-person contacts with all participants at 4 clinical visits and by quarterly phone calls. Baseline and follow-up blood samples were collected in all participants to measure changes in 25-hydroxyvitamin D and poly-unsaturated fatty acid concentrations. Our objective was to test interventions that are expected to promote healthy aging and longer life expectancy and that can be easily and safely implemented by older community-dwelling adults

Effect of Vitamin D Supplementation, Omega-3 Fatty Acid Supplementation, or a Strength-Training Exercise Program on Clinical Outcomes in Older Adults:The DO-HEALTH Randomized Clinical Trial

Importance: The benefits of vitamin D, omega-3 fatty acids, and exercise in disease prevention remain unclear. Objective: To test whether vitamin D, omega-3s, and a strength-training exercise program, alone or in combination, improved 6 health outcomes among older adults. Design, setting, and participants: Double-blind, placebo-controlled, 2 × 2 × 2 factorial randomized clinical trial among 2157 adults aged 70 years or older who had no major health events in the 5 years prior to enrollment and had sufficient mobility and good cognitive status. Patients were recruited between December 2012 and November 2014, and final follow-up was in November 2017. Interventions: Participants were randomized to 3 years of intervention in 1 of the following 8 groups: 2000 IU/d of vitamin D3, 1 g/d of omega-3s, and a strength-training exercise program (n = 264); vitamin D3 and omega-3s (n = 265); vitamin D3 and exercise (n = 275); vitamin D3 alone (n = 272); omega-3s and exercise (n = 275); omega-3s alone (n = 269); exercise alone (n = 267); or placebo (n = 270). Main outcomes and measures: The 6 primary outcomes were change in systolic and diastolic blood pressure (BP), Short Physical Performance Battery (SPPB), Montreal Cognitive Assessment (MoCA), and incidence rates (IRs) of nonvertebral fractures and infections over 3 years. Based on multiple comparisons of 6 primary end points, 99% confidence intervals are presented and P < .01 was required for statistical significance. Results: Among 2157 randomized participants (mean age, 74.9 years; 61.7% women), 1900 (88%) completed the study. Median follow-up was 2.99 years. Overall, there were no statistically significant benefits of any intervention individually or in combination for the 6 end points at 3 years. For instance, the differences in mean change in systolic BP with vitamin D vs no vitamin D and with omega-3s vs no omega-3s were both -0.8 (99% CI, -2.1 to 0.5) mm Hg, with P < .13 and P < .11, respectively; the difference in mean change in diastolic BP with omega-3s vs no omega-3s was -0.5 (99% CI, -1.2 to 0.2) mm Hg; P = .06); and the difference in mean change in IR of infections with omega-3s vs no omega-3s was -0.13 (99% CI, -0.23 to -0.03), with an IR ratio of 0.89 (99% CI, 0.78-1.01; P = .02). No effects were found on the outcomes of SPPB, MoCA, and incidence of nonvertebral fractures). A total of 25 deaths were reported, with similar numbers in all treatment groups. Conclusions and relevance: Among adults without major comorbidities aged 70 years or older, treatment with vitamin D3, omega-3s, or a strength-training exercise program did not result in statistically significant differences in improvement in systolic or diastolic blood pressure, nonvertebral fractures, physical performance, infection rates, or cognitive function. These findings do not support the effectiveness of these 3 interventions for these clinical outcomes. Trial registration: ClinicalTrials.gov Identifier: NCT01745263