Self-Distilled Representation Learning for Time Series

Self-supervised learning for time-series data holds potential similar to that recently unleashed in Natural Language Processing and Computer Vision. While most existing works in this area focus on contrastive learning, we propose a conceptually simple yet powerful non-contrastive approach, based on the data2vec self-distillation framework. The core of our method is a student-teacher scheme that predicts the latent representation of an input time series from masked views of the same time series. This strategy avoids strong modality-specific assumptions and biases typically introduced by the design of contrastive sample pairs. We demonstrate the competitiveness of our approach for classification and forecasting as downstream tasks, comparing with state-of-the-art self-supervised learning methods on the UCR and UEA archives as well as the ETT and Electricity datasets.Comment: Presented at the NeurIPS 2023 Workshop: Self-Supervised Learning - Theory and Practic

Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models

Generalized Additive Models (GAMs) have recently experienced a resurgence in popularity due to their interpretability, which arises from expressing the target value as a sum of non-linear transformations of the features. Despite the current enthusiasm for GAMs, their susceptibility to concurvity - i.e., (possibly non-linear) dependencies between the features - has hitherto been largely overlooked. Here, we demonstrate how concurvity can severly impair the interpretability of GAMs and propose a remedy: a conceptually simple, yet effective regularizer which penalizes pairwise correlations of the non-linearly transformed feature variables. This procedure is applicable to any differentiable additive model, such as Neural Additive Models or NeuralProphet, and enhances interpretability by eliminating ambiguities due to self-canceling feature contributions. We validate the effectiveness of our regularizer in experiments on synthetic as well as real-world datasets for time-series and tabular data. Our experiments show that concurvity in GAMs can be reduced without significantly compromising prediction quality, improving interpretability and reducing variance in the feature importances

Efficacy of a meal replacement diet plan compared to a food-based diet plan after a period of weight loss and weight maintenance: a randomized controlled trial

<p>Abstract</p> <p>Background</p> <p>Obesity has reached epidemic proportions in the United States. It is implicated in the development of a variety of chronic disease states and is associated with increased levels of inflammation and oxidative stress. The objective of this study is to examine the effect of Medifast's meal replacement program (MD) on body weight, body composition, and biomarkers of inflammation and oxidative stress among obese individuals following a period of weight loss and weight maintenance compared to a an isocaloric, food-based diet (FB).</p> <p>Methods</p> <p>This 40-week randomized, controlled clinical trial included 90 obese adults with a body mass index (BMI) between 30 and 50 kg/m², randomly assigned to one of two weight loss programs for 16 weeks and then followed for a 24-week period of weight maintenance. The dietary interventions consisted of Medifast's meal replacement program for weight loss and weight maintenance, or a self-selected, isocaloric, food-based meal plan.</p> <p>Results</p> <p>Weight loss at 16 weeks was significantly better in the Medifast group (MD) versus the food-based group (FB) (12.3% vs. 6.9%), and while significantly more weight was regained during weight maintenance on MD versus FB, overall greater weight loss was achieved on MD versus FB. Significantly more of the MD participants lost ≥ 5% of their initial weight at week 16 (93% vs. 55%) and week 40 (62% vs. 30%). There was no difference in satiety observed between the two groups during the weight loss phase. Significant improvements in body composition were also observed in MD participants compared to FB at week 16 and week 40. At week 40, both groups experienced improvements in biochemical outcomes and other clinical indicators.</p> <p>Conclusions</p> <p>Our data suggest that the meal replacement diet plan evaluated was an effective strategy for producing robust initial weight loss and for achieving improvements in a number of health-related parameters during weight maintenance, including inflammation and oxidative stress, two key factors more recently shown to underlie our most common chronic diseases.</p> <p>Trial Registration</p> <p>ClinicalTrials.gov NCT01011491</p

Serum insulin-like activity in genetic and experimental diabetes mellitus

A modification of the epididymal fat pad assay for insulin-like activity has been applied to serum from normal subjects, untreated diabetic patients, and dogs with experimentally induced diabetes. Diabetic patients exhibited abnormally elevated serum ILA levels before and after glucose loading, and also demonstrated a delay in their ILA response to glucose. Dogs with experimental diabetes did not show an elevation in their ILA values. Genetically determined diabetes is obviously different from simple insulin deficiency diabetes. The data confirm and extend previous observations that a significant degree of hyperinsulinemia exists in the garden variety of mildly diabetic patients. Unusually high levels of insulin-like activity were found in 7 of 27 apparently normal subjects. Their ILA exceeded at most times the mean of those found in the diabetic patients. Two of these subjects later discovered a family history of diabetes. Some of the implications of these observations are discussed.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/32090/1/0000140.pd

Association of Parental Obesity With Concentrations of Select Systemic Biomarkers in Nonobese Offspring : The Framingham Heart Study

OBJECTIVE—Parental obesity is a risk factor for offspring obesity. It is unclear whether parental obesity also confers risk for obesity-associated conditions (e.g., a proinflammatory or prothrombotic state) in the absence of offspring obesity

Weight loss for individuals with type 2 diabetes following a very-low-calorie diet in a community-based setting with trained facilitators for 12 weeks.

Approximately 80% of people with type 2 diabetes mellitus (T2DM) are overweight or obese, and obesity compounds the cardiovascular risk of T2DM. The aim of this retrospective study was twofold: first to investigate whether a twelve-week, community-based VLCD programme can result in important weight loss; and second to investigate any potential difference in the weight loss achieved using this community based approach in individuals with and without T2DM. Three hundred and fifty five participants with T2DM were matched for age, BMI and gender to participants without T2DM. The total cohort comprised 204 males: 506 females; age (years) 54.0 ± 9.1; BMI (kg/m2) 41.6 ± 8.1; weight (kg) 116.1 ± 25.1). The programme included a daily intake of 550kcal in addition to group support and behaviour therapy provided by trained facilitators within a community-based setting. After twelve weeks, there was significant weight loss within each group when compared to baseline (T2DM: 115.0 ± 24.4 kg vs 96.7 ± 21.4 kg, p < 0.0001; non-T2DM: 117.2 ± 25.8 kg vs 97.3 ± 22.2 kg, p < 0.0001). At twelve weeks, both weight change (-18.3 ± 7.3 kg vs -19.9 ± 7.0 kg, p = 0.012) and BMI change (-6.7 ± 2.9 kg/m2 vs -7.1 ± 2.1 kg/m2, p = 0.011) were significantly less in the T2DM group when compared to the non-T2DM group. Our results suggest that the use of VLCD approaches for weight management in T2DM can achieve more than 90% of the weight loss seen in obese individuals without T2DM

Nutrient adequacy during weight loss interventions: a randomized study in women comparing the dietary intake in a meal replacement group with a traditional food group

<p>Abstract</p> <p>Background</p> <p>Safe and effective weight control strategies are needed to stem the current obesity epidemic. The objective of this one-year study was to document and compare the macronutrient and micronutrient levels in the foods chosen by women following two different weight reduction interventions.</p> <p>Methods</p> <p>Ninety-six generally healthy overweight or obese women (ages 25–50 years; BMI 25–35 kg/m²) were randomized into a Traditional Food group (TFG) or a Meal Replacement Group (MRG) incorporating 1–2 meal replacement drinks or bars per day. Both groups had an energy-restricted goal of 5400 kJ/day. Dietary intake data was obtained using 3-Day Food records kept by the subjects at baseline, 6 months and one-year. For more uniform comparisons between groups, each diet intervention consisted of 18 small group sessions led by the same Registered Dietitian.</p> <p>Results</p> <p>Weight loss for the 73% (n = 70) completing this one-year study was not significantly different between the groups, but was significantly different (p ≤ .05) within each group with a mean (± standard deviation) weight loss of -6.1 ± 6.7 kg (TFG, n = 35) vs -5.0 ± 4.9 kg (MRG, n = 35). Both groups had macronutrient (Carbohydrate:Protein:Fat) ratios that were within the ranges recommended (50:19:31, TFG vs 55:16:29, MRG). Their reported reduced energy intake was similar (5729 ± 1424 kJ, TFG vs 5993 ± 2016 kJ, MRG). There was an improved dietary intake pattern in both groups as indicated by decreased intake of saturated fat (≤ 10%), cholesterol (<200 mg/day), and sodium (< 2400 mg/day), with increased total servings/day of fruits and vegetables (4.0 ± 2.2, TFG vs 4.6 ± 3.2, MRG). However, the TFG had a significantly lower dietary intake of several vitamins and minerals compared to the MRG and was at greater risk for inadequate intake.</p> <p>Conclusion</p> <p>In this one-year university-based intervention, both dietitian-led groups successfully lost weight while improving overall dietary adequacy. The group incorporating fortified meal replacements tended to have a more adequate essential nutrient intake compared to the group following a more traditional food group diet. This study supports the need to incorporate fortified foods and/or dietary supplements while following an energy-restricted diet for weight loss.</p

Protein-enriched meal replacements do not adversely affect liver, kidney or bone density: an outpatient randomized controlled trial

<p>Abstract</p> <p>Background</p> <p>There is concern that recommending protein-enriched meal replacements as part of a weight management program could lead to changes in biomarkers of liver or renal function and reductions in bone density. This study was designed as a placebo-controlled clinical trial utilizing two isocaloric meal plans utilizing either a high protein-enriched (HP) or a standard protein (SP) meal replacement in an outpatient weight loss program.</p> <p>Subjects/methods</p> <p>100 obese men and women over 30 years of age with a body mass index (BMI) between 27 to 40 kg/m²were randomized to one of two isocaloric weight loss meal plans 1). HP group: providing 2.2 g protein/kg of lean body mass (LBM)/day or 2). SP group: providing 1.1 g protein/kg LBM/day. Meal replacement (MR) was used twice daily (one meal, one snack) for 3 months and then once a day for 9 months. Body weight, lipid profiles, liver function, renal function and bone density were measured at baseline and 12 months.</p> <p>Results</p> <p>Seventy subjects completed the study. Both groups lost weight (HP -4.29 ± 5.90 kg vs. SP -4.66 ± 6.91 kg, p < 0.01) and there was no difference in weight loss observed between the groups at one year. There was no significant change noted in liver function [AST (HP -2.07 ± 10.32 U/L, p = 0.28; SP 0.27 ± 6.67 U/L, p = 0.820), ALT (HP -1.03 ± 10.08 U/L, p = 0.34; SP -2.6 ± 12.51 U/L, p = 0.24), bilirubin (HP 0.007 ± 0.33, U/L, p = 0.91; SP 0.07 ± 0.24 U/L, p = 0.120), alkaline phosphatase (HP 2.00 ± 9.07 U/L, p = 0.240; SP -2.12 ± 11.01 U/L, p = 0.280)], renal function [serum creatinine (HP 0.31 ± 1.89 mg/dL, p = 0.380; SP -0.05 ± 0.15 mg/dL, p = 0.060), urea nitrogen (HP 1.33 ± 4.68 mg/dL, p = 0.130; SP -0.24 ± 3.03 mg/dL, p = 0.650), 24 hour urine creatinine clearance (HP -0.02 ± 0.16 mL/min, p = 0.480; SP 1.18 ± 7.53 mL/min, p = 0.400), and calcium excretion (HP -0.41 ± 9.48 mg/24 hours, p = 0.830; SP -0.007 ± 6.76 mg/24 hours, p = 0.990)] or in bone mineral density by DEXA (HP 0.04 ± 0.19 g/cm², p = 0.210; SP -0.03 ± 0.17 g/cm², p = 0.320) in either group over one year.</p> <p>Conclusions</p> <p>These studies demonstrate that protein-enriched meals replacements as compared to standard meal replacements recommended for weight management do not have adverse effects on routine measures of liver function, renal function or bone density at one year. Clinicaltrial.gov: NCT01030354.</p

Obesity: An overview on its current perspectives and treatment options

Obesity is a multi-factorial disorder, which is often associated with many other significant diseases such as diabetes, hypertension and other cardiovascular diseases, osteoarthritis and certain cancers. The management of obesity will therefore require a comprehensive range of strategies focussing on those with existing weight problems and also on those at high risk of developing obesity. Hence, prevention of obesity during childhood should be considered a priority, as there is a risk of persistence to adulthood. This article highlights various preventive aspects and treatment procedures of obesity with special emphasis on the latest research manifolds