Limitations of Information-Theoretic Generalization Bounds for Gradient Descent Methods in Stochastic Convex Optimization

To date, no "information-theoretic" frameworks for reasoning about generalization error have been shown to establish minimax rates for gradient descent in the setting of stochastic convex optimization. In this work, we consider the prospect of establishing such rates via several existing information-theoretic frameworks: input-output mutual information bounds, conditional mutual information bounds and variants, PAC-Bayes bounds, and recent conditional variants thereof. We prove that none of these bounds are able to establish minimax rates. We then consider a common tactic employed in studying gradient methods, whereby the final iterate is corrupted by Gaussian noise, producing a noisy "surrogate" algorithm. We prove that minimax rates cannot be established via the analysis of such surrogates. Our results suggest that new ideas are required to analyze gradient descent using information-theoretic techniques.Comment: 49 pages, 2 figures. To appear, Proc. International Conference on Algorithmic Learning Theory (ALT), 202

What "best practice" could be in Palliative Care: an analysis of statements on practice and ethics expressed by the main Health Organizations

<p>Abstract</p> <p>Background</p> <p>In palliative care it would be necessary to refer to a model. Nevertheless it seems that there are no official statements which state and describe that model. We carried out an analysis of the statements on practice and ethics of palliative care expressed by the main health organizations to show which dimensions of end-of-life care are taken into consideration.</p> <p>Methods</p> <p>The official documents by the most representative health organisations committed to the definition of policies and guidelines for palliative and end-of-life care had been considered. The documents were analysed through a framework of the components of end-of-life care derived from literature, which was composed of 4 main "areas" and of 12 "sub-areas".</p> <p>Results</p> <p>Overall, 34 organizations were identified, 7 international organisations, and 27 organisations operating on the national level in four different countries (Australia, Canada, UK and United States). Up to 56 documents were selected and analysed. Most of them (38) are position statements. Relevant quotations from the documents were presented by "areas" and "sub-areas". In general, the "sub-areas" of symptoms control as well as those referring to relational and social issues are more widely covered by the documents than the "sub-areas" related to "preparation" and to "existential condition". Indeed, the consistency of end-of-life choices with the patient's wishes, as well as completion and meaningfulness at the end of life is given only a minor relevance.</p> <p>Conclusions</p> <p>An integrated model of the best palliative care practice is generally lacking in the documents. It might be argued that the lack of a fixed and coherent model is due to the relevance of unavoidable context issues in palliative care, such as specific cultural settings, patient-centred variables, and family specificity. The implication is that palliative care staff have continuously to adapt their model of caring to the specific needs and values of each patient, more than applying a fixed, although maybe comprehensive, care model.</p

Neighborhood and weight-related health behaviors in the Look AHEAD (Action for Health in Diabetes) Study

<p>Abstract</p> <p>Background</p> <p>Previous studies have shown that neighborhood factors are associated with obesity, but few studies have evaluated the association with weight control behaviors. This study aims to conduct a multi-level analysis to examine the relationship between neighborhood SES and weight-related health behaviors.</p> <p>Methods</p> <p>In this ancillary study to Look AHEAD (Action for Health in Diabetes) a trial of long-term weight loss among individuals with type 2 diabetes, individual-level data on 1219 participants from 4 clinic sites at baseline were linked to neighborhood-level data at the tract level from the 2000 US Census and other databases. Neighborhood variables included SES (% living below the federal poverty level) and the availability of food stores, convenience stores, and restaurants. Dependent variables included BMI, eating patterns, weight control behaviors and resource use related to food and physical activity. Multi-level models were used to account for individual-level SES and potential confounders.</p> <p>Results</p> <p>The availability of restaurants was related to several eating and weight control behaviors. Compared to their counterparts in neighborhoods with fewer restaurants, participants in neighborhoods with more restaurants were more likely to eat breakfast (prevalence Ratio [PR] 1.29 95% CI: 1.01-1.62) and lunch (PR = 1.19, 1.04-1.36) at non-fast food restaurants. They were less likely to be attempting weight loss (OR = 0.93, 0.89-0.97) but more likely to engage in weight control behaviors for food and physical activity, respectively, than those who lived in neighborhoods with fewer restaurants. In contrast, neighborhood SES had little association with weight control behaviors.</p> <p>Conclusion</p> <p>In this selected group of weight loss trial participants, restaurant availability was associated with some weight control practices, but neighborhood SES was not. Future studies should give attention to other populations and to evaluating various aspects of the physical and social environment with weight control practices.</p