Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems

Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge, weakening theoretical guarantees and causing implementation failures on physical systems. This paper develops a machine learning framework centered around Control Lyapunov Functions (CLFs) to adapt to parametric uncertainty and unmodeled dynamics in general robotic systems. Our proposed method proceeds by iteratively updating estimates of Lyapunov function derivatives and improving controllers, ultimately yielding a stabilizing quadratic program model-based controller. We validate our approach on a planar Segway simulation, demonstrating substantial performance improvements by iteratively refining on a base model-free controller

Towards Robust Data-Driven Control Synthesis for Nonlinear Systems with Actuation Uncertainty

Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model uncertainty using Control Certificate Functions (CCFs), resulting in a convex optimization based controller for achieving properties like stability and safety. An important benefit of our framework is nuanced data-dependent guarantees, which in principle can yield sample-efficient data collection approaches that need not fully determine the input-to-state relationship. This work serves as a starting point for addressing important questions at the intersection of nonlinear control theory and non-parametric learning, both theoretical and in application. We validate the proposed method in simulation with an inverted pendulum in multiple experimental configurations

A Control Lyapunov Perspective on Episodic Learning via Projection to State Stability

The goal of this paper is to understand the impact of learning on control synthesis from a Lyapunov function perspective. In particular, rather than consider uncertainties in the full system dynamics, we employ Control Lyapunov Functions (CLFs) as low-dimensional projections. To understand and characterize the uncertainty that these projected dynamics introduce in the system, we introduce a new notion: Projection to State Stability (PSS). PSS can be viewed as a variant of Input to State Stability defined on projected dynamics, and enables characterizing robustness of a CLF with respect to the data used to learn system uncertainties. We use PSS to bound uncertainty in affine control, and demonstrate that a practical episodic learning approach can use PSS to characterize uncertainty in the CLF for robust control synthesis

Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems

Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge, weakening theoretical guarantees and causing implementation failures on physical systems. This paper develops a machine learning framework centered around Control Lyapunov Functions (CLFs) to adapt to parametric uncertainty and unmodeled dynamics in general robotic systems. Our proposed method proceeds by iteratively updating estimates of Lyapunov function derivatives and improving controllers, ultimately yielding a stabilizing quadratic program model-based controller. We validate our approach on a planar Segway simulation, demonstrating substantial performance improvements by iteratively refining on a base model-free controller

A Control Lyapunov Perspective on Episodic Learning via Projection to State Stability

The goal of this paper is to understand the impact of learning on control synthesis from a Lyapunov function perspective. In particular, rather than consider uncertainties in the full system dynamics, we employ Control Lyapunov Functions (CLFs) as low-dimensional projections. To understand and characterize the uncertainty that these projected dynamics introduce in the system, we introduce a new notion: Projection to State Stability (PSS). PSS can be viewed as a variant of Input to State Stability defined on projected dynamics, and enables characterizing robustness of a CLF with respect to the data used to learn system uncertainties. We use PSS to bound uncertainty in affine control, and demonstrate that a practical episodic learning approach can use PSS to characterize uncertainty in the CLF for robust control synthesis

Effect of aliskiren on post-discharge outcomes among diabetic and non-diabetic patients hospitalized for heart failure: insights from the ASTRONAUT trial

Aims The objective of the Aliskiren Trial on Acute Heart Failure Outcomes (ASTRONAUT) was to determine whether aliskiren, a direct renin inhibitor, would improve post-discharge outcomes in patients with hospitalization for heart failure (HHF) with reduced ejection fraction. Pre-specified subgroup analyses suggested potential heterogeneity in post-discharge outcomes with aliskiren in patients with and without baseline diabetes mellitus (DM). Methods and results ASTRONAUT included 953 patients without DM (aliskiren 489; placebo 464) and 662 patients with DM (aliskiren 319; placebo 343) (as reported by study investigators). Study endpoints included the first occurrence of cardiovascular death or HHF within 6 and 12 months, all-cause death within 6 and 12 months, and change from baseline in N-terminal pro-B-type natriuretic peptide (NT-proBNP) at 1, 6, and 12 months. Data regarding risk of hyperkalaemia, renal impairment, and hypotension, and changes in additional serum biomarkers were collected. The effect of aliskiren on cardiovascular death or HHF within 6 months (primary endpoint) did not significantly differ by baseline DM status (P = 0.08 for interaction), but reached statistical significance at 12 months (non-DM: HR: 0.80, 95% CI: 0.64-0.99; DM: HR: 1.16, 95% CI: 0.91-1.47; P = 0.03 for interaction). Risk of 12-month all-cause death with aliskiren significantly differed by the presence of baseline DM (non-DM: HR: 0.69, 95% CI: 0.50-0.94; DM: HR: 1.64, 95% CI: 1.15-2.33; P < 0.01 for interaction). Among non-diabetics, aliskiren significantly reduced NT-proBNP through 6 months and plasma troponin I and aldosterone through 12 months, as compared to placebo. Among diabetic patients, aliskiren reduced plasma troponin I and aldosterone relative to placebo through 1 month only. There was a trend towards differing risk of post-baseline potassium ≥6 mmol/L with aliskiren by underlying DM status (non-DM: HR: 1.17, 95% CI: 0.71-1.93; DM: HR: 2.39, 95% CI: 1.30-4.42; P = 0.07 for interaction). Conclusion This pre-specified subgroup analysis from the ASTRONAUT trial generates the hypothesis that the addition of aliskiren to standard HHF therapy in non-diabetic patients is generally well-tolerated and improves post-discharge outcomes and biomarker profiles. In contrast, diabetic patients receiving aliskiren appear to have worse post-discharge outcomes. Future prospective investigations are needed to confirm potential benefits of renin inhibition in a large cohort of HHF patients without D

Global variation in diabetes diagnosis and prevalence based on fasting glucose and hemoglobin A1c

Fasting plasma glucose (FPG) and hemoglobin A1c (HbA1c) are both used to diagnose diabetes, but these measurements can identify different people as having diabetes. We used data from 117 population-based studies and quantified, in different world regions, the prevalence of diagnosed diabetes, and whether those who were previously undiagnosed and detected as having diabetes in survey screening, had elevated FPG, HbA1c or both. We developed prediction equations for estimating the probability that a person without previously diagnosed diabetes, and at a specific level of FPG, had elevated HbA1c, and vice versa. The age-standardized proportion of diabetes that was previously undiagnosed and detected in survey screening ranged from 30% in the high-income western region to 66% in south Asia. Among those with screen-detected diabetes with either test, the age-standardized proportion who had elevated levels of both FPG and HbA1c was 29-39% across regions; the remainder had discordant elevation of FPG or HbA1c. In most low- and middle-income regions, isolated elevated HbA1c was more common than isolated elevated FPG. In these regions, the use of FPG alone may delay diabetes diagnosis and underestimate diabetes prevalence. Our prediction equations help allocate finite resources for measuring HbA1c to reduce the global shortfall in diabetes diagnosis and surveillance