AReS and MaRS - Adversarial and MMD-Minimizing Regression for SDEs

Stochastic differential equations are an important modeling class in many disciplines. Consequently, there exist many methods relying on various discretization and numerical integration schemes. In this paper, we propose a novel, probabilistic model for estimating the drift and diffusion given noisy observations of the underlying stochastic system. Using state-of-the-art adversarial and moment matching inference techniques, we avoid the discretization schemes of classical approaches. This leads to significant improvements in parameter accuracy and robustness given random initial guesses. On four established benchmark systems, we compare the performance of our algorithms to state-of-the-art solutions based on extended Kalman filtering and Gaussian processes.Comment: Published at the Thirty-sixth International Conference on Machine Learning (ICML 2019

Distributional Gradient Matching for Learning Uncertain Neural Dynamics Models

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the adjoint method, many downstream tasks such as active learning, exploration in reinforcement learning, robust control, or filtering require accurate estimates of predictive uncertainties. In this work, we propose a novel approach towards estimating epistemically uncertain neural ODEs, avoiding the numerical integration bottleneck. Instead of modeling uncertainty in the ODE parameters, we directly model uncertainties in the state space. Our algorithm - distributional gradient matching (DGM) - jointly trains a smoother and a dynamics model and matches their gradients via minimizing a Wasserstein loss. Our experiments show that, compared to traditional approximate inference methods based on numerical integration, our approach is faster to train, faster at predicting previously unseen trajectories, and in the context of neural ODEs, significantly more accurate.Comment: Published at NeurIPS 202

Along the Spectrum of Women\u27s Rights Advocacy: A Cross-Cultural Comparison of Sexual Harassment Law in the United States and India

This Comment compares the development of sexual harassment law in the United States and India. It strives to contribute to this global feminist debate by highlighting the successes and failures of each country\u27s respective anti-harassment protections. It also compares the United States\u27 and India\u27s legal approaches to the problem of workplace sexual harassment. The Comment also discusses the successes and failures of the U.S. and Indian protections in a manner that attempts to minimize the problems present in cross-cultural studies

Mutual care taking: collectively creating our respiratory wellbeing with open sciences

Background: Worldwide, 6 people out of 10 have no access to treatment, or are not encouraged to follow it. Air pollution alone kills 7 million people yearly, reduces our life expectancy by 20 months, and costs 6% the gross world product. Devices to assess lung capacity remain often unavailable in low / middle income countries. Actions: We co-create inclusive, open science knowledge: open source breath and air quality controllers, and libre / gratis education to reduce risks and make care fun. Learnings: Awareness: breath as a way to feel life, from childhood. Universal health: mutualizing resources to end poverty. Partnership: reducing barriers with remote participation

Setting priorities for land management to mitigate climate change

<p>Abstract</p> <p>Background</p> <p>No consensus has been reached how to measure the effectiveness of climate change mitigation in the land-use sector and how to prioritize land use accordingly. We used the long-term cumulative and average sectorial C stocks in biomass, soil and products, C stock changes, the substitution of fossil energy and of energy-intensive products, and net present value (NPV) as evaluation criteria for the effectiveness of a hectare of productive land to mitigate climate change and produce economic returns. We evaluated land management options using real-life data of Thuringia, a region representative for central-western European conditions, and input from life cycle assessment, with a carbon-tracking model. We focused on solid biomass use for energy production.</p> <p>Results</p> <p>In forestry, the traditional timber production was most economically viable and most climate-friendly due to an assumed recycling rate of 80% of wood products for bioenergy. Intensification towards "pure bioenergy production" would reduce the average sectorial C stocks and the C substitution and would turn NPV negative. In the forest conservation (non-use) option, the sectorial C stocks increased by 52% against timber production, which was not compensated by foregone wood products and C substitution. Among the cropland options wheat for food with straw use for energy, whole cereals for energy, and short rotation coppice for bioenergy the latter was most climate-friendly. However, specific subsidies or incentives for perennials would be needed to favour this option.</p> <p>Conclusions</p> <p>When using the harvested products as materials prior to energy use there is no climate argument to support intensification by switching from sawn-wood timber production towards energy-wood in forestry systems. A legal framework would be needed to ensure that harvested products are first used for raw materials prior to energy use. Only an effective recycling of biomaterials frees land for long-term sustained C sequestration by conservation. Reuse cascades avoid additional emissions from shifting production or intensification.</p

Adaptive Gaussian Process Change Point Detection

Detecting change points in time series, i.e., points in time at which some observed process suddenly changes, is a fundamental task that arises in many real-world applications, with consequences for safety and reliability. In this work, we propose ADAGA, a novel Gaussian process-based solution to this problem, that leverages a powerful heuristics we developed based on statistical hypothesis testing. In contrast to prior approaches, ADAGA adapts to changes both in mean and covariance structure of the temporal process. In extensive experiments, we show its versatility and applicability to different classes of change points, demonstrating that it is significantly more accurate than current state-of-the-art alternatives.ISSN:2640-349

Learning Stable Deep Dynamics Models for Partially Observed or Delayed Dynamical Systems

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end, neural ODEs regularized with neural Lyapunov functions are a promising approach when states are fully observed. For practical applications however, {\em partial observations} are the norm. As we will demonstrate, initialization of unobserved augmented states can become a key problem for neural ODEs. To alleviate this issue, we propose to augment the system's state with its history. Inspired by state augmentation in discrete-time systems, we thus obtain {\em neural delay differential equations}. Based on classical time delay stability analysis, we then show how to ensure stability of the learned models, and theoretically analyze our approach. Our experiments demonstrate its applicability to stable system identification of partially observed systems and learning a stabilizing feedback policy in delayed feedback control

AReS and MaRS Adversarial and MMD-Minimizing Regression for SDEs

ISSN:2640-349