2,201 research outputs found
Distributed Stochastic Market Clearing with High-Penetration Wind Power
Integrating renewable energy into the modern power grid requires
risk-cognizant dispatch of resources to account for the stochastic availability
of renewables. Toward this goal, day-ahead stochastic market clearing with
high-penetration wind energy is pursued in this paper based on the DC optimal
power flow (OPF). The objective is to minimize the social cost which consists
of conventional generation costs, end-user disutility, as well as a risk
measure of the system re-dispatching cost. Capitalizing on the conditional
value-at-risk (CVaR), the novel model is able to mitigate the potentially high
risk of the recourse actions to compensate wind forecast errors. The resulting
convex optimization task is tackled via a distribution-free sample average
based approximation to bypass the prohibitively complex high-dimensional
integration. Furthermore, to cope with possibly large-scale dispatchable loads,
a fast distributed solver is developed with guaranteed convergence using the
alternating direction method of multipliers (ADMM). Numerical results tested on
a modified benchmark system are reported to corroborate the merits of the novel
framework and proposed approaches.Comment: To appear in IEEE Transactions on Power Systems; 12 pages and 9
figure
Tailoring to the Tails: Risk Measures for Fine-Grained Tail Sensitivity
Expected risk minimization (ERM) is at the core of many machine learning
systems. This means that the risk inherent in a loss distribution is summarized
using a single number - its average. In this paper, we propose a general
approach to construct risk measures which exhibit a desired tail sensitivity
and may replace the expectation operator in ERM. Our method relies on the
specification of a reference distribution with a desired tail behaviour, which
is in a one-to-one correspondence to a coherent upper probability. Any risk
measure, which is compatible with this upper probability, displays a tail
sensitivity which is finely tuned to the reference distribution. As a concrete
example, we focus on divergence risk measures based on f-divergence ambiguity
sets, which are a widespread tool used to foster distributional robustness of
machine learning systems. For instance, we show how ambiguity sets based on the
Kullback-Leibler divergence are intricately tied to the class of subexponential
random variables. We elaborate the connection of divergence risk measures and
rearrangement invariant Banach norms.Comment: Made multiple minor edit
Risk-sensitive Inverse Reinforcement Learning via Semi- and Non-Parametric Methods
The literature on Inverse Reinforcement Learning (IRL) typically assumes that
humans take actions in order to minimize the expected value of a cost function,
i.e., that humans are risk neutral. Yet, in practice, humans are often far from
being risk neutral. To fill this gap, the objective of this paper is to devise
a framework for risk-sensitive IRL in order to explicitly account for a human's
risk sensitivity. To this end, we propose a flexible class of models based on
coherent risk measures, which allow us to capture an entire spectrum of risk
preferences from risk-neutral to worst-case. We propose efficient
non-parametric algorithms based on linear programming and semi-parametric
algorithms based on maximum likelihood for inferring a human's underlying risk
measure and cost function for a rich class of static and dynamic
decision-making settings. The resulting approach is demonstrated on a simulated
driving game with ten human participants. Our method is able to infer and mimic
a wide range of qualitatively different driving styles from highly risk-averse
to risk-neutral in a data-efficient manner. Moreover, comparisons of the
Risk-Sensitive (RS) IRL approach with a risk-neutral model show that the RS-IRL
framework more accurately captures observed participant behavior both
qualitatively and quantitatively, especially in scenarios where catastrophic
outcomes such as collisions can occur.Comment: Submitted to International Journal of Robotics Research; Revision 1:
(i) Clarified minor technical points; (ii) Revised proof for Theorem 3 to
hold under weaker assumptions; (iii) Added additional figures and expanded
discussions to improve readabilit
Risk measure changes and portfolio optimization theory
Imperial Users onl
Robust Estimation and Inference for Expected Shortfall Regression with Many Regressors
Expected Shortfall (ES), also known as superquantile or Conditional
Value-at-Risk, has been recognized as an important measure in risk analysis and
stochastic optimization, and is also finding applications beyond these areas.
In finance, it refers to the conditional expected return of an asset given that
the return is below some quantile of its distribution. In this paper, we
consider a recently proposed joint regression framework that simultaneously
models the quantile and the ES of a response variable given a set of
covariates, for which the state-of-the-art approach is based on minimizing a
joint loss function that is non-differentiable and non-convex. This inevitably
raises numerical challenges and limits its applicability for analyzing
large-scale data. Motivated by the idea of using Neyman-orthogonal scores to
reduce sensitivity with respect to nuisance parameters, we propose a
statistically robust (to highly skewed and heavy-tailed data) and
computationally efficient two-step procedure for fitting joint quantile and ES
regression models. With increasing covariate dimensions, we establish explicit
non-asymptotic bounds on estimation and Gaussian approximation errors, which
lay the foundation for statistical inference. Finally, we demonstrate through
numerical experiments and two data applications that our approach well balances
robustness, statistical, and numerical efficiencies for expected shortfall
regression
Optimizing the CVaR via Sampling
Conditional Value at Risk (CVaR) is a prominent risk measure that is being
used extensively in various domains. We develop a new formula for the gradient
of the CVaR in the form of a conditional expectation. Based on this formula, we
propose a novel sampling-based estimator for the CVaR gradient, in the spirit
of the likelihood-ratio method. We analyze the bias of the estimator, and prove
the convergence of a corresponding stochastic gradient descent algorithm to a
local CVaR optimum. Our method allows to consider CVaR optimization in new
domains. As an example, we consider a reinforcement learning application, and
learn a risk-sensitive controller for the game of Tetris.Comment: To appear in AAAI 201
Support Vector Regression Based GARCH Model with Application to Forecasting Volatility of Financial Returns
In recent years, support vector regression (SVR), a novel neural network (NN) technique, has been successfully used for financial forecasting. This paper deals with the application of SVR in volatility forecasting. Based on a recurrent SVR, a GARCH method is proposed and is compared with a moving average (MA), a recurrent NN and a parametric GACH in terms of their ability to forecast financial markets volatility. The real data in this study uses British Pound-US Dollar (GBP) daily exchange rates from July 2, 2003 to June 30, 2005 and New York Stock Exchange (NYSE) daily composite index from July 3, 2003 to June 30, 2005. The experiment shows that, under both varying and fixed forecasting schemes, the SVR-based GARCH outperforms the MA, the recurrent NN and the parametric GARCH based on the criteria of mean absolute error (MAE) and directional accuracy (DA). No structured way being available to choose the free parameters of SVR, the sensitivity of performance is also examined to the free parameters.recurrent support vector regression, GARCH model, volatility forecasting
- …