Adaptive Poisson disorder problem

We study the quickest detection problem of a sudden change in the arrival rate of a Poisson process from a known value to an unknown and unobservable value at an unknown and unobservable disorder time. Our objective is to design an alarm time which is adapted to the history of the arrival process and detects the disorder time as soon as possible. In previous solvable versions of the Poisson disorder problem, the arrival rate after the disorder has been assumed a known constant. In reality, however, we may at most have some prior information about the likely values of the new arrival rate before the disorder actually happens, and insufficient estimates of the new rate after the disorder happens. Consequently, we assume in this paper that the new arrival rate after the disorder is a random variable. The detection problem is shown to admit a finite-dimensional Markovian sufficient statistic, if the new rate has a discrete distribution with finitely many atoms. Furthermore, the detection problem is cast as a discounted optimal stopping problem with running cost for a finite-dimensional piecewise-deterministic Markov process. This optimal stopping problem is studied in detail in the special case where the new arrival rate has Bernoulli distribution. This is a nontrivial optimal stopping problem for a two-dimensional piecewise-deterministic Markov process driven by the same point process. Using a suitable single-jump operator, we solve it fully, describe the analytic properties of the value function and the stopping region, and present methods for their numerical calculation. We provide a concrete example where the value function does not satisfy the smooth-fit principle on a proper subset of the connected, continuously differentiable optimal stopping boundary, whereas it does on the complement of this set.Comment: Published at http://dx.doi.org/10.1214/105051606000000312 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org

Bayesian sequential change diagnosis

Sequential change diagnosis is the joint problem of detection and identification of a sudden and unobservable change in the distribution of a random sequence. In this problem, the common probability law of a sequence of i.i.d. random variables suddenly changes at some disorder time to one of finitely many alternatives. This disorder time marks the start of a new regime, whose fingerprint is the new law of observations. Both the disorder time and the identity of the new regime are unknown and unobservable. The objective is to detect the regime-change as soon as possible, and, at the same time, to determine its identity as accurately as possible. Prompt and correct diagnosis is crucial for quick execution of the most appropriate measures in response to the new regime, as in fault detection and isolation in industrial processes, and target detection and identification in national defense. The problem is formulated in a Bayesian framework. An optimal sequential decision strategy is found, and an accurate numerical scheme is described for its implementation. Geometrical properties of the optimal strategy are illustrated via numerical examples. The traditional problems of Bayesian change-detection and Bayesian sequential multi-hypothesis testing are solved as special cases. In addition, a solution is obtained for the problem of detection and identification of component failure(s) in a system with suspended animation

Multisource Bayesian sequential change detection

Suppose that local characteristics of several independent compound Poisson and Wiener processes change suddenly and simultaneously at some unobservable disorder time. The problem is to detect the disorder time as quickly as possible after it happens and minimize the rate of false alarms at the same time. These problems arise, for example, from managing product quality in manufacturing systems and preventing the spread of infectious diseases. The promptness and accuracy of detection rules improve greatly if multiple independent information sources are available. Earlier work on sequential change detection in continuous time does not provide optimal rules for situations in which several marked count data and continuously changing signals are simultaneously observable. In this paper, optimal Bayesian sequential detection rules are developed for such problems when the marked count data is in the form of independent compound Poisson processes, and the continuously changing signals form a multi-dimensional Wiener process. An auxiliary optimal stopping problem for a jump-diffusion process is solved by transforming it first into a sequence of optimal stopping problems for a pure diffusion by means of a jump operator. This method is new and can be very useful in other applications as well, because it allows the use of the powerful optimal stopping theory for diffusions.Comment: Published in at http://dx.doi.org/10.1214/07-AAP463 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org

Sequential Detection and Identification of a Change in the Distribution of a Markov-Modulated Random Sequence

The problem of detection and identification of an unobservable change in the distribution of a random sequence is studied via a hidden Markov model (HMM) approach. The formulation is Bayesian, on-line, discrete-time, allowing both single- and multiple- disorder cases, dealing with both independent and identically distributed (i.i.d.) and dependent observations scenarios, allowing for statistical dependencies between the change-time and change-type in both the observation sequence and the risk structure, and allowing for general discrete-time disorder distributions. Several of these factors provide useful new generalizations of the sequential analysis theory for change detection and/or hypothesis testing, taken individually. In this paper, a unifying framework is provided that handles each of these considerations not only individually, but also concurrently. Optimality results and optimal decision characterizations are given as well as detailed examples that illustrate the myriad of sequential change detection and identification problems that fall within this new framework

OPTIMAL STOPPING PROBLEMS FOR ASSET MANAGEMENT

Abstract. An asset manager invests the savings of some investors in a portfolio of defaultable bonds. The manager pays the investors coupons at a constant rate and receives management fee proportional to the value of portfolio. She also has the right to walk out of the contract at any time with the net terminal value of the portfolio after the payment of investors ’ initial funds, but is not responsible for any deficit. To control the principal losses, investors may buy from the manager a limited protection which terminates the agreement as soon as the value of the portfolio drops below a predetermined threshold. We assume that the value of the portfolio is a jump-diffusion process and find optimal termination rule of the manager with and without a protection. We also derive the indifference price of a limited protection. We describe numerical algorithms to calculate expected maximum reward and nearly optimal terminal rules for the asset manager and illustrate them on an example. The motivation comes from the collateralized debt obligations. 1

On the optimal stopping problem for one-dimensional diffusions

A new characterization of excessive functions for arbitrary one-dimensional regular diffusion processes is provided, using the notion of concavity. It is shown that excessivity is equivalent to concavity in some suitable generalized sense. This permits a characterization of the value function of the optimal stopping problem as "the smallest nonnegative concave majorant of the reward function" and allows us to generalize results of Dynkin and Yushkevich for standard Brownian motion. Moreover, we show how to reduce the discounted optimal stopping problems for an arbitrary diffusion process to an undiscounted optimal stopping problem for standard Brownian motion. The concavity of the value functions also leads to conclusions about their smoothness, thanks to the properties of concave functions. One is thus led to a new perspective and new facts about the principle of smooth-fit in the context of optimal stopping. The results are illustrated in detail on a number of non-trivial, concrete optimal stopping problems, both old and new.Optimal stopping Diffusions Principle of smooth-fit Convexity