Average Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a general Borel space and with compact action space depending on the state variable. The control variable acts on the jump rate and transition measure of the PDMP, and the running and boundary costs are assumed to be positive but not necessarily bounded. Our first main result is to obtain an optimality equation for the long run average cost in terms of a discrete-time optimality equation related to the embedded Markov chain given by the post-jump location of the PDMP. Our second main result guarantees the existence of a feedback measurable selector for the discrete-time optimality equation by establishing a connection between this equation and an integro-differential equation. Our final main result is to obtain some sufficient conditions for the existence of a solution for a discrete-time optimality inequality and an ordinary optimal feedback control for the long run average cost using the so-called vanishing discount approach.Comment: 34 page

Geometrical Considerations for the Design of Liquid-phase Biochemical Sensors Using a Cantilever\u27s Fundamental In-plane Mode

The influence of the beam geometry on the quality factor and resonance frequency of resonant silicon cantilever beams vibrating in their fundamental in-plane flexural mode in water has been investigated. Compared to cantilevers vibrating in their first out-of-plane flexural mode, utilizing the in-plane mode results in reduced damping and reduced mass loading by the surrounding fluid. Quality factors as high as 86 have been measured in water for cantilevers with a 20 μm thick silicon layer. Based on the experimental data, design guidelines are established for beam dimensions that ensure maximal Q-factors and minimal mass loading by the surrounding fluid, thus improving the limit-of-detection of mass-sensitive biochemical sensors. Elementary theory is also presented to help explain the observed trends. Additional discussion focuses on the tradeoffs that exist in designing liquid-phase biochemical sensors using in-plane cantilevers

Constrained and Unconstrained Optimal Discounted Control of Piecewise Deterministic Markov Processes

International audienceThe main goal of this paper is to study the infinite-horizon expected discounted continuous-time optimal control problem of piecewise deterministic Markov processes with the control acting continuously on the jump intensity $\lambda$ and on the transition measure $Q$ of the process but not on the deterministic flow $\phi$. The contributions of the paper are for the unconstrained as well as the constrained cases. The set of admissible control strategies is assumed to be formed by policies, possibly randomized and depending on the history of the process, taking values in a set valued action space. For the unconstrained case we provide sufficient conditions based on the three local characteristics of the process $\phi$, $\lambda$, $Q$ and the semicontinuity properties of the set valued action space, to guarantee the existence and uniqueness of the integro-differential optimality equation (the so-called Bellman--Hamilton--Jacobi equation) as well as the existence of an optimal (and $\delta$-optimal, as well) deterministic stationary control strategy for the problem. For the constrained case we show that the values of the constrained control problem and an associated infinite dimensional linear programming (LP) problem are the same, and moreover we provide sufficient conditions for the solvability of the LP problem as well as for the existence of an optimal feasible randomized stationary control strategy for the constrained problem

Unconventional Uses of Microcantilevers as Chemical Sensors in Gas and Liquid Media

The use of microcantilevers as (bio)chemical sensors usually involves the application of a chemically sensitive layer. The coated device operates either in a static bending regime or in a dynamic flexural mode. While some of these coated devices may be operated successfully in both the static and the dynamic modes, others may suffer from certain shortcomings depending on the type of coating, the medium of operation and the sensing application. Such shortcomings include lack of selectivity and reversibility of the sensitive coating and a reduced quality factor due to the surrounding medium. In particular, the performance of microcantilevers excited in their standard out-of-plane dynamic mode drastically decreases in viscous liquid media. Moreover, the responses of coated cantilevers operating in the static bending mode are often difficult to interpret. To resolve these performance issues, the following emerging unconventional uses of microcantilevers are reviewed in this paper: (1) dynamic-mode operation without using a sensitive coating, (2) the use of in-plane vibration modes (both flexural and longitudinal) in liquid media, and (3) incorporation of viscoelastic effects in the coatings in the static mode of operation. The advantages and drawbacks of these atypical uses of microcantilevers for chemical sensing in gas and liquid environments are discussed

Pulsation in carbon-atmosphere white dwarfs: A new chapter in white dwarf asteroseismology

We present some of the results of a survey aimed at exploring the asteroseismological potential of the newly-discovered carbon-atmosphere white dwarfs. We show that, in certains regions of parameter space, carbon-atmosphere white dwarfs may drive low-order gravity modes. We demonstrate that our theoretical results are consistent with the recent exciting discovery of luminosity variations in SDSS J1426+5752 and some null results obtained by a team of scientists at McDonald Observatory. We also present follow-up photometric observations carried out by ourselves at the Mount Bigelow 1.6-m telescope using the new Mont4K camera. The results of follow-up spectroscopic observations at the MMT are also briefly reported, including the surprising discovery that SDSS J1426+5752 is not only a pulsating star but that it is also a magnetic white dwarf with a surface field near 1.2 MG. The discovery of $g$-mode pulsations in SDSS J1426+5752 is quite significant in itself as it opens a fourth asteroseismological "window", after the GW Vir, V777 Her, and ZZ Ceti families, through which one may study white dwarfs.Comment: 7 pages, 4 figures, to appear in Journal of Physics Conference Proceedings for the 16th European White Dwarf Worksho