Characterization and computation of restless bandit marginal productivity indices

The Whittle index [P. Whittle (1988). Restless bandits: Activity allocation in a changing world. J. Appl. Probab. 25A, 287-298] yields a practical scheduling rule for the versatile yet intractable multi-armed restless bandit problem, involving the optimal dynamic priority allocation to multiple stochastic projects, modeled as restless bandits, i.e., binary-action (active/passive) (semi-) Markov decision processes. A growing body of evidence shows that such a rule is nearly optimal in a wide variety of applications, which raises the need to efficiently compute the Whittle index and more general marginal productivity index (MPI) extensions in large-scale models. For such a purpose, this paper extends to restless bandits the parametric linear programming (LP) approach deployed in [J. Niño-Mora. A (2/3)$n^{3}$ fast-pivoting algorithm for the Gittins index and optimal stopping of a Markov chain, INFORMS J. Comp., in press], which yielded a fast Gittins-index algorithm. Yet the extension is not straightforward, as the MPI is only defined for the limited range of socalled indexable bandits, which motivates the quest for methods to establish indexability. This paper furnishes algorithmic and analytical tools to realize the potential of MPI policies in largescale applications, presenting the following contributions: (i) a complete algorithmic characterization of indexability, for which two block implementations are given; and (ii) more importantly, new analytical conditions for indexability — termed LP-indexability — that leverage knowledge on the structure of optimal policies in particular models, under which the MPI is computed faster by the adaptive-greedy algorithm previously introduced by the author under the more stringent PCL-indexability conditions, for which a new fast-pivoting block implementation is given. The paper further reports on a computational study, measuring the runtime performance of the algorithms, and assessing by a simulation study the high prevalence of indexability and PCL-indexability.

Fluctuations and shape of cooperative rearranging regions in glass-forming liquids

We develop a theory of amorphous interfaces in glass-forming liquids. We show that the statistical properties of these surfaces, which separate regions characterized by different amorphous arrangements of particles, coincide with the ones of domain walls in the random field Ising model. A major consequence of our results is that supercooled liquids are characterized by two different static lengths: the point-to-set ξPS, which is a measure of the spatial extent of cooperative rearranging regions, and the wandering length ξ⊥, which is related to the fluctuations of their shape. We find that ξ⊥ grows when approaching the glass transition but slower than ξPS. The wandering length increases as s−1/2c, where sc is the configurational entropy. Our results strengthen the relationship with the random field Ising model found in recent works. They are in agreement with previous numerical studies of amorphous interfaces and provide a theoretical framework for explaining numerical and experimental findings on pinned particle systems and static lengths in glass-forming liquids

Soluzioni esercizi simulazione. Aggiornate al 9.12.15

Aggiornate al 9.12.1

A trajectory computation algorithm for adaptive aircraft descents considering altitude and speed restrictions

The main objective of this final degree project is to enhance the maturity level of the trajectory simulation software suite developed by the Icarus UPC research group. Consequently, the advancements made in this project aim to adapt the software to provide a more realistic interpretation of the simulation scenarios and, therefore, yield more accurate and faithful results, compliant with real flight operations. To accomplish this objective, the planning and design of a novel functionality are undertaken. This report begins by describing the conception of the implementation within an aeronautical context, thereby establishing the guidelines to fulfill the requirements of the software upgrade. Additionally, the report provides a comprehensive outline of the implementation's architecture, along with a detailed explanation of the operational aspects of the various logical blocks that conform the functionality. This initial section of the report further describes the integration of this implementation within the main software architecture. Afterwards, this report provides details regarding the verification process conducted to ensure the proper operation of the logic. This process encompasses the planning of a particularly interesting scenario, comprising various sub-cases in which the implementation is thoroughly tested. Moreover, the results produced by the software are meticulously analyzed and conclusions about the applied logic are drawn. In addition to the previous verification, another validation process of a more realistic situation is presented. This procedure allows for a meticulous examination of the system's performance and effectiveness within a real-world application scenario. Finally, the results are subjected to an in-depth analysis. This detailed study provides a deeper understanding of the outcomes, yielding valuable insights and potential improvements for the future development of the software

FINDS: A fault inferring nonlinear detection system. User's guide

The computer program FINDS is written in FORTRAN-77, and is intended for operation on a VAX 11-780 or 11-750 super minicomputer, using the VMS operating system. The program detects, isolates, and compensates for failures in navigation aid instruments and onboard flight control and navigation sensors of a Terminal Configured Vehicle aircraft in a Microwave Landing System environment. In addition, FINDS provides sensor fault tolerant estimates for the aircraft states which are then used by an automatic guidance and control system to land the aircraft along a prescribed path. FINDS monitors for failures by evaluating all sensor outputs simultaneously using the nonlinear analytic relationships between the various sensor outputs arising from the aircraft point mass equations of motion. Hence, FINDS is an integrated sensor failure detection and isolation system

The Hills Fuel Poverty Review Interim Report: assessing proposals and implications

The Hills Fuel Poverty Review has been commissioned by the United Kingdom coalition government to review the definition and targets used to guide the alleviation of fuel poverty in England, as mandated by the Warm Homes and Energy Conservation Act 2000. The interim report was published on 19 October 2011 and addressed questions relating to the definition and measurement of fuel poverty. The final report, due in early 2012, will make further recommendations as to appropriate policy responses. This paper reviews the interim report, placing proposals within the context of the ongoing debate around fuel poverty and its alleviation, and offering commentary as to the implications for policy

Tachykinin receptor 3 in the lateral habenula alleviates pain and anxiety comorbidity in mice

The coexistence of chronic pain and anxiety is a common clinical phenomenon. Here, the role of tachykinin receptor 3 (NK3R) in the lateral habenula (LHb) in trigeminal neuralgia and in pain-associated anxiety was systematically investigated. First, electrophysiological recording showed that bilateral LHb neurons are hyperactive in a mouse model of trigeminal neuralgia made by partial transection of the infraorbital nerve (pT-ION). Chemicogenetic activation of bilateral LHb glutamatergic neurons in naive mice induced orofacial allodynia and anxiety-like behaviors, and pharmacological activation of NK3R in the LHb attenuated allodynia and anxiety-like behaviors induced by pT-ION. Electrophysiological recording showed that pharmacological activation of NK3R suppressed the abnormal excitation of LHb neurons. In parallel, pharmacological inhibition of NK3R induced orofacial allodynia and anxiety-like behavior in naive mice. The electrophysiological recording showed that pharmacological inhibition of NK3R activates LHb neurons. Neurokinin B (NKB) is an endogenous high-affinity ligand of NK3R, which binds NK3R and activates it to perform physiological functions, and further neuron projection tracing showed that the front section of the periaqueductal gray (fPAG) projects NKB-positive nerve fibers to the LHb. Optogenetics combined with electrophysiology recordings characterize the functional connections in this fPAG NKB → LHb pathway. In addition, electrophysiological recording showed that NKB-positive neurons in the fPAG were more active than NKB-negative neurons in pT-ION mice. Finally, inhibition of NKB release from the fPAG reversed the analgesic and anxiolytic effects of LHb Tacr3 overexpression in pT-ION mice, indicating that fPAG NKB → LHb regulates orofacial allodynia and pain-induced anxious behaviors. These findings for NK3R suggest the cellular mechanism behind pT-ION in the LHb and suggest that the fPAG NKB → LHb circuit is involved in pain and anxiety comorbidity. This previously unrecognized pathway might provide a potential approach for relieving the pain and anxiety associated with trigeminal neuralgia by targeting NK3R