Stellar winds in M-type AGB stars: the role of dust grains and pulsation Venti stellari in stelle AGB di tipo M: ruolo dei grani di polvere e della pulsazione

It is a matter of fact that stars are subject to mass loss events which may be periodic, semi-periodic or episodic and can vary from insignificant to massive. A quantitative description of this phenomenon is necessary to assemble an accurate model for the evolution of stars and galaxies. Such description requires realistic dynamical models that follow the flow of stellar matter from the atmosphere through the wind acceleration zone into the circumstellar region. Three main aspects characterize the mass loss phenomenon in asymptotic giant branch stars: long-period pulsations with the production and propagation of shock-waves through the atmosphere; dust formation in the region where the temperature is low enough for the formation of grains; momentum transfer from the radiation field to the dust particles together with dust-gas and gas-gas collision. In the first chapter I present a short review of the evolution of stars up to the AGB phase and the main events that are typical of that stage of evolution. In the second chapter the topic of dust driven stellar winds is introduced from a general point of view through the analysis of the fundamental mechanisms at the base of wind formation. Finally, in the third chapter I discuss the problem of driving a dusty wind in an M-type star. Oxides and pure silicates have low opacities in the relevant spectral region while dirty silicates, which should be good candidates due to their high opacity, can form only at large distances from the star. I also highlight a recently proposed solution that invokes scattering on large dust grains (with sizes of a few tenths of a micron) and an interesting argument based on the hypothesis that the process of chemisputtering may be negligible in the atmospheres of AGB starsope

Exploring the direction on the environmental and business performance relationship at the firm level. Lessons from a literature review

The interest of scientists and companies in understanding the business implications of environmental investment is timely; however, a dilemma remains at the firm level: is the environment a “strategic competitive factor”, as in the “Porter point of view”, or is it a “luxury good”, as in the “Wagner point of view”? Our research contributes to this debate through a review of the papers published in scientific journals between 2000 and 2015 that discussed the direction of the relationship between the environmental and business performances of enterprises. The objectives of the research are: (a) to verify if there is an agreement in the scientific literature of the last 15 years about the “Porter–Wagner dilemma” when focusing at the firm level; (b) to underline the prevalent cause and effect directions of the relationship between environmental and business performance; and (c) to investigate the reasons for any disagreements in this topic among the scientists. The results show that the main agreement regards the positive bi-directional relationship, as a virtuous cyclic approach with mutual effects between business and environmental performance; nevertheless, more complex hypotheses emerge, such as nonlinear and/or conditional relationship, that need to be further explored. On the other hand, the Porter–Wagner dilemma remains, and the main reason for the non-agreement among scientists can be due to the several non-homogeneous variables considered in the analyses. Thereafter, as lesson for scientists, the priority is to share univocal methods to measure firms’ environmental and business performances

Rule-Based Policy Interpretation and Shielding for Partially Observable Monte Carlo Planning

Partially Observable Monte Carlo Planning (POMCP) is a powerful online algorithm that can generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by avoiding complete policy representation. However, the lack of an explicit representation of the policy hinders interpretability. In this thesis, we propose a methodology based on Maximum Satisfiability Modulo Theory (MAX-SMT) for analyzing POMCP policies by inspecting their traces, namely, sequences of belief-action pairs generated by the algorithm. The proposed method explores local properties of the policy to build a compact and informative summary of the policy behaviour. This representation exploits a high-level description encoded using logical formulas that domain experts can provide. The final formula can be used to identify unexpected decisions, namely, decisions that violate the expert indications. We show that this identification process can be used offline (to improve the explainability of the policy and to identify anomalous behaviours) or online (to shield the decisions of the POMCP algorithm). We also present an active methodology that can effectively query a POMCP policy to build more reliable descriptions quickly. We extensively evaluate our methodologies on two standard benchmarks for POMDPs, namely, emph{tiger} and emph{rocksample}, and on a problem related to velocity regulation in mobile robot navigation. Results show that our approach achieves good performance due to its capability to exploit experts' knowledge of the domains. Specifically, our approach can be used both to identify anomalous behaviours in faulty POMCPs and to improve the performance of the system by using the shielding mechanism. In the first case, we test the methodology against a state-of-the-art anomaly detection algorithm, while in the second, we compared the performance of shielded and unshielded POMCPs. We implemented our methodology in CC, and the code is open-source and available at href{https://github.com/GiuMaz/XPOMCP}{https://github.com/GiuMaz/XPOMCP}

Risk-aware shielding of Partially Observable Monte Carlo Planning policies

Partially Observable Monte Carlo Planning (POMCP) is a powerful online algorithm that can generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by avoiding complete policy representation. However, the lack of an explicit policy representation hinders interpretability and a proper evaluation of the risks an agent may incur. In this work, we propose a methodology based on Maximum Satisfiability Modulo Theory (MAX-SMT) for analyzing POMCP policies by inspecting their traces, namely, sequences of belief- action pairs generated by the algorithm. The proposed method explores local properties of the policy to build a compact and informative summary of the policy behaviour. Moreover, we introduce a rich and formal language that a domain expert can use to describe the expected behaviour of a policy. In more detail, we present a formulation that directly computes the risk involved in taking actions by considering the high- level elements specified by the expert. The final formula can identify risky decisions taken by POMCP that violate the expert indications. We show that this identification process can be used offline (to improve the policy’s explainability and identify anomalous behaviours) or online (to shield the risky decisions of the POMCP algorithm). We present an extended evaluation of our approach on four domains: the well-known tiger and rocksample benchmarks, a problem of velocity regulation in mobile robots, and a problem of battery management in mobile robots. We test the methodology against a state-of- the-art anomaly detection algorithm to show that our approach can be used to identify anomalous behaviours in faulty POMCP. We also show, comparing the performance of shielded and unshielded POMCP, that the shielding mechanism can improve the system’s performance. We provide an open-source implementation of the proposed methodologies at https://github.com/GiuMaz/XPOMCP

Rule-based Shield Synthesis for Partially Observable Monte Carlo Planning

Partially Observable Monte-Carlo Planning (POMCP) is a powerful online algorithm able to generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by avoiding complete policy representation. The lack of an explicit representation however hinders policy interpretability and makes policy verification very complex. In this work, we propose two contributions. The first is a method for identifying unexpected actions selected by POMCP with respect to expert prior knowledge of the task. The second is a shielding approach that prevents POMCP from selecting unexpected actions. The first method is based on Maximum Satisfiability Modulo Theory (MAX-SMT). It inspects traces (i.e., sequences of belief-action-observation triplets) generated by POMCP to compute the parameters of logical formulas about policy properties defined by the expert. The second contribution is a module that uses online the logical formulas to identify anomalous actions selected by POMCP and substitutes those actions with actions that satisfy the logical formulas fulfilling expert knowledge. We evaluate our approach in two domains. Results show that the shielded POMCP outperforms the standard POMCP in a case study in which a wrong parameter of POMCP makes it select wrong actions from time to time. © 2021 Copyright for this paper by its authors

Rule-based shielding for Partially Observable Monte-Carlo Planning

Partially Observable Monte-Carlo Planning (POMCP) is a powerful online algorithm able to generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by avoiding complete policy representation. The lack of an explicit representation however hinders policy interpretability and makes policy verification very complex. In this work, we propose two contributions. The first is a method for identifying unexpected actions selected by POMCP with respect to expert prior knowledge of the task. The second is a shielding approach that prevents POMCP from selecting unexpected actions. The first method is based on Satisfiability Modulo Theory (SMT). It inspects traces (i.e., sequences of belief-action-observation triplets) generated by POMCP to compute the parameters of logical formulas about policy properties defined by the expert. The second contribution is a module that uses online the logical formulas to identify anomalous actions selected by POMCP and substitutes those actions with actions that satisfy the logical formulas fulfilling expert knowledge. We evaluate our approach on Tiger, a standard benchmark for POMDPs, and a real-world problem related to velocity regulation in mobile robot navigation. Results show that the shielded POMCP outperforms the standard POMCP in a case study in which a wrong parameter of POMCP makes it select wrong actions from time to time. Moreover, we show that the approach keeps good performance also if the parameters of the logical formula are optimized using trajectories containing some wrong actions

Identification of Unexpected Decisions in Partially Observable Monte-Carlo Planning: a Rule-Based Approach

Partially Observable Monte-Carlo Planning (POMCP) is a powerful online algorithm able to generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by avoiding complete policy representation. The lack of an explicit representation however hinders interpretability. In this work, we propose a methodology based on Satisfiability Modulo Theory (SMT) for analyzing POMCP policies by inspecting their traces, namely sequences of belief-action-observation triplets generated by the algorithm. The proposed method explores local properties of policy behavior to identify unexpected decisions. We propose an iterative process of trace analysis consisting of three main steps, i) the definition of a question by means of a parametric logical formula describing (probabilistic) relationships between beliefs and actions, ii) the generation of an answer by computing the parameters of the logical formula that maximize the number of satisfied clauses (solving a MAX-SMT problem), iii) the analysis of the generated logical formula and the related decision boundaries for identifying unexpected decisions made by POMCP with respect to the original question. We evaluate our approach on Tiger, a standard benchmark for POMDPs, and a real-world problem related to mobile robot navigation. Results show that the approach can exploit human knowledge on the domain, outperforming state-of-the-art anomaly detection methods in identifying unexpected decisions. An improvement of the Area Under Curve up to 47\% has been achieved in our tests.Comment: AAMAS 2021, 3-7 May 2021, London-UK (Virtual

Learning logic specifications for soft policy guidance in POMCP

Partially Observable Monte Carlo Planning (POMCP) is an effi- cient solver for Partially Observable Markov Decision Processes (POMDPs). It allows scaling to large state spaces by computing an approximation of the optimal policy locally and online, using a Monte Carlo Tree Search based strategy. However, POMCP suffers from sparse reward function, namely, rewards achieved only when the final goal is reached, particularly in environments with large state spaces and long horizons. Recently, logic specifications have been integrated into POMCP to guide exploration and to satisfy safety requirements. However, such policy-related rules require manual definition by domain experts, especially in real-world sce- narios. In this paper, we use inductive logic programming to learn logic specifications from traces of POMCP executions, i.e., sets of belief-action pairs generated by the planner. Specifically, we learn rules expressed in the paradigm of answer set programming. We then integrate them inside POMCP to provide soft policy bias toward promising actions. In the context of two benchmark sce- narios, rocksample and battery, we show that the integration of learned rules from small task instances can improve performance with fewer Monte Carlo simulations and in larger task instances. We make our modified version of POMCP publicly available at https://github.com/GiuMaz/pomcp_clingo.git

From POMDP executions to policy specifications

Partially Observable Markov Decision Processes (POMDPs) allow modeling systems with uncertain state using probability distributions over states (called beliefs). However, in complex domains, POMDP solvers must explore large belief spaces, which is computationally intractable. One solution is to introduce domain knowledge to drive exploration, in the form of logic specifications. However, defining effective specifications may be challenging even for domain experts. We propose an approach based on inductive logic programming to learn specifications with confidence level from observed POMDP executions. We show that the learning approach converges to robust specifications as the number of examples increases

The first comprehensive Milky Way stellar mock catalogue for the Chinese Space Station Telescope Survey Camera

The Chinese Space Station Telescope (CSST) is a cutting-edge two-meter astronomical space telescope currently under construction. Its primary Survey Camera (SC) is designed to conduct large-area imaging sky surveys using a sophisticated seven-band photometric system. The resulting data will provide unprecedented data for studying the structure and stellar populations of the Milky Way. To support the CSST development and scientific projects related to its survey data, we generate the first comprehensive Milky Way stellar mock catalogue for the CSST SC photometric system using the TRILEGAL stellar population synthesis tool. The catalogue includes approximately 12.6 billion stars, covering a wide range of stellar parameters, photometry, astrometry, and kinematics, with magnitude reaching down to g=27.5 mag in the AB magnitude system. The catalogue represents our benchmark understanding of the stellar populations in the Milky Way, enabling a direct comparison with the future CSST survey data. Particularly, it sheds light on faint stars that are hidden from current sky surveys. Our crowding limit analysis based on this catalogue provides compelling evidence for the extension of the CSST Optical Survey (OS) to cover low Galactic latitude regions. The strategic extension of the CSST-OS coverage, combined with this comprehensive mock catalogue, will enable transformative science with the CSST