Computer Aided Verification

The open access two-volume set LNCS 11561 and 11562 constitutes the refereed proceedings of the 31st International Conference on Computer Aided Verification, CAV 2019, held in New York City, USA, in July 2019. The 52 full papers presented together with 13 tool papers and 2 case studies, were carefully reviewed and selected from 258 submissions. The papers were organized in the following topical sections: Part I: automata and timed systems; security and hyperproperties; synthesis; model checking; cyber-physical systems and machine learning; probabilistic systems, runtime techniques; dynamical, hybrid, and reactive systems; Part II: logics, decision procedures; and solvers; numerical programs; verification; distributed systems and networks; verification and invariants; and concurrency

Modeling Mutual Influence in Multi-Agent Reinforcement Learning

In multi-agent systems (MAS), agents rarely act in isolation but tend to achieve their goals through interactions with other agents. To be able to achieve their ultimate goals, individual agents should actively evaluate the impacts on themselves of other agents' behaviors before they decide which actions to take. The impacts are reciprocal, and it is of great interest to model the mutual influence of agent's impacts with one another when they are observing the environment or taking actions in the environment. In this thesis, assuming that the agents are aware of each other's existence and their potential impact on themselves, I develop novel multi-agent reinforcement learning (MARL) methods that can measure the mutual influence between agents to shape learning. The first part of this thesis outlines the framework of recursive reasoning in deep multi-agent reinforcement learning. I hypothesize that it is beneficial for each agent to consider how other agents react to their behavior. I start from Probabilistic Recursive Reasoning (PR2) using level-1 reasoning and adopt variational Bayes methods to approximate the opponents' conditional policies. Each agent shapes the individual Q-value by marginalizing the conditional policies in the joint Q-value and finding the best response to improving their policies. I further extend PR2 to Generalized Recursive Reasoning (GR2) with different hierarchical levels of rationality. GR2 enables agents to possess various levels of thinking ability, thereby allowing higher-level agents to best respond to less sophisticated learners. The first part of the thesis shows that eliminating the joint Q-value to an individual Q-value via explicitly recursive reasoning would benefit the learning. In the second part of the thesis, in reverse, I measure the mutual influence by approximating the joint Q-value based on the individual Q-values. I establish Q-DPP, an extension of the Determinantal Point Process (DPP) with partition constraints, and apply it to multi-agent learning as a function approximator for the centralized value function. An attractive property of using Q-DPP is that when it reaches the optimum value, it can offer a natural factorization of the centralized value function, representing both quality (maximizing reward) and diversity (different behaviors). In the third part of the thesis, I depart from the action-level mutual influence and build a policy-space meta-game to analyze agents' relationship between adaptive policies. I present a Multi-Agent Trust Region Learning (MATRL) algorithm that augments single-agent trust region policy optimization with a weak stable fixed point approximated by the policy-space meta-game. The algorithm aims to find a game-theoretic mechanism to adjust the policy optimization steps that force the learning of all agents toward the stable point

Computer Aided Verification

The open access two-volume set LNCS 11561 and 11562 constitutes the refereed proceedings of the 31st International Conference on Computer Aided Verification, CAV 2019, held in New York City, USA, in July 2019. The 52 full papers presented together with 13 tool papers and 2 case studies, were carefully reviewed and selected from 258 submissions. The papers were organized in the following topical sections: Part I: automata and timed systems; security and hyperproperties; synthesis; model checking; cyber-physical systems and machine learning; probabilistic systems, runtime techniques; dynamical, hybrid, and reactive systems; Part II: logics, decision procedures; and solvers; numerical programs; verification; distributed systems and networks; verification and invariants; and concurrency

Mycotoxins and indoor environment : Aerosolization of mycotoxins during development of toxigenic species and development of tools for monitoring in habitats

Mycotoxins are secondary metabolites produced by many fungal species. Health effects induced by the ingestion of these substances are well documented and some mycotoxins are now regulated for their maximum tolerable levels in foods. However, other routes of exposure to these contaminants are possible. Thus, if irritating or allergenic reactions related to the inhalation of fungal spores or mycelial fragments have been demonstrated, inhalation of mycotoxins is also suspected to be causing certain respiratory disorders or certain pathologies. Indeed, mycotoxins can be found in spores but also on finer particles which are easily aerosolized and therefore likely to be inhaled. However, data on the hazard associated with human exposure to mycotoxins by inhalation are still very fragmented. In this context, our main objective was to characterize the aerosolization of mycotoxins during the colonization of different materials encountered in indoor environments by toxinogenic molds. First we studied growth and production of mycotoxins during the colonization of building materials (wallpaper, painted fiberglass wallpaper, vinyl wallpaper, fir, fiberglass) by three fungal species of interest: Aspergillus versicolor, Penicillium brevicompactum, Stachybotrys chartarum. These species were chosen because of their frequent presence in indoor environments and their diverse mycelial organization. In addition, these three species produce different toxins: sterigmatocystin, mycophenolic acid and macrocyclic trichothecenes for A. versicolor, P. brevicompactum and S. chartarum, respectively. These studies have shown that, during their development on tested materials, three species produce mycotoxins. The most favorable material for fungal development and toxinogenesis is wallpaper. Mycophenolic acid, sterigmatocystin and macrocyclic trichothecenes can thus be produced at levels of 1.8, 112.1 and 27.8 mg/m2, respectively, on this material. These toxins can then be partially aerosolized. We have shown that aerosolization depends on species and their mycelial structure, but also on culture conditions and airflow. This transfer to air is nevertheless observed after aeraulic solicitations which can be easily encountered in indoor environments because theycorrespond to the movement of people in a room (0.3 m/s), speed of air in ceiling diffusers (2 m/s), slamming doors or air drafts when opening windows(6 m/s). P. brevicompactum showed to be the easiest to aerosolize. The major part of the aerosols’ toxic charge is found in particles whose size corresponds to that of spores or mycelial fragments. However, for macrocyclic trichothecenes, toxins were also found in particles smaller than spores, which could easily be inhaled by occupants and penetrate deep into the respiratory tract. In order to better characterize the actual hazard associated with inhalation of these compounds, cytotoxicity studies have been performed using lung cells and comparing with results observed on digestive cells. Pulmonary toxicity is comparable to that observed in digestive cells. Macrocyclic trichothecenes are much more toxic than other tested toxins with IC50 in order of ng/ml. In parallel, we analyzed the VOCs specifically produced during active mycotoxinogenesis in order to identify potential biomarkers of the actual production of mycotoxins that could be used as tools for monitoring of indoor environments. Unfortunately, this approach has not, for the moment, led to the identification of specific targets. In the end, we evaluated the persistence of these contaminants during application of bleach, the most frequently used decontamination process. We have shown that a normal cleaning procedure allows only partial removal of mold

Natural Language Processing: Emerging Neural Approaches and Applications

This Special Issue highlights the most recent research being carried out in the NLP field to discuss relative open issues, with a particular focus on both emerging approaches for language learning, understanding, production, and grounding interactively or autonomously from data in cognitive and neural systems, as well as on their potential or real applications in different domains

Intelligent Transportation Related Complex Systems and Sensors

Building around innovative services related to different modes of transport and traffic management, intelligent transport systems (ITS) are being widely adopted worldwide to improve the efficiency and safety of the transportation system. They enable users to be better informed and make safer, more coordinated, and smarter decisions on the use of transport networks. Current ITSs are complex systems, made up of several components/sub-systems characterized by time-dependent interactions among themselves. Some examples of these transportation-related complex systems include: road traffic sensors, autonomous/automated cars, smart cities, smart sensors, virtual sensors, traffic control systems, smart roads, logistics systems, smart mobility systems, and many others that are emerging from niche areas. The efficient operation of these complex systems requires: i) efficient solutions to the issues of sensors/actuators used to capture and control the physical parameters of these systems, as well as the quality of data collected from these systems; ii) tackling complexities using simulations and analytical modelling techniques; and iii) applying optimization techniques to improve the performance of these systems. It includes twenty-four papers, which cover scientific concepts, frameworks, architectures and various other ideas on analytics, trends and applications of transportation-related data

Scientific Reasoning in Science Education: From Global Measures to Fine-Grained Descriptions of Students’ Competencies

This book is a reprint of the Special Issue "Scientific Reasoning in Science Education: From Global Measures to Fine-Grained Descriptions of Students’ Competencies" published in the journal Education Sciences. It compiles all manuscripts of the special issue

The Role of ID3 and PCB153 in the Hyperproliferation and Dysregulation of Lung Endothelial Cells

Uncontrolled growth of vascular stem cells as a result of endothelial-mesenchymal transition is considered to cause hyper-proliferative vascular remodeling in severe pulmonary arterial hypertension (PAH) patients. Hyperplastic intimal growth is one of the causes of closure of the lumen of pulmonary arterioles. This abnormal vessel remodeling leads to the progressive increase in pressure of the pulmonary arterioles causing severe PAH; and debilitating harm to patients resulting in mortality from right heart failure. Environmental factors, including polychlorinated biphenyls (PCBs), are considered to be involved in hyper-proliferative vascular remodeling because genetic makeup can only explain about 10% of severe PAH cases. PCB involvement in lung toxicity has received attention because (i) they have been reported to accumulate in the lung; (ii) PCBs produce pathological vascular remodeling in the experimental model; high levels of PCBs are found in human lung tissue; and (iii) epidemiological studies show the association between lung toxicity and PCBs; and prevalence of hypertension and elevated concentrations of particularly PCB153. Recent studies identify PCB153 as one of the largest contributors for total PCB body burden in humans. Our previous studies demonstrated PCB153 mediated vascular endothelial dysfunction and activated the inhibitor of differentiation protein 3 (ID3). ID3 is an important determinant of mitogen and reactive oxygen species-induced G1→S phase cell cycle progression. Although phosphorylation of ID3 increases cell growth by antagonizing the transcription of cell cycle inhibitors, still there is a critical gap in understanding the molecular mechanism(s) of pulmonary proliferative vascular remodeling associated with PCB exposure in humans and the role of the transcription regulator ID3. Our overall objective was to investigate ID3 mediated transcriptional reprogramming as a driver of PCB153-induced pathological proliferative vascular remodeling. Stable ectopic expression of ID3 in lung endothelial cells contributed to endothelial-mesenchymal transition (EndMT), cell proliferation, and cell migration. Using an endothelial spheroid assay, an established method to measure aberrant hyper-proliferation of endothelial cells in PAH patients, we show that stable ectopic expression of ID3 increased the number and size of vascular spheres. ID3 overexpressing cells exposed to environmentally relevant concentrations of PCB153 showed a two-fold increase in cell proliferation as determined by MTT, SRB, and BrdU assays. ID3 overexpressing cells showed the loss of VE-cadherin and gain of MMP9 and vimentin, which are markers of EndMT. PCB153 also increased phosphorylation of ID3 in lung endothelial cells. To determine the molecular mechanism by which ID3 contributes to hyper-proliferative endothelial cells, we investigated ID3 transcriptional reprogramming using ChIP-Seq and RNA-Seq technology. We show here for the first time that ID3 is part of a more general mechanism of transcriptional regulation. Our ChIP-Seq data show that ID3 binds to a subset of approximately 1200 target genes. Comprehensive motif analysis of ChIP-Seq data using the MEME Suite software toolkit revealed that ID3 bound to the GAGAGAGAGA motif sequence on genomic DNA. We also show a significant preference of ID3 binding to motifs associated with transcription factors IRF1, BC11A, IRF4, PRDM1, FOXJ3, SMAD4, ZBTB6, GATA1, and STAT2. Using an integrative approach of ChIP-Seq and RNA-Seq data, we identified 19 genes whose promoter region was bound by ID3 and RNA was differentially expressed in ID3 overexpressing cells. In summary, our data demonstrated that PCB153 and/or ID3 induces proliferation of lung endothelial cells via transcriptional reprogramming. Discoveries from these findings will lay the necessary groundbreaking work for testing the efficacy of ID3 antagonists for the prevention and treatment of pathological vascular remodeling as well as provide a new paradigm by which PCBs may contribute to lung vascular toxicity

Human-Robot Collaborations in Industrial Automation

Technology is changing the manufacturing world. For example, sensors are being used to track inventories from the manufacturing floor up to a retail shelf or a customer’s door. These types of interconnected systems have been called the fourth industrial revolution, also known as Industry 4.0, and are projected to lower manufacturing costs. As industry moves toward these integrated technologies and lower costs, engineers will need to connect these systems via the Internet of Things (IoT). These engineers will also need to design how these connected systems interact with humans. The focus of this Special Issue is the smart sensors used in these human–robot collaborations