An Analysis of Multi-Agent Reinforcement Learning for Decentralized Inventory Control Systems

Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-known planning problem in operations research, concerned with finding the optimal re-order policy for nodes in a supply chain. While many centralized solutions to the problem exist, they are not applicable to real-world supply chains made up of independent entities. The problem can however be naturally decomposed into sub-problems, each associated with an independent entity, turning it into a multi-agent system. Therefore, a decentralized data-driven solution to inventory management problems using multi-agent reinforcement learning is proposed where each entity is controlled by an agent. Three multi-agent variations of the proximal policy optimization algorithm are investigated through simulations of different supply chain networks and levels of uncertainty. The centralized training decentralized execution framework is deployed, which relies on offline centralization during simulation-based policy identification, but enables decentralization when the policies are deployed online to the real system. Results show that using multi-agent proximal policy optimization with a centralized critic leads to performance very close to that of a centralized data-driven solution and outperforms a distributed model-based solution in most cases while respecting the information constraints of the system

A national cross-sectional study among drug-users in France: epidemiology of HCV and highlight on practical and statistical aspects of the design

<p>Abstract</p> <p>Background</p> <p>Epidemiology of HCV infection among drug users (DUs) has been widely studied. Prevalence and sociobehavioural data among DUs are therefore available in most countries but no study has taken into account in the sampling weights one important aspect of the way of life of DUs, namely that they can use one or more specialized services during the study period. In 2004–2005, we conducted a national seroepidemiologic survey of DUs, based on a random sampling design using the Generalised Weight Share Method (GWSM) and on blood testing.</p> <p>Methods</p> <p>A cross-sectional multicenter survey was done among DUs having injected or snorted drugs at least once in their life. We conducted a two stage random survey of DUs selected to represent the diversity of drug use. The fact that DUs can use more than one structure during the study period has an impact on their inclusion probabilities. To calculate a correct sampling weight, we used the GWSM. A sociobehavioral questionnaire was administered by interviewers. Selected DUs were asked to self-collect a fingerprick blood sample on blotting paper.</p> <p>Results</p> <p>Of all DUs selected, 1462 (75%) accepted to participate. HCV seroprevalence was 59.8% [95% CI: 50.7–68.3]. Of DUs under 30 years, 28% were HCV seropositive. Of HCV-infected DUs, 27% were unaware of their status. In the month prior to interview, 13% of DUs shared a syringe, 38% other injection parapharnelia and 81% shared a crack pipe. In multivariate analysis, factors independently associated with HCV seropositivity were age over 30, HIV seropositivity, having ever injected drugs, opiate substitution treatment (OST), crack use, and precarious housing.</p> <p>Conclusion</p> <p>This is the first time that blood testing combined to GWSM is applied to a DUs population, which improve the estimate of HCV prevalence. HCV seroprevalence is high, indeed by the youngest DUs. And a large proportion of DUs are not aware of their status. Our multivariate analysis identifies risk factors such as crack consumption and unstable housing.</p

Architecture and performance of the KM3NeT front-end firmware

The KM3NeT infrastructure consists of two deep-sea neutrino telescopes being deployed in the Mediterranean Sea. The telescopes will detect extraterrestrial and atmospheric neutrinos by means of the incident photons induced by the passage of relativistic charged particles through the seawater as a consequence of a neutrino interaction. The telescopes are configured in a three-dimensional grid of digital optical modules, each hosting 31 photomultipliers. The photomultiplier signals produced by the incident Cherenkov photons are converted into digital information consisting of the integrated pulse duration and the time at which it surpasses a chosen threshold. The digitization is done by means of time to digital converters (TDCs) embedded in the field programmable gate array of the central logic board. Subsequently, a state machine formats the acquired data for its transmission to shore. We present the architecture and performance of the front-end firmware consisting of the TDCs and the state machine

Event reconstruction for KM3NeT/ORCA using convolutional neural networks

The KM3NeT research infrastructure is currently under construction at two locations in the Mediterranean Sea. The KM3NeT/ORCA water-Cherenkov neutrino detector off the French coast will instrument several megatons of seawater with photosensors. Its main objective is the determination of the neutrino mass ordering. This work aims at demonstrating the general applicability of deep convolutional neural networks to neutrino telescopes, using simulated datasets for the KM3NeT/ORCA detector as an example. To this end, the networks are employed to achieve reconstruction and classification tasks that constitute an alternative to the analysis pipeline presented for KM3NeT/ORCA in the KM3NeT Letter of Intent. They are used to infer event reconstruction estimates for the energy, the direction, and the interaction point of incident neutrinos. The spatial distribution of Cherenkov light generated by charged particles induced in neutrino interactions is classified as shower- or track-like, and the main background processes associated with the detection of atmospheric neutrinos are recognized. Performance comparisons to machine-learning classification and maximum-likelihood reconstruction algorithms previously developed for KM3NeT/ORCA are provided. It is shown that this application of deep convolutional neural networks to simulated datasets for a large-volume neutrino telescope yields competitive reconstruction results and performance improvements with respect to classical approaches

Event reconstruction for KM3NeT/ORCA using convolutional neural networks

The KM3NeT research infrastructure is currently under construction at two locations in the Mediterranean Sea. The KM3NeT/ORCA water-Cherenkov neutrino de tector off the French coast will instrument several megatons of seawater with photosensors. Its main objective is the determination of the neutrino mass ordering. This work aims at demonstrating the general applicability of deep convolutional neural networks to neutrino telescopes, using simulated datasets for the KM3NeT/ORCA detector as an example. To this end, the networks are employed to achieve reconstruction and classification tasks that constitute an alternative to the analysis pipeline presented for KM3NeT/ORCA in the KM3NeT Letter of Intent. They are used to infer event reconstruction estimates for the energy, the direction, and the interaction point of incident neutrinos. The spatial distribution of Cherenkov light generated by charged particles induced in neutrino interactions is classified as shower-or track-like, and the main background processes associated with the detection of atmospheric neutrinos are recognized. Performance comparisons to machine-learning classification and maximum-likelihood reconstruction algorithms previously developed for KM3NeT/ORCA are provided. It is shown that this application of deep convolutional neural networks to simulated datasets for a large-volume neutrino telescope yields competitive reconstruction results and performance improvements with respect to classical approaches

Genome-wide association analyses identify new Brugada syndrome risk loci and highlight a new mechanism of sodium channel regulation in disease susceptibility.

Brugada syndrome (BrS) is a cardiac arrhythmia disorder associated with sudden death in young adults. With the exception of SCN5A, encoding the cardiac sodium channel Na1.5, susceptibility genes remain largely unknown. Here we performed a genome-wide association meta-analysis comprising 2,820 unrelated cases with BrS and 10,001 controls, and identified 21 association signals at 12 loci (10 new). Single nucleotide polymorphism (SNP)-heritability estimates indicate a strong polygenic influence. Polygenic risk score analyses based on the 21 susceptibility variants demonstrate varying cumulative contribution of common risk alleles among different patient subgroups, as well as genetic associations with cardiac electrical traits and disorders in the general population. The predominance of cardiac transcription factor loci indicates that transcriptional regulation is a key feature of BrS pathogenesis. Furthermore, functional studies conducted on MAPRE2, encoding the microtubule plus-end binding protein EB2, point to microtubule-related trafficking effects on Na1.5 expression as a new underlying molecular mechanism. Taken together, these findings broaden our understanding of the genetic architecture of BrS and provide new insights into its molecular underpinnings

Application of a risk-management framework for integration of stromal tumor-infiltrating lymphocytes in clinical trials

Funder: Breast Cancer Research Foundation (BCRF); doi: https://doi.org/10.13039/100001006Abstract: Stromal tumor-infiltrating lymphocytes (sTILs) are a potential predictive biomarker for immunotherapy response in metastatic triple-negative breast cancer (TNBC). To incorporate sTILs into clinical trials and diagnostics, reliable assessment is essential. In this review, we propose a new concept, namely the implementation of a risk-management framework that enables the use of sTILs as a stratification factor in clinical trials. We present the design of a biomarker risk-mitigation workflow that can be applied to any biomarker incorporation in clinical trials. We demonstrate the implementation of this concept using sTILs as an integral biomarker in a single-center phase II immunotherapy trial for metastatic TNBC (TONIC trial, NCT02499367), using this workflow to mitigate risks of suboptimal inclusion of sTILs in this specific trial. In this review, we demonstrate that a web-based scoring platform can mitigate potential risk factors when including sTILs in clinical trials, and we argue that this framework can be applied for any future biomarker-driven clinical trial setting

Pitfalls in assessing stromal tumor infiltrating lymphocytes (sTILs) in breast cancer

Abstract: Stromal tumor-infiltrating lymphocytes (sTILs) are important prognostic and predictive biomarkers in triple-negative (TNBC) and HER2-positive breast cancer. Incorporating sTILs into clinical practice necessitates reproducible assessment. Previously developed standardized scoring guidelines have been widely embraced by the clinical and research communities. We evaluated sources of variability in sTIL assessment by pathologists in three previous sTIL ring studies. We identify common challenges and evaluate impact of discrepancies on outcome estimates in early TNBC using a newly-developed prognostic tool. Discordant sTIL assessment is driven by heterogeneity in lymphocyte distribution. Additional factors include: technical slide-related issues; scoring outside the tumor boundary; tumors with minimal assessable stroma; including lymphocytes associated with other structures; and including other inflammatory cells. Small variations in sTIL assessment modestly alter risk estimation in early TNBC but have the potential to affect treatment selection if cutpoints are employed. Scoring and averaging multiple areas, as well as use of reference images, improve consistency of sTIL evaluation. Moreover, to assist in avoiding the pitfalls identified in this analysis, we developed an educational resource available at www.tilsinbreastcancer.org/pitfalls

Report on computational assessment of Tumor Infiltrating Lymphocytes from the International Immuno-Oncology Biomarker Working Group

Funder: U.S. Department of Health & Human Services | NIH | National Cancer Institute (NCI)Funder: National Center for Research Resources under award number 1 C06 RR12463-01, VA Merit Review Award IBX004121A from the United States Department of Veterans Affairs Biomedical Laboratory Research and Development Service, the DOD Prostate Cancer Idea Development Award (W81XWH-15-1-0558), the DOD Lung Cancer Investigator-Initiated Translational Research Award (W81XWH-18-1-0440), the DOD Peer Reviewed Cancer Research Program (W81XWH-16-1-0329), the Ohio Third Frontier Technology Validation Fund, the Wallace H. Coulter Foundation Program in the Department of Biomedical Engineering and the Clinical and Translational Science Award Program (CTSA) at Case Western Reserve University.Funder: Susan G Komen Foundation (CCR CCR18547966) and a Young Investigator Grant from the Breast Cancer Alliance.Funder: The Canadian Cancer SocietyFunder: Breast Cancer Research Foundation (BCRF), Grant No. 17-194Abstract: Assessment of tumor-infiltrating lymphocytes (TILs) is increasingly recognized as an integral part of the prognostic workflow in triple-negative (TNBC) and HER2-positive breast cancer, as well as many other solid tumors. This recognition has come about thanks to standardized visual reporting guidelines, which helped to reduce inter-reader variability. Now, there are ripe opportunities to employ computational methods that extract spatio-morphologic predictive features, enabling computer-aided diagnostics. We detail the benefits of computational TILs assessment, the readiness of TILs scoring for computational assessment, and outline considerations for overcoming key barriers to clinical translation in this arena. Specifically, we discuss: 1. ensuring computational workflows closely capture visual guidelines and standards; 2. challenges and thoughts standards for assessment of algorithms including training, preanalytical, analytical, and clinical validation; 3. perspectives on how to realize the potential of machine learning models and to overcome the perceptual and practical limits of visual scoring