A comparison among Reinforcement Learning algorithms in financial trading systems

In this work we analyze and implement different Reinforcement Learning (RL) algorithms in financial trading system applications. RL-based algorithms applied to financial systems aim to find an optimal policy, that is an optimal mapping between the variables describing the state of the system and the actions available to an agent, by interacting with the system itself in order to maximize a cumulative return. In this contribution we compare the results obtained considering different on-policy (SARSA) and off-policy (Q-Learning, Greedy-GQ) RL algorithms applied to daily trading in the Italian stock market. We consider both computational issues related to the implementation of the algorithms, and issues originating from practical application to real stock markets, in an effort to improve previous results while keeping a simple and understandable structure of the used models

Non noble metal catalysts for electrochemical energy conversion and hydrogen storage schemes

We review here our work on several electrochemical technologies with the potential of achieving performances-over-cost ratios suitable for large scale applications. 1. Alkaline water electrolysis and fuel cells. Electrolysers and hydrogen fuel cells with Proton Exchange Membranes are compact and have good performances; however, they are unsuitable for large scale applications since they use platinum group metal (PGM) catalysts. We show that comparable performances may be achieved with alkaline devices based on gas diffusion electrodes with non-PGM catalysts. In particular, a comparison with PEM devices was carried out considering: i) system design and requirements, ii) efficiency, iii) power density, iv) lifetime and reliability. 2. H-storage. Hydrogen is conveniently stored in, and retrieved from, borohydrides but the rate of hydrogen generation from BH4 hydrolysis in practical devices should be controlled Our CoO based porous electrode outperforms the reference Pt/C catalyst 3. Direct boro-hydride fuel cell. Direct oxidation of BH4 in a fuel cell is a challenging issue but this device has the potential of achieving superior power/energy densities at reduced cost. The incorporation of a gas diffusion electrode may simplify the design and enhance the performances in schemes using either aqueous electrolytes or an ion-conducting polymeric membrane. 4. Metal hydride-air battery. Primary and secondary Li-air batteries have the potential of displacing current alkaline, Li-ion and Zn-air batteries in low-power applications but major technological hurdles should be overcome to address safety, reliability and environmental concerns. We discuss the strong and weak points of our metal-hydride air battery which makes use of a gas diffusion electrode and has properties intermediate between a NiM-H and a Li-air battery

A Loosely-coupled Neural-symbolic approach to Compliance of Electric Panels

This paper presents an ongoing work on project MAP4ID “Multipurpose Analytics Platform 4 Industrial Data”, where one of the objectives is to propose suitable combinations of machine learning and Answer Set Programming (ASP) to cope with industrial problems. In particular, we focus on a specific use case of the project, where we combine deep learning and ASP to solve a problem of compliance to blueprints of electric panels. The use case data was provided by Elettrocablaggi srl, a SME leader in the market. Our proposed solution couples an object-recognition layer, implemented resorting to deep neural networks, that identifies components in an image of an electric panel, and sends this information to a logic program, that checks the compliance of the panel in the picture with the blueprint of the circuit

Non-invasive biomarkers for sperm retrieval in non-obstructive patients: a comprehensive review

Recent advancements in reproductive medicine have guided novel strategies for addressing male infertility, particularly in cases of non-obstructive azoospermia (NOA). Two prominent invasive interventions, namely testicular sperm extraction (TESE) and microdissection TESE (micro-TESE), have emerged as key techniques to retrieve gametes for assisted reproduction technologies (ART). Both heterogeneity and complexity of NOA pose a multifaceted challenge to clinicians, as the invasiveness of these procedures and their unpredictable success underscore the need for more precise guidance. Seminal plasma can be aptly regarded as a liquid biopsy of the male reproductive tract, encompassing secretions from the testes, epididymides, seminal vesicles, bulbourethral glands, and prostate. This fluid harbors a variety of cell-free nucleic acids, microvesicles, proteins, and metabolites intricately linked to gonadal activity. However, despite numerous investigations exploring potential biomarkers from seminal fluid, their widespread inclusion into the clinical practice remains limited. This could be partially due to the complex interplay of diverse clinical and genetic factors inherent to NOA that likely contributes to the absence of definitive biomarkers for residual spermatogenesis. It is conceivable that the integration of clinical data with biomarkers could increase the potential in predicting surgical procedure outcomes and their choice in NOA cases. This comprehensive review addresses the challenge of sperm retrieval in NOA through non-invasive biomarkers. Moreover, we delve into promising perspectives, elucidating innovative approaches grounded in multi-omics methodologies, including genomics, transcriptomics and proteomics. These cutting-edge techniques, combined with the clinical and genetics features of patients, could improve the use of biomarkers in personalized medical approaches, patient counseling, and the decision-making continuum. Finally, Artificial intelligence (AI) holds significant potential in the realm of combining biomarkers and clinical data, also in the context of identifying non-invasive biomarkers for sperm retrieval

The open abdomen, indications, management and definitive closure

The indications for Open Abdomen (OA) are generally all those situations in which is ongoing the development an intra-abdominal hypertension condition (IAH), in order to prevent the development of abdominal compartmental syndrome (ACS). In fact all those involved in care of a critically ill patient should in the first instance think how to prevent IAH and ACS. In case of ACS goal directed therapy to achieve early opening and early closure is the key: paradigm of closure shifts to combination of therapies including negative pressure wound therapy and dynamic closure, in order to reduce complications and avoid incisional hernia. There have been huge studies and progress in survival of critically ill trauma and septic surgical patients: this in part has been through the great work of pioneers, scientific societies and their guidelines; however future studies and continued innovation are needed to better understand optimal treatment strategies and to define more clearly the indications, because OA by itself is still a morbid procedure.Peer reviewe

Array analysis of seismic noise at the Sos Enattos mine, the Italian candidate site for the Einstein Telescope

The area surrounding the dismissed mine of Sos Enattos (Sardinia, Italy) is the Italian candidate site for hosting Einstein Telescope (ET), the third-generation gravitational wave (GW) observatory. One of the goals of ET is to extend the sensitivity down to frequencies well below those currently achieved by GW detectors, i.e. down to 2 Hz. In the bandwidth [1,10] Hz, the seismic noise of anthropogenic origin is expected to represent the major perturbation to the operation of the infrastructure, and the site that will host the future detector must fulfill stringent requirements on seismic disturbances. In this paper we describe the operation of a temporary, 15-element, seismic array deployed in close proximity to the mine. Signals of anthropogenic origin have a transient nature, and their spectra are characterized by a wide spectral lobe spanning the [3,20] Hz frequency interval. Superimposed to this wide lobe are narrow spectral peaks within the [3,8] Hz frequency range. Results from slowness analyses suggest that the origin of these peaks is related to vehicle traffic along the main road running east of the mine. Exploiting the correlation properties of seismic noise, we derive a dispersion curve for Rayleigh waves, which is then inverted for a shallow velocity structure down to depths of ≈≈ 150 m. This data, which is consistent with that derived from analysis of a quarry blast, provide a first assessment of the elastic properties of the rock materials at the site candidate to hosting ET

Association of COVID-19 Vaccinations With Intensive Care Unit Admissions and Outcome of Critically Ill Patients With COVID-19 Pneumonia in Lombardy, Italy

IMPORTANCE Data on the association of COVID-19 vaccination with intensive care unit (ICU) admission and outcomes of patients with SARS-CoV-2-related pneumonia are scarce. OBJECTIVE To evaluate whether COVID-19 vaccination is associated with preventing ICU admission for COVID-19 pneumonia and to compare baseline characteristics and outcomes of vaccinated and unvaccinated patients admitted to an ICU. DESIGN, SETTING, AND PARTICIPANTS This retrospective cohort study on regional data sets reports: (1) daily number of administered vaccines and (2) data of all consecutive patients admitted to an ICU in Lombardy, Italy, from August 1 to December 15, 2021 (Delta variant predominant). Vaccinated patients received either mRNA vaccines (BNT162b2 or mRNA-1273) or adenoviral vector vaccines (ChAdOx1-S or Ad26.COV2). Incident rate ratios (IRRs) were computed from August 1, 2021, to January 31, 2022; ICU and baseline characteristics and outcomes of vaccinated and unvaccinated patients admitted to an ICU were analyzed from August 1 to December 15, 2021. EXPOSURES COVID-19 vaccination status (no vaccination, mRNA vaccine, adenoviral vector vaccine). MAIN OUTCOMES AND MEASURES The incidence IRR of ICU admission was evaluated, comparing vaccinated people with unvaccinated, adjusted for age and sex. The baseline characteristics at ICU admission of vaccinated and unvaccinated patients were investigated. The association between vaccination status at ICU admission and mortality at ICU and hospital discharge were also studied, adjusting for possible confounders. RESULTS Among the 10 107 674 inhabitants of Lombardy, Italy, at the time of this study, the median [IQR] agewas 48 [28-64] years and 5 154 914 (51.0%) were female. Of the 7 863 417 individuals who were vaccinated (median [IQR] age: 53 [33-68] years; 4 010 343 [51.4%] female), 6 251 417 (79.5%) received an mRNA vaccine, 550 439 (7.0%) received an adenoviral vector vaccine, and 1 061 561 (13.5%) received a mix of vaccines and 4 497 875 (57.2%) were boosted. Compared with unvaccinated people, IRR of individuals who received an mRNA vaccine within 120 days from the last dosewas 0.03 (95% CI, 0.03-0.04; P <.001), whereas IRR of individuals who received an adenoviral vector vaccine after 120 days was 0.21 (95% CI, 0.19-0.24; P <.001). There were 553 patients admitted to an ICU for COVID-19 pneumonia during the study period: 139 patients (25.1%) were vaccinated and 414 (74.9%) were unvaccinated. Compared with unvaccinated patients, vaccinated patients were older (median [IQR]: 72 [66-76] vs 60 [51-69] years; P <.001), primarily male individuals (110 patients [ 79.1%] vs 252 patients [60.9%]; P <.001), with more comorbidities (median [IQR]: 2 [1-3] vs 0 [0-1] comorbidities; P <.001) and had higher ratio of arterial partial pressure of oxygen (PaO2) and fraction of inspiratory oxygen (FiO(2)) at ICU admission (median [IQR]: 138 [100-180] vs 120 [90-158] mm Hg; P =.007). Factors associated with ICU and hospital mortality were higher age, premorbid heart disease, lower PaO2/FiO(2) at ICU admission, and female sex (this factor only for ICU mortality). ICU and hospital mortality were similar between vaccinated and unvaccinated patients. CONCLUSIONS AND RELEVANCE In this cohort study, mRNA and adenoviral vector vaccines were associated with significantly lower risk of ICU admission for COVID-19 pneumonia. ICU and hospital mortality were not associated with vaccinated status.These findings suggest a substantial reduction of the risk of developing COVID-19-related severe acute respiratory failure requiring ICU admission among vaccinated people

Conjugate Direction Methods and Polarity for Quadratic Hypersurfaces

We use some results from polarity theory to recast several geometric properties of Conjugate Gradient-based methods, for the solution of nonsingular symmetric linear systems. This approach allows us to pursue three main theoretical objectives. First, we can provide a novel geometric perspective on the generation of conjugate directions, in the context of positive definite systems. Second, we can extend the above geometric perspective to treat the generation of conjugate directions for handling indefinite linear systems. Third, by exploiting the geometric insight suggested by polarity theory, we can easily study the possible degeneracy (pivot breakdown) of Conjugate Gradient- based methods on indefinite linear systems. In particular, we prove that the degeneracy of the standard Conjugate Gradient on nonsingular indefinite linear systems can occur only once in the execution of the Conjugate Gradient

Surgical site infection after gastrointestinal surgery in high-income, middle-income, and low-income countries: a prospective, international, multicentre cohort study

Background: Surgical site infection (SSI) is one of the most common infections associated with health care, but its importance as a global health priority is not fully understood. We quantified the burden of SSI after gastrointestinal surgery in countries in all parts of the world. Methods: This international, prospective, multicentre cohort study included consecutive patients undergoing elective or emergency gastrointestinal resection within 2-week time periods at any health-care facility in any country. Countries with participating centres were stratified into high-income, middle-income, and low-income groups according to the UN's Human Development Index (HDI). Data variables from the GlobalSurg 1 study and other studies that have been found to affect the likelihood of SSI were entered into risk adjustment models. The primary outcome measure was the 30-day SSI incidence (defined by US Centers for Disease Control and Prevention criteria for superficial and deep incisional SSI). Relationships with explanatory variables were examined using Bayesian multilevel logistic regression models. This trial is registered with ClinicalTrials.gov, number NCT02662231. Findings: Between Jan 4, 2016, and July 31, 2016, 13 265 records were submitted for analysis. 12 539 patients from 343 hospitals in 66 countries were included. 7339 (58·5%) patient were from high-HDI countries (193 hospitals in 30 countries), 3918 (31·2%) patients were from middle-HDI countries (82 hospitals in 18 countries), and 1282 (10·2%) patients were from low-HDI countries (68 hospitals in 18 countries). In total, 1538 (12·3%) patients had SSI within 30 days of surgery. The incidence of SSI varied between countries with high (691 [9·4%] of 7339 patients), middle (549 [14·0%] of 3918 patients), and low (298 [23·2%] of 1282) HDI (p < 0·001). The highest SSI incidence in each HDI group was after dirty surgery (102 [17·8%] of 574 patients in high-HDI countries; 74 [31·4%] of 236 patients in middle-HDI countries; 72 [39·8%] of 181 patients in low-HDI countries). Following risk factor adjustment, patients in low-HDI countries were at greatest risk of SSI (adjusted odds ratio 1·60, 95% credible interval 1·05–2·37; p=0·030). 132 (21·6%) of 610 patients with an SSI and a microbiology culture result had an infection that was resistant to the prophylactic antibiotic used. Resistant infections were detected in 49 (16·6%) of 295 patients in high-HDI countries, in 37 (19·8%) of 187 patients in middle-HDI countries, and in 46 (35·9%) of 128 patients in low-HDI countries (p < 0·001). Interpretation: Countries with a low HDI carry a disproportionately greater burden of SSI than countries with a middle or high HDI and might have higher rates of antibiotic resistance. In view of WHO recommendations on SSI prevention that highlight the absence of high-quality interventional research, urgent, pragmatic, randomised trials based in LMICs are needed to assess measures aiming to reduce this preventable complication

Effects of hospital facilities on patient outcomes after cancer surgery: an international, prospective, observational study

Background Early death after cancer surgery is higher in low-income and middle-income countries (LMICs) compared with in high-income countries, yet the impact of facility characteristics on early postoperative outcomes is unknown. The aim of this study was to examine the association between hospital infrastructure, resource availability, and processes on early outcomes after cancer surgery worldwide.Methods A multimethods analysis was performed as part of the GlobalSurg 3 study-a multicentre, international, prospective cohort study of patients who had surgery for breast, colorectal, or gastric cancer. The primary outcomes were 30-day mortality and 30-day major complication rates. Potentially beneficial hospital facilities were identified by variable selection to select those associated with 30-day mortality. Adjusted outcomes were determined using generalised estimating equations to account for patient characteristics and country-income group, with population stratification by hospital.Findings Between April 1, 2018, and April 23, 2019, facility-level data were collected for 9685 patients across 238 hospitals in 66 countries (91 hospitals in 20 high-income countries; 57 hospitals in 19 upper-middle-income countries; and 90 hospitals in 27 low-income to lower-middle-income countries). The availability of five hospital facilities was inversely associated with mortality: ultrasound, CT scanner, critical care unit, opioid analgesia, and oncologist. After adjustment for case-mix and country income group, hospitals with three or fewer of these facilities (62 hospitals, 1294 patients) had higher mortality compared with those with four or five (adjusted odds ratio [OR] 3.85 [95% CI 2.58-5.75]; p&lt;0.0001), with excess mortality predominantly explained by a limited capacity to rescue following the development of major complications (63.0% vs 82.7%; OR 0.35 [0.23-0.53]; p&lt;0.0001). Across LMICs, improvements in hospital facilities would prevent one to three deaths for every 100 patients undergoing surgery for cancer.Interpretation Hospitals with higher levels of infrastructure and resources have better outcomes after cancer surgery, independent of country income. Without urgent strengthening of hospital infrastructure and resources, the reductions in cancer-associated mortality associated with improved access will not be realised