On benchmarking of deep learning systems: software engineering issues and reproducibility challenges

Since AlexNet won the ImageNet Large Scale Visual Recognition Challenge (ILSVRC) in 2012, Deep Learning (and Machine Learning/AI in general) gained an exponential interest. Nowadays, their adoption spreads over numerous sectors, like automotive, robotics, healthcare and finance. The ML advancement goes in pair with the quality improvement delivered by those solutions. However, those ameliorations are not for free: ML algorithms always require an increasing computational power, which pushes computer engineers to develop new devices capable of coping with this demand for performance. To foster the evolution of DSAs, and thus ML research, it is key to make it easy to experiment and compare them. This may be challenging since, even if the software built around these devices simplifies their usage, obtaining the best performance is not always straightforward. The situation gets even worse when the experiments are not conducted in a reproducible way. Even though the importance of reproducibility for the research is evident, it does not directly translate into reproducible experiments. In fact, as already shown by previous studies regarding other research fields, also ML is facing a reproducibility crisis. Our work addresses the topic of reproducibility of ML applications. Reproducibility in this context has two aspects: results reproducibility and performance reproducibility. While the reproducibility of the results is mandatory, performance reproducibility cannot be neglected because high-performance device usage causes cost. To understand how the ML situation is regarding reproducibility of performance, we reproduce results published for the MLPerf suite, which seems to be the most used machine learning benchmark. Because of the wide range of devices and frameworks used in different benchmark submissions, we focus on a subset of accuracy and performance results submitted to the MLPerf Inference benchmark, presenting a detailed analysis of the difficulties a scientist may find when trying to reproduce such a benchmark and a possible solution using our workflow tool for experiment reproducibility: PROVA!. We designed PROVA! to support the reproducibility in traditional HPC experiments, but we will show how we extended it to be used as a 'driver' for MLPerf benchmark applications. The PROVA! driver mode allows us to experiment with different versions of the MLPerf Inference benchmark switching among different hardware and software combinations and compare them in a reproducible way. In the last part, we will present the results of our reproducibility study, demonstrating the importance of having a support tool to reproduce and extend original experiments getting deeper knowledge about performance behaviours

Physiological role of Prion Protein in Copper homeostasis and angiogenic mechanisms of endothelial cells

Abstract The Prion Protein (PrP) is mostly known for its role in prion diseases, where its misfolding and aggregation can cause fatal neurodegenerative conditions such as the bovine spongiform encephalopathy and human Creutzfeldt–Jakob disease. Physiologically, PrP is involved in several processes including adhesion, proliferation, differentiation and angiogenesis, but the molecular mechanisms behind its role remain unclear. PrP, due to its well-described structure, is known to be able to regulate copper homeostasis; however, copper dyshomeostasis can lead to developmental defects. We investigated PrP-dependent regulation of copper homeostasis in human endothelial cells (HUVEC) using an RNA-interference protocol. PrP knockdown did not influence cell viability in silenced HUVEC (PrPKD) compared to control cells, but significantly increased PrPKD HUVEC cells sensitivity to cytotoxic copper concentrations. A reduction of PrPKD cells reductase activity and copper ions transport capacity was observed. Furthermore, PrPKD-derived spheroids exhibited altered morphogenesis and their derived cells showed a decreased vitality 24 and 48 hours after seeding. PrPKD spheroid-derived cells also showed disrupted tubulogenesis in terms of decreased coverage area, tubule length and total nodes number on matrigel, preserving unaltered VEGF receptors expression levels. Our results highlight PrP physiological role in cellular copper homeostasis and in the angiogenesis of endothelial cells

The Challenge of Planning Conservation Strategies in Threatened Seascapes: Understanding the Role of Fine Scale Assessments of Community Response to Cumulative Human Pressures

Assessing the distribution and intensity of human threats to biodiversity is a prerequisite for effective spatial planning, harmonizing conservation purposes with sustainable development. In the Mediterranean Sea, the management of Marine Protected Areas (MPAs) is rarely based on explicit consideration of the distribution of multiple stressors, with direct assessment of their effects on ecosystems. This gap limits the effectiveness of protection and is conducive to conflicts among stakeholders. Here, a fine scale assessment of the potential effects of different combinations of stressors (both land- and marine-based) on vulnerable rocky habitats (i.e. lower midlittoral and shallow infralittoral) along 40 km of coast in the western Mediterranean (Ionian Sea) has been carried out. The study area is a paradigmatic example of socio-ecological interactions, where several human uses and conservation measures collide. Significant differences in the structure of assemblages according to different combinations of threats were observed, indicating distinct responses of marine habitats to different sets of human pressures. A more complex three-dimensional structure, higher taxon richness and \u3b2-diversity characterized assemblages subject to low versus high levels of human pressure, consistently across habitats. In addition, the main drivers of change were: closeness to the harbour, water quality, and the relative extension of beaches. Our findings suggest that, although efforts to assess cumulative impacts at large scale may help in individuating priority areas for conservation purposes, the fact that such evaluations are often based on expert opinions and not on actual studies limits their ability to represent real environmental conditions at local scale. Systematic evaluations of local scale effects of anthropogenic drivers of change on biological communities should complement broad scale management strategies to achieve effective sustainability of human exploitation of marine resources

Bindarit inhibits human coronary artery smooth muscle cell proliferation, migration and phenotypic switching

Bindarit, a selective inhibitor of monocyte chemotactic proteins (MCPs) synthesis, reduces neointimal formation in animal models of vascular injury and recently has been shown to inhibit in-stent late loss in a placebo-controlled phase II clinical trial. However, the mechanisms underlying the efficacy of bindarit in controlling neointimal formation/restenosis have not been fully elucidated. Therefore, we investigated the effect of bindarit on human coronary smooth muscle cells activation, drawing attention to the phenotypic modulation process, focusing on contractile proteins expression as well as proliferation and migration. The expression of contractile proteins was evaluated by western blot analysis on cultured human coronary smooth muscle cells stimulated with TNF-α (30 ng/mL) or fetal bovine serum (5%). Bindarit (100-300 µM) reduced the embryonic form of smooth muscle myosin heavy chain while increased smooth muscle α-actin and calponin in both TNF-α- and fetal bovine serum-stimulated cells. These effects were associated with the inhibition of human coronary smooth muscle cell proliferation/migration and both MCP-1 and MCP-3 production. The effect of bindarit on smooth muscle cells phenotypic switching was confirmed in vivo in the rat balloon angioplasty model. Bindarit (200 mg/Kg/day) significantly reduced the expression of the embryonic form of smooth muscle myosin heavy chain, and increased smooth muscle α-actin and calponin in the rat carodid arteries subjected to endothelial denudation. Our results demonstrate that bindarit induces the differentiated state of human coronary smooth muscle cells, suggesting a novel underlying mechanisms by which this drug inhibits neointimal formation

Nanostructures for SERS in living cell

Surface-enhanced Raman spectroscopy (SERS) has received renewed interest in recent years in fields such as trace analysis, biorelated diagnosis, and living cell study. However, the interference of impurities left on the surface from the preparation process of substrates limits to some extent the application of SERS. In the present paper, we propose a method to prepare clean SERS substrates by a combined method of hydrothermal green synthesis and thermal treatment to obtain a clean and impurity-free surface for SERS measurements, suitable for cells growth. The goal of such activity was the study of the membrane proteome, with special attention to prion protein (PrPC), in its physiological ambient. SERS has been used to evidence the PrPC-Cu(II) interaction in a rat neuroblastoma cell line (B104), known to overexpress the cellular prion protein PrPC

Ovarian Cancer Biomarkers: A Focus on Genomic and Proteomic Findings

Among the gynaecological malignancies, ovarian cancer is one of the neoplastic forms with the poorest prognosis and with the bad overall and disease-free survival rates than other gynaecological cancers; several studies, analyzing clinical data and pathological features on ovarian cancers, have focused on the identification of both diagnostic and prognostic markers for applications in clinical practice. High-throughput technologies have accelerated the process of biomarker discovery, but their validity should be still demonstrated by extensive researches on sensibility and sensitivity of ovarian cancer novel biomarkers, determining whether gene profiling and proteomics could help differentiate between patients with metastatic ovarian cancer and primary ovarian carcinomas, and their potential impact on management

Blood Metabolite Profiling of Antarctic Expedition Members: An 1H NMR Spectroscopy-Based Study

Serum samples from eight participants during the XV winter-over at Concordia base (Antarctic expedition) collected at defined time points, including predeparture, constituted the key substrates for a specific metabolomics study. To ascertain acute changes and chronic adaptation to hypoxia, the metabolic profiles of the serum samples were analyzed using NMR spectroscopy, with principal components analysis (PCA) followed by partial least squares and orthogonal partial least squares discriminant analyses (PLS-DA and OPLS-DA) used as supervised classification methods. Multivariate data analyses clearly highlighted an adaptation period characterized by an increase in the levels of circulating glutamine and lipids, mobilized to supply the body energy needs. At the same time, a reduction in the circulating levels of glutamate and N-acetyl glycoproteins, stress condition indicators, and proinflammatory markers were also found in the NMR data investigation. Subsequent pathway analysis showed possible perturbations in metabolic processes, potentially related to the physiological adaptation, predominantly found by comparing the baseline (at sea level, before mission onset), the base arrival, and the mission ending collected values

Phosphorylation regulates human polη stability and damage bypass throughout the cell cycle

DNA translesion synthesis (TLS) is a crucial damage tolerance pathway that oversees the completion of DNA replication in the presence of DNA damage. TLS polymerases are capable of bypassing a distorted template but they are generally considered inaccurate and they need to be tightly regulated. We have previously shown that polη is phosphorylated on Serine 601 after DNA damage and we have demonstrated that this modification is important for efficient damage bypass. Here we report that polη is also phosphorylated by CDK2, in the absence of damage, in a cell cycle-dependent manner and we identify serine 687 as an important residue targeted by the kinase. We discover that phosphorylation on serine 687 regulates the stability of the polymerase during the cell cycle, allowing it to accumulate in late S and G2 when productive TLS is critical for cell survival. Furthermore, we show that alongside the phosphorylation of S601, the phosphorylation of S687 and S510, S512 and/or S514 are important for damage bypass and cell survival after UV irradiation. Taken together our results provide new insights into how cells can, at different times, modulate DNA TLS for improved cell survival

3-Aroyl-1,4-diarylpyrroles inhibit chronic myeloid leukemia cell growth through an interaction with tubulin

We designed 3-aroyl-1,4-diarylpyrrole (ARDAP) derivatives as potential anticancer agents having different substituents at the 1- or 4-phenyl ring. ARDAP compounds exhibited potent inhibition of tubulin polymerization, binding of colchicine to tubulin, and cancer cell growth. ARDAP derivative 10 inhibited the proliferation of BCR/ABL-expressing KU812 and LAMA84 cells from chronic myeloid leukemia (CML) patients in blast crisis and of hematopoietic cells ectopically expressing the imatinib mesylate (IM)-sensitive KBM5-WT or its IM-resistant KBM5-T315I mutation. Compound 10 minimally affected the proliferation of normal blood cells, indicating that it may be a promising agent to overcome broad tyrosine kinase inhibitor resistance in relapsed/refractory CML patients. Compound 10 significantly decreased CML proliferation by inducing G2/M phase arrest and apoptosis via a mitochondria-dependent pathway. ARDAP 10 augmented the cytotoxic effects of IM in human CML cells. Compound 10 represents a robust lead compound to develop tubulin inhibitors with potential as novel treatments for CML