Evaluating Pre-Trained Transformers on Italian Administrative Texts

In recent years, Transformer-based models have been widely used in NLP for various downstream tasks and in different domains. However, a language model explicitly built for the Italian administrative language is still lacking. Therefore, in this paper, we decided to compare the performance of five different Transformer models, pre-trained on general purpose texts, on two main tasks in the Italian administrative domain: Name Entity Recognition and multi-label document classification on Public Administration (PA) documents. We evaluate the performance of each model on both tasks to identify the best model in this particular domain. We also discuss the effect of model size and pre-training data on the performances on domain data. Our evaluation identifies UmBERTo as the best-performing model, with an accuracy of 0.71, an F1 score of 0.89 for multi-label document classification, and an F1 score of 0.87 for NER-PA

Challenging specialized transformers on zero-shot classification

This paper investigates the feasibility of employing basic prompting systems for domain-specific language models. The study focuses on bureaucratic language and uses the recently introduced BureauBERTo model for experimentation. The experiments reveal that while further pre-trained models exhibit reduced robustness concerning general knowledge, they display greater adaptability in modeling domain-specific tasks, even under a zero-shot paradigm. This demonstrates the potential of leveraging simple prompting systems in specialized contexts, providing valuable insights both for research and industry

Reconciling CloudSat and GPM Estimates of Falling Snow

Satellite-based estimates of falling snow have been provided by CloudSat (launched in 2006) and the Global Precipitation Measurement (GPM) core satellite (launched in 2014). The CloudSat estimates are derived from W-band radar measurements whereas the GPM estimates are derived from its scanning Ku- and Ka-band Dual-Frequency Precipitation Radar (DPR) and 13-channel microwave imager (GMI). Each platform has advantages and disadvantages: CloudSat has higher resolution (approximately 1.5 km) and much better sensitivity (-28 dBZ), but poorer sampling (nadir-only and daytime-only since 2011) and the reflectivity-snowfall (Z-S) relationship is poorly constrained with single-frequency measurements. Meanwhile, DPR suffers from relatively poor resolution (5 km) and sensitivity (approximately 13 dBZ), but has cross-track scanning capability to cover a 245-km swath. Additionally, where Ku and Ka measurements are available, the conversion of reflectivity to snowfall rate is better-constrained than with a single frequency

Ancient encaustic: An experimental exploration of technology, ageing behaviour and approaches to analytical investigation

The composition of the ancient wax-based painting technique known as encaustic has long been the subject of debate. Ancient sources provide few details of the technology, and modern understanding of the medium is restricted to theoretical interpretation and experimental observation. In this multi-analytical collaborative study, a number of analytical approaches were used to investigate the physical and molecular properties of a range of experimentally prepared encaustic paints before and after ageing. Analysis using gas chromatography mass spectrometry, Fourier transform infrared spectroscopy (invasive and non-invasive), X-ray diffraction and thermogravimetric analysis demonstrated how differences in the technology of production alter the properties and composition of the medium and showed how these are modified by the addition of pigment and the effects of ageing. Comparison of results from the different analytical techniques highlights the benefit of an integrated analytical approach to the analysis of ancient encaustic paints and the fundamental importance of insights from invasive study to evaluating the results of non-invasive analysis

Global Regulation of Nucleotide Biosynthetic Genes by c-Myc

The c-Myc transcription factor is a master regulator and integrates cell proliferation, cell growth and metabolism through activating thousands of target genes. Our identification of direct c-Myc target genes by chromatin immunoprecipitation (ChIP) coupled with pair-end ditag sequencing analysis (ChIP-PET) revealed that nucleotide metabolic genes are enriched among c-Myc targets, but the role of Myc in regulating nucleotide metabolic genes has not been comprehensively delineated.Here, we report that the majority of genes in human purine and pyrimidine biosynthesis pathway were induced and directly bound by c-Myc in the P493-6 human Burkitt's lymphoma model cell line. The majority of these genes were also responsive to the ligand-activated Myc-estrogen receptor fusion protein, Myc-ER, in a Myc null rat fibroblast cell line, HO.15 MYC-ER. Furthermore, these targets are also responsive to Myc activation in transgenic mouse livers in vivo. To determine the functional significance of c-Myc regulation of nucleotide metabolism, we sought to determine the effect of loss of function of direct Myc targets inosine monophosphate dehydrogenases (IMPDH1 and IMPDH2) on c-Myc-induced cell growth and proliferation. In this regard, we used a specific IMPDH inhibitor mycophenolic acid (MPA) and found that MPA dramatically inhibits c-Myc-induced P493-6 cell proliferation through S-phase arrest and apoptosis.Taken together, these results demonstrate the direct induction of nucleotide metabolic genes by c-Myc in multiple systems. Our finding of an S-phase arrest in cells with diminished IMPDH activity suggests that nucleotide pool balance is essential for c-Myc's orchestration of DNA replication, such that uncoupling of these two processes create DNA replication stress and apoptosis

A Mitosis Block Links Active Cell Cycle with Human Epidermal Differentiation and Results in Endoreplication

How human self-renewal tissues co-ordinate proliferation with differentiation is unclear. Human epidermis undergoes continuous cell growth and differentiation and is permanently exposed to mutagenic hazard. Keratinocytes are thought to arrest cell growth and cell cycle prior to terminal differentiation. However, a growing body of evidence does not satisfy this model. For instance, it does not explain how skin maintains tissue structure in hyperproliferative benign lesions. We have developed and applied novel cell cycle techniques to human skin in situ and determined the dynamics of key cell cycle regulators of DNA replication or mitosis, such as cyclins E, A and B, or members of the anaphase promoting complex pathway: cdc14A, Ndc80/Hec1 and Aurora kinase B. The results show that actively cycling keratinocytes initiate terminal differentiation, arrest in mitosis, continue DNA replication in a special G2/M state, and become polyploid by mitotic slippage. They unambiguously demonstrate that cell cycle progression coexists with terminal differentiation, thus explaining how differentiating cells increase in size. Epidermal differentiating cells arrest in mitosis and a genotoxic-induced mitosis block rapidly pushes epidermal basal cells into differentiation and polyploidy. These observations unravel a novel mitosis-differentiation link that provides new insight into skin homeostasis and cancer. It might constitute a self-defence mechanism against oncogenic alterations such as Myc deregulation

Crosstalk between reactive oxygen species and pro-inflammatory markers in developing various chronic diseases: a review

The inflammation process in the human body plays a central role in the pathogenesis of many chronic diseases. In addition, reactive oxygen species (ROS) exert potentially a decisive role in human body, particularly in physiological and pathological process. The chronic inflammation state could generate several types of diseases such as cancer, atherosclerosis, diabetes mellitus and arthritis, especially if it is concomitant with high levels of pro-inflammatory markers and ROS. The respiratory burst of inflammatory cells during inflammation increases the production and accumulation of ROS. However, ROS regulate various types of kinases and transcription factors such nuclear factor-kappa B which is related to the activation of pro-inflammatory genes. The exact crosstalk between pro-inflammatory markers and ROS in terms of pathogenesis and development of serious diseases is still ambitious. Many studies have been attempting to determine the mechanistic mutual relationship between ROS and pro-inflammatory markers. Therefore hereby, we review the hypothetical relationship between ROS and pro-inflammatory markers in which they have been proposed to initiate cancer, atherosclerosis, diabetes mellitus and arthritis

EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

Welcome to EVALITA 2020! EVALITA is the evaluation campaign of Natural Language Processing and Speech Tools for Italian. EVALITA is an initiative of the Italian Association for Computational Linguistics (AILC, http://www.ai-lc.it) and it is endorsed by the Italian Association for Artificial Intelligence (AIxIA, http://www.aixia.it) and the Italian Association for Speech Sciences (AISV, http://www.aisv.it)