Late multimodal fusion for image and audio music transcription

Music transcription, which deals with the conversion of music sources into a structured digital format, is a key problem for Music Information Retrieval (MIR). When addressing this challenge in computational terms, the MIR community follows two lines of research: music documents, which is the case of Optical Music Recognition (OMR), or audio recordings, which is the case of Automatic Music Transcription (AMT). The different nature of the aforementioned input data has conditioned these fields to develop modality-specific frameworks. However, their recent definition in terms of sequence labeling tasks leads to a common output representation, which enables research on a combined paradigm. In this respect, multimodal image and audio music transcription comprises the challenge of effectively combining the information conveyed by image and audio modalities. In this work, we explore this question at a late-fusion level: we study four combination approaches in order to merge, for the first time, the hypotheses regarding end-to-end OMR and AMT systems in a lattice-based search space. The results obtained for a series of performance scenarios–in which the corresponding single-modality models yield different error rates–showed interesting benefits of these approaches. In addition, two of the four strategies considered significantly improve the corresponding unimodal standard recognition frameworks.This paper is part of the I+D+i PID2020-118447RA-I00 (MultiScore) project, funded by MCIN/AEI/10.13039/501100011033. Some of the computing resources were provided by the Generalitat Valenciana and the European Union through the FEDER funding programme (IDIFEDER/2020/003). The first and second authors are respectively supported by grants FPU19/04957 from the Spanish Ministerio de Universidades and APOSTD/2020/256 from Generalitat Valenciana

Few-Shot Symbol Classification via Self-Supervised Learning and Nearest Neighbor

The recognition of symbols within document images is one of the most relevant steps involved in the Document Analysis field. While current state-of-the-art methods based on Deep Learning are capable of adequately performing this task, they generally require a vast amount of data that has to be manually labeled. In this paper, we propose a self-supervised learning-based method that addresses this task by training a neural-based feature extractor with a set of unlabeled documents and performs the recognition task considering just a few reference samples. Experiments on different corpora comprising music, text, and symbol documents report that the proposal is capable of adequately tackling the task with high accuracy rates of up to 95% in few-shot settings. Moreover, results show that the presented strategy outperforms the base supervised learning approaches trained with the same amount of data that, in some cases, even fail to converge. This approach, hence, stands as a lightweight alternative to deal with symbol classification with few annotated data.This paper is part of the project I+D+i PID2020-118447RA-I00 (MultiScore), funded by MCIN/AEI/10.13039/501100011033. The first author is supported by grant FPU19/04957 from the Spanish Ministerio de Universidades. The second and third authors are respectively supported by grants ACIF/2021/356 and APOSTD/2020/256 from “Programa I+D+i de la Generalitat Valenciana”

Decoupling music notation to improve end-to-end Optical Music Recognition

Inspired by the Text Recognition field, end-to-end schemes based on Convolutional Recurrent Neural Networks (CRNN) trained with the Connectionist Temporal Classification (CTC) loss function are considered one of the current state-of-the-art techniques for staff-level Optical Music Recognition (OMR). Unlike text symbols, music-notation elements may be defined as a combination of (i) a shape primitive located in (ii) a certain position in a staff. However, this double nature is generally neglected in the learning process, as each combination is treated as a single token. In this work, we study whether exploiting such particularity of music notation actually benefits the recognition performance and, if so, which approach is the most appropriate. For that, we thoroughly review existing specific approaches that explore this premise and propose different combinations of them. Furthermore, considering the limitations observed in such approaches, a novel decoding strategy specifically designed for OMR is proposed. The results obtained with four different corpora of historical manuscripts show the relevance of leveraging this double nature of music notation since it outperforms the standard approaches where it is ignored. In addition, the proposed decoding leads to significant reductions in the error rates with respect to the other cases.This paper is part of the project I+D+i PID2020-118447RA-I00 (MultiScore), funded by MCIN/AEI/10.13039/501100011033. The first author is supported by grant FPU19/04957 from the Spanish Ministerio de Universidades. The second author is supported by grant ACIF/2021/356 from “Programa I+D+i de la Generalitat Valenciana“. The third author is supported by grant APOSTD/2020/256 from “Programa I+D+i de la Generalitat Valenciana”

Genetic Deletion of NOD1 Prevents Cardiac Ca2+ Mishandling Induced by Experimental Chronic Kidney Disease

© 2020 by the authors.Risk of cardiovascular disease (CVD) increases considerably as renal function declines in chronic kidney disease (CKD). Nucleotide-binding oligomerization domain-containing protein 1 (NOD1) has emerged as a novel innate immune receptor involved in both CVD and CKD. Following activation, NOD1 undergoes a conformational change that allows the activation of the receptor-interacting serine/threonine protein kinase 2 (RIP2), promoting an inflammatory response. We evaluated whether the genetic deficiency of Nod1 or Rip2 in mice could prevent cardiac Ca2+ mishandling induced by sixth nephrectomy (Nx), a model of CKD. We examined intracellular Ca2+ dynamics in cardiomyocytes from Wild-type (Wt), Nod1−/− and Rip2−/− sham-operated or nephrectomized mice. Compared with Wt cardiomyocytes, Wt-Nx cells showed an impairment in the properties and kinetics of the intracellular Ca2+ transients, a reduction in both cell shortening and sarcoplasmic reticulum Ca2+ load, together with an increase in diastolic Ca2+ leak. Cardiomyocytes from Nod1−/−-Nx and Rip2−/−-Nx mice showed a significant amelioration in Ca2+ mishandling without modifying the kidney impairment induced by Nx. In conclusion, Nod1 and Rip2 deficiency prevents the intracellular Ca2+ mishandling induced by experimental CKD, unveiling new innate immune targets for the development of innovative therapeutic strategies to reduce cardiac complications in patients with CKD.This work was supported by Spanish Ministry of Economy and Competitiveness and European Regional Development Fund (SAF-2017-84777R), Institute of Health Carlos III (PI17/01093 and PI17/01344), Sociedad Española de Cardiología, Proyecto Traslacional 2019, Fundación Renal Íñigo Álvarez de Toledo (FRIAT), Fondo Europeo de Desarrollo Regional (FEDER), FSE, and CIBER-CV, a network funded by ISCIII. M.F.-V. is Miguel Servet II researcher of ISCIII (MSII16/00047 Carlos III Health Institute). G.R.-H. is Miguel Servet I researcher of ISCIII (CP15/00129 Carlos III Health Institute). M.T. is a PhD student funded by the FPU program of the Spanish Ministry of Science, Innovation and Universities (FPU17/06135). A.R. was supported by Fondo SEP-Cinvestav project #601410 FIDSC 2018/2; and Fondo SEP-Conacyt Ciencia Básica A1-S-9082

EMMPRIN-targeted magnetic nanoparticles for In vivo visualization and regression of acute myocardial infarction.

Inhibition of extracellular matrix (ECM) degradation may represent a mechanism for cardiac protection against ischemia. Extracellular matrix metalloproteinase inducer (EMMPRIN) is highly expressed in response to acute myocardial infarction (AMI), and induces activation of several matrix metalloproteinases (MMPs), including gelatinases MMP-2 and MMP-9. We targeted EMMPRIN with paramagnetic/fluorescent micellar nanoparticles conjugated with the EMMPRIN binding peptide AP-9 (NAP9), or an AP-9 scrambled peptide as a negative control (NAPSC). We found that NAP9 binds to endogenous EMMPRIN in cultured HL1 myocytes and in mouse hearts subjected to ischemia/reperfusion (IR). Injection of NAP9 at the time of or one day after IR, was enough to reduce progression of myocardial cell death when compared to CONTROL and NAPSC injected mice (infarct size in NAP9 injected mice: 32%±6.59 vs 46%±9.04 or NAPSC injected mice: 48%±7.64). In the same way, cardiac parameters were recovered to almost healthy levels (LVEF NAP9 63% ± 7.24 vs CONTROL 42% ± 4.74 or NAPSC 39% ± 6.44), whereas ECM degradation was also reduced as shown by inhibition of MMP-2 and MMP-9 activation. Cardiac magnetic resonance (CMR) scans have shown a signal enhancement in the left ventricle of NAP9 injected mice with respect to non-injected, and to mice injected with NAPSC. A positive correlation between CMR enhancement and Evans-Blue/TTC staining of infarct size was calculated (R:0.65). Taken together, these results point to EMMPRIN targeted nanoparticles as a new approach to the mitigation of ischemic/reperfusion injury.Ministerio de Economía y CompetitividadInstituto de Salud Carlos II

The immunogenetic diversity of the HLA system in Mexico correlates with underlying population genetic structure

We studied HLA class I (HLA-A, -B) and class II (HLA-DRB1, -DQB1) allele groups and alleles by PCR-SSP based typing in a total of 15,318 mixed ancestry Mexicans from all the states of the country divided into 78 sample sets, providing information regarding allelic and haplotypic frequencies and their linkage disequilibrium, as well as admixture estimates and genetic substructure. We identified the presence of 4268 unique HLA extended haplotypes across Mexico and find that the ten most frequent (HF > 1%) HLA haplotypes with significant linkage disequilibrium (Δ’≥0.1) in Mexico (accounting for 20% of the haplotypic diversity of the country) are of primarily Native American ancestry (A*02~B*39~DRB1*04~DQB1*03:02, A*02~B*35~DRB1*08~DQB1*04, A*68~B*39~DRB1*04~DQB1*03:02, A*02~B*35~DRB1*04~DQB1*03:02, A*24~B*39~DRB1*14~DQB1*03:01, A*24~B*35~DRB1*04~DQB1*03:02, A*24~B*39~DRB1*04~DQB1*03:02, A*02~B*40:02~DRB1*04~DQB1*03:02, A*68~B*35~DRB1*04~DQB1*03:02, A*02~B*15:01~DRB1*04~DQB1*03:02). Admixture estimates obtained by a maximum likelihood method using HLA-A/-B/-DRB1 as genetic estimators revealed that the main genetic components in Mexico as a whole are Native American (ranging from 37.8% in the northern part of the country to 81.5% in the southeastern region) and European (ranging from 11.5% in the southeast to 62.6% in northern Mexico). African admixture ranged from 0.0 to 12.7% not following any specific pattern. We were able to detect three major immunogenetic clusters correlating with genetic diversity and differential admixture within Mexico: North, Central and Southeast, which is in accordance with previous reports using genome-wide data. Our findings provide insights into the population immunogenetic substructure of the whole country and add to the knowledge of mixed ancestry Latin American population genetics, important for disease association studies, detection of demographic signatures on population variation and improved allocation of public health resources.Fil: Barquera, Rodrigo. Max Planck Institute For The Science Of Human History; Alemania. Instituto Nacional de Antropología E Historia. Escuela Nacional de Antropología E Historia; MéxicoFil: Hernández Zaragoza, Diana Iraíz. Técnicas Genéticas Aplicadas A la Clínica (tgac); México. Instituto Nacional de Antropología E Historia. Escuela Nacional de Antropología E Historia; MéxicoFil: Bravo Acevedo, Alicia. Instituto Mexicano del Seguro Social; MéxicoFil: Arrieta Bolaños, Esteban. Universitat Essen; AlemaniaFil: Clayton, Stephen. Max Planck Institute For The Science Of Human History; AlemaniaFil: Acuña Alonzo, Víctor. Instituto Nacional de Antropología E Historia, Mexico; MéxicoFil: Martínez Álvarez, Julio César. Instituto Mexicano del Seguro Social; MéxicoFil: López Gil, Concepción. Instituto Mexicano del Seguro Social; MéxicoFil: Adalid Sáinz, Carmen. Instituto Mexicano del Seguro Social; MéxicoFil: Vega Martínez, María del Rosario. Hospital Central Sur de Alta Especialidad; MéxicoFil: Escobedo Ruíz, Araceli. Instituto Mexicano del Seguro Social; MéxicoFil: Juárez Cortés, Eva Dolores. Instituto Mexicano del Seguro Social; MéxicoFil: Immel, Alexander. Max Planck Institute For The Science Of Human History; Alemania. Christian Albrechts Universitat Zu Kiel; AlemaniaFil: Pacheco Ubaldo, Hanna. Instituto Nacional de Antropología E Historia. Escuela Nacional de Antropología E Historia; MéxicoFil: González Medina, Liliana. Instituto Nacional de Antropología E Historia. Escuela Nacional de Antropología E Historia; MéxicoFil: Lona Sánchez, Abraham. Instituto Nacional de Antropología E Historia. Escuela Nacional de Antropología E Historia; MéxicoFil: Lara Riegos, Julio. Universidad Autónoma de Yucatán; MéxicoFil: Sánchez Fernández, María Guadalupe de Jesús. Instituto Mexicano del Seguro Social; MéxicoFil: Díaz López, Rosario. Hospital Central Militar, Mexico City; MéxicoFil: Guizar López, Gregorio Ulises. Hospital Central Militar, Mexico City; MéxicoFil: Medina Escobedo, Carolina Elizabeth. Instituto Mexicano del Seguro Social; MéxicoFil: Arrazola García, María Araceli. Instituto Mexicano del Seguro Social; MéxicoFil: Montiel Hernández, Gustavo Daniel. Instituto Nacional de Antropología E Historia. Escuela Nacional de Antropología E Historia; MéxicoFil: Hernández Hernández, Ofelia. Técnicas Genéticas Aplicadas a la Clínica ; MéxicoFil: Ramos de la Cruz, Flor del Rocío. Instituto Mexicano del Seguro Social; MéxicoFil: Juárez Nicolás, Francisco. Instituto Nacional de Pediatría; MéxicoFil: Pantoja Torres, Jorge Arturo. Instituto Mexicano del Seguro Social; MéxicoFil: Rodríguez Munguía, Tirzo Jesús. Hospital General Norberto Treviño Zapata; MéxicoFil: Juárez Barreto, Vicencio. Hospital Infantil de Mexico Federico Gomez; MéxicoFil: Gonzalez-Jose, Rolando. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Centro Nacional Patagónico. Instituto Patagónico de Ciencias Sociales y Humanas; Argentin

Shape-dependent catalytic activity of palladium nanoparticles embedded in SiO2 and TiO2

Catalytic studies have shown that the activity of metal nanoparticles depends on their size and shape. Palladium nanoparticles with different morphologies have been prepared and embedded in a SiO2 and TiO2 matrix, and their catalytic performance in the solvent-free aerobic oxidation of 1-phenylethanol has been studied. The observed activity is strongly related to the exposed surface sites, being some of the active sites embedded in the matrix or blocked by residual organic species. (1 1 1)/(1 0 0) edge sites are involved in the oxidativ dehydrogenation of 1-phenylethanol. The amount of these sites depends on particle morphology. Under our conditions, Pdbars SiO2 (Pd nanobars embedded in SiO2) were found to be the most active.We gratefully acknowledge financial support from CICYT (MAT 2006-14274-C02-01) and Consolider-Ingenio-2010 (project MULTICAT). We would like to thank Dr. Juan Garc a Rodriguez of the Universidad Complutense de Madrid for providing hydrogen chemisorption measurements and useful discussions.Pérez Cortés, Y.; Ruiz-González María Luisa; González Calbet, JM.; Concepción Heydorn, P.; Boronat Zaragoza, M.; Corma Canós, A. (2012). Shape-dependent catalytic activity of palladium nanoparticles embedded in SiO2 and TiO2. Catalysis Today. 180(1):59-67. doi:10.1016/j.cattod.2011.09.011S5967180

Evaluación cuantitativa de las especificaciones de diseño en problemas de síntesis de sonido mediante aprendizaje automático

La evaluación de las tareas en problemas de síntesis de sonido constituye un reto dada la naturaleza acústica de la salida, forzando generalmente a un proceso de corrección manual con las desventajas de subjetividad y cansancio que ello conlleva. En este trabajo proponemos un modelo que sea capaz de evaluar este tipo de problemas de manera automática y así apoyar al docente en esta tarea con la finalidad de que pueda destinar ese tiempo a otro tipo de tareas docentes con más impacto en el proceso de enseñanza-aprendizaje del alumno. La propuesta se basa en modelos de aprendizaje neuronal profundo, concretamente las llamadas Redes Siamesas, los cuales permiten medir la similitud entre dos elementos de entrada. En nuestro caso, en base a un grupo de datos etiquetados como correctos e incorrectos, el modelo nos permite estimar a qué tipo de elemento se asemejan más las diferentes entregas de los alumnos. Los resultados obtenidos con una serie de escenarios simulados en base a entregas de estudiantes de la asignatura Síntesis Digital de Sonido del Grado en Ingeniería en Sonido e Imagen en Telecomunicación validan la propuesta realizada en todos los casos propuestos

Neurocognitive Suicide and Homicide Markers in Patients with Schizophrenia Spectrum Disorders: A Systematic Review

Suicide and homicide are considered important problems in public health. This study aims to identify the cognitive performance of suicidal and homicidal behaviors in people with schizophrenia spectrum disorders, as well as examining whether there are shared neuropsychological mechanisms. A systematic review of the recent literature was carried out from September 2012 to June 2022 using the Medline (via PubMed), Scopus, Embase, and Cochrane databases. Among the 870 studies initially identified, 23 were finally selected (15 related to suicidal behaviors and 8 to homicidal behaviors). The results evidenced a relationship between impairment of cognitive performance and homicidal behavior; meanwhile, for suicidal behaviors, no consistent results were found. High neuropsychological performance seems to act as a protective factor against violent behavior in people with schizophrenia spectrum disorders, but not against suicidal behavior; indeed, it can even act as a risk factor for suicidal behavior. To date, there is insufficient evidence that shared neurocognitive mechanisms exist. However, processing speed and visual memory seem to be affected in the presence of both behaviors