Saliency Benchmarking Made Easy: Separating Models, Maps and Metrics

Dozens of new models on fixation prediction are published every year and compared on open benchmarks such as MIT300 and LSUN. However, progress in the field can be difficult to judge because models are compared using a variety of inconsistent metrics. Here we show that no single saliency map can perform well under all metrics. Instead, we propose a principled approach to solve the benchmarking problem by separating the notions of saliency models, maps and metrics. Inspired by Bayesian decision theory, we define a saliency model to be a probabilistic model of fixation density prediction and a saliency map to be a metric-specific prediction derived from the model density which maximizes the expected performance on that metric given the model density. We derive these optimal saliency maps for the most commonly used saliency metrics (AUC, sAUC, NSS, CC, SIM, KL-Div) and show that they can be computed analytically or approximated with high precision. We show that this leads to consistent rankings in all metrics and avoids the penalties of using one saliency map for all metrics. Our method allows researchers to have their model compete on many different metrics with state-of-the-art in those metrics: "good" models will perform well in all metrics.Comment: published at ECCV 201

Infant Cognitive Scores Prediction With Multi-stream Attention-based Temporal Path Signature Features

There is stunning rapid development of human brains in the first year of life. Some studies have revealed the tight connection between cognition skills and cortical morphology in this period. Nonetheless, it is still a great challenge to predict cognitive scores using brain morphological features, given issues like small sample size and missing data in longitudinal studies. In this work, for the first time, we introduce the path signature method to explore hidden analytical and geometric properties of longitudinal cortical morphology features. A novel BrainPSNet is proposed with a differentiable temporal path signature layer to produce informative representations of different time points and various temporal granules. Further, a two-stream neural network is included to combine groups of raw features and path signature features for predicting the cognitive score. More importantly, considering different influences of each brain region on the cognitive function, we design a learning-based attention mask generator to automatically weight regions correspondingly. Experiments are conducted on an in-house longitudinal dataset. By comparing with several recent algorithms, the proposed method achieves the state-of-the-art performance. The relationship between morphological features and cognitive abilities is also analyzed

Multiview classification and dimensionality reduction of scalp and intracranial EEG data through tensor factorisation

Electroencephalography (EEG) signals arise as a mixture of various neural processes that occur in different spatial, frequency and temporal locations. In classification paradigms, algorithms are developed that can distinguish between these processes. In this work, we apply tensor factorisation to a set of EEG data from a group of epileptic patients and factorise the data into three modes; space, time and frequency with each mode containing a number of components or signatures. We train separate classifiers on various feature sets corresponding to complementary combinations of those modes and components and test the classification accuracy of each set. The relative influence on the classification accuracy of the respective spatial, temporal or frequency signatures can then be analysed and useful interpretations can be made. Additionaly, we show that through tensor factorisation we can perform dimensionality reduction by evaluating the classification performance with regards to the number mode components and by rejecting components with insignificant contribution to the classification accuracy

A novel selection of optimal statistical features in the DWPT domain for discrimination of ictal and seizure-free electroencephalography signals

Properly determining the discriminative features which characterize the inherent behaviors of electroencephalography (EEG) signals remains a great challenge for epileptic seizure detection. In this present study, a novel feature selection scheme based on the discrete wavelet packet decomposition and cuckoo search algorithm (CSA) was proposed. The normal as well as epileptic EEG recordings were frst decomposed into various frequency bands by means of wavelet packet decomposition, and subsequently, statistical features at all developed nodes in the wavelet packet decomposition tree were derived. Instead of using the complete set of the extracted features to construct a wavelet neural networks-based classifer, an optimal feature subset that maximizes the predictive competence of the classifer was selected by using the CSA. Experimental results on the publicly available benchmarks demonstrated that the proposed feature subset selection scheme achieved promising recognition accuracies of 98.43–100%, and the results were statistically signifcant using z-test with p value <0.0001

Masonry compressive strength prediction using artificial neural networks

The masonry is not only included among the oldest building materials, but it is also the most widely used material due to its simple construction and low cost compared to the other modern building materials. Nevertheless, there is not yet a robust quantitative method, available in the literature, which can reliably predict its strength, based on the geometrical and mechanical characteristics of its components. This limitation is due to the highly nonlinear relation between the compressive strength of masonry and the geometrical and mechanical properties of the components of the masonry. In this paper, the application of artificial neural networks for predicting the compressive strength of masonry has been investigated. Specifically, back-propagation neural network models have been used for predicting the compressive strength of masonry prism based on experimental data available in the literature. The comparison of the derived results with the experimental findings demonstrates the ability of artificial neural networks to approximate the compressive strength of masonry walls in a reliable and robust manner.- (undefined

Functional Relationship between Protein Disulfide Isomerase Family Members during the Oxidative Folding of Human Secretory Proteins

We systematically depleted PDI family members and show that whereas ERp72 and P5 contributed minimally to oxidative protein folding, PDI and ERp57 were the predominant catalysts. Depletion of PDI or ERp57 alone modestly delayed folding, but depletion of both led to generalized protein misfolding and degradation

Consensus Middle East and North Africa Registry on Inborn Errors of Immunity

Background: Inborn errors of immunity (IEIs) are a heterogeneous group of genetic defects of immunity, which cause high rates of morbidity and mortality mainly among children due to infectious and non-infectious complications. The IEI burden has been critically underestimated in countries from middle- and low-income regions and the majority of patients with IEI in these regions lack a molecular diagnosis. Methods: We analyzed the clinical, immunologic, and genetic data of IEI patients from 22 countries in the Middle East and North Africa (MENA) region. The data was collected from national registries and diverse databases such as the Asian Pacific Society for Immunodeficiencies (APSID) registry, African Society for Immunodeficiencies (ASID) registry, Jeffrey Modell Foundation (JMF) registry, J Project centers, and International Consortium on Immune Deficiency (ICID) centers. Results: We identified 17,120 patients with IEI, among which females represented 39.4%. Parental consanguinity was present in 60.5% of cases and 27.3% of the patients were from families with a confirmed previous family history of IEI. The median age of patients at the onset of disease was 36 months and the median delay in diagnosis was 41 months. The rate of registered IEI patients ranges between 0.02 and 7.58 per 100,000 population, and the lowest rates were in countries with the highest rates of disability-adjusted life years (DALY) and death rates for children. Predominantly antibody deficiencies were the most frequent IEI entities diagnosed in 41.2% of the cohort. Among 5871 patients genetically evaluated, the diagnostic yield was 83% with the majority (65.2%) having autosomal recessive defects. The mortality rate was the highest in patients with non-syndromic combined immunodeficiency (51.7%, median age: 3.5 years) and particularly in patients with mutations in specific genes associated with this phenotype (RFXANK, RAG1, and IL2RG). Conclusions: This comprehensive registry highlights the importance of a detailed investigation of IEI patients in the MENA region. The high yield of genetic diagnosis of IEI in this region has important implications for prevention, prognosis, treatment, and resource allocation

Guidelines for the use and interpretation of assays for monitoring autophagy (4th edition)1.

In 2008, we published the first set of guidelines for standardizing research in autophagy. Since then, this topic has received increasing attention, and many scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Thus, it is important to formulate on a regular basis updated guidelines for monitoring autophagy in different organisms. Despite numerous reviews, there continues to be confusion regarding acceptable methods to evaluate autophagy, especially in multicellular eukaryotes. Here, we present a set of guidelines for investigators to select and interpret methods to examine autophagy and related processes, and for reviewers to provide realistic and reasonable critiques of reports that are focused on these processes. These guidelines are not meant to be a dogmatic set of rules, because the appropriateness of any assay largely depends on the question being asked and the system being used. Moreover, no individual assay is perfect for every situation, calling for the use of multiple techniques to properly monitor autophagy in each experimental setting. Finally, several core components of the autophagy machinery have been implicated in distinct autophagic processes (canonical and noncanonical autophagy), implying that genetic approaches to block autophagy should rely on targeting two or more autophagy-related genes that ideally participate in distinct steps of the pathway. Along similar lines, because multiple proteins involved in autophagy also regulate other cellular pathways including apoptosis, not all of them can be used as a specific marker for bona fide autophagic responses. Here, we critically discuss current methods of assessing autophagy and the information they can, or cannot, provide. Our ultimate goal is to encourage intellectual and technical innovation in the field

Guidelines for the use and interpretation of assays for monitoring autophagy (3rd edition)

In 2008 we published the first set of guidelines for standardizing research in autophagy. Since then, research on this topic has continued to accelerate, and many new scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Accordingly, it is important to update these guidelines for monitoring autophagy in different organisms. Various reviews have described the range of assays that have been used for this purpose. Nevertheless, there continues to be confusion regarding acceptable methods to measure autophagy, especially in multicellular eukaryotes. For example, a key point that needs to be emphasized is that there is a difference between measurements that monitor the numbers or volume of autophagic elements (e.g., autophagosomes or autolysosomes) at any stage of the autophagic process versus those that measure fl ux through the autophagy pathway (i.e., the complete process including the amount and rate of cargo sequestered and degraded). In particular, a block in macroautophagy that results in autophagosome accumulation must be differentiated from stimuli that increase autophagic activity, defi ned as increased autophagy induction coupled with increased delivery to, and degradation within, lysosomes (inmost higher eukaryotes and some protists such as Dictyostelium ) or the vacuole (in plants and fungi). In other words, it is especially important that investigators new to the fi eld understand that the appearance of more autophagosomes does not necessarily equate with more autophagy. In fact, in many cases, autophagosomes accumulate because of a block in trafficking to lysosomes without a concomitant change in autophagosome biogenesis, whereas an increase in autolysosomes may reflect a reduction in degradative activity. It is worth emphasizing here that lysosomal digestion is a stage of autophagy and evaluating its competence is a crucial part of the evaluation of autophagic flux, or complete autophagy. Here, we present a set of guidelines for the selection and interpretation of methods for use by investigators who aim to examine macroautophagy and related processes, as well as for reviewers who need to provide realistic and reasonable critiques of papers that are focused on these processes. These guidelines are not meant to be a formulaic set of rules, because the appropriate assays depend in part on the question being asked and the system being used. In addition, we emphasize that no individual assay is guaranteed to be the most appropriate one in every situation, and we strongly recommend the use of multiple assays to monitor autophagy. Along these lines, because of the potential for pleiotropic effects due to blocking autophagy through genetic manipulation it is imperative to delete or knock down more than one autophagy-related gene. In addition, some individual Atg proteins, or groups of proteins, are involved in other cellular pathways so not all Atg proteins can be used as a specific marker for an autophagic process. In these guidelines, we consider these various methods of assessing autophagy and what information can, or cannot, be obtained from them. Finally, by discussing the merits and limits of particular autophagy assays, we hope to encourage technical innovation in the field