Spectral and temporal features as the estimators of the irrelevant speech effect

The distractive effects on cognitive processes ascribed to the nature of sound havebeen studied in the paradigm of ”irrelevant sound,” where test participants perform cognitivetasks in the presence of background noise. By comparing the test scores for different acousticstimulus conditions in such experiments, the ”irrelevant sound (speech) effect” (ISE) can bequantified. The ISE is often explained by the changing state hypothesis: the distinctivesegmentation of sound tokens; where tokens may be understood as sound segments that canbe distinguished from each other in temporal and/or spectral characteristics. A sequence ofsounds consisting of differing tokens produces much more disruption than a steady-statesound. The present work investigates the relationship between the features from bothtemporal and spectral domains and the ISE, predicting separately the magnitude of the effectwith two estimators: The Average Modulation Transfer Function (AMTF) and the FrequencyDomain Correlation Coefficient (FDCC). The first parameter is a measure for temporalvariations in a sound, whilst the latter measures spectral variability in the sounds. Backgroundstimuli are synthesized from a pulse train in which modified and unmodified pulses alternate.In order to manipulate the temporal and spectral features in the stimuli, a numericaloptimization method was used to generate two sets of background stimuli where one of thetwo descriptors was always kept constant and the other was varied in a systematic way.Therefore, stimulus sets used in this study allow the separate estimation of the role of the twoestimators on cognitive performance in tasks involving serial ordering of short-term memorycontent

A CNN CADx System for Multimodal Classification of Colorectal Polyps Combining WL, BLI, and LCI Modalities

Colorectal polyps are critical indicators of colorectal cancer (CRC). Blue Laser Imaging and Linked Color Imaging are two modalities that allow improved visualization of the colon. In conjunction with the Blue Laser Imaging (BLI) Adenoma Serrated International Classification (BASIC) classification, endoscopists are capable of distinguishing benign and pre-malignant polyps. Despite these advancements, this classification still prevails a high misclassification rate for pre-malignant colorectal polyps. This work proposes a computer aided diagnosis (CADx) system that exploits the additional information contained in two novel imaging modalities, enabling more informative decision-making during colonoscopy. We train and benchmark six commonly used CNN architectures and compare the results with 19 endoscopists that employed the standard clinical classification model (BASIC). The proposed CADx system for classifying colorectal polyps achieves an area under the curve (AUC) of 0.97. Furthermore, we incorporate visual explanatory information together with a probability score, jointly computed from White Light, Blue Laser Imaging, and Linked Color Imaging. Our CADx system for automatic polyp malignancy classification facilitates future advances towards patient safety and may reduce time-consuming and costly histology assessment