Predictive coding in auditory perception: challenges and unresolved questions.

Predictive coding is arguably the currently dominant theoretical framework for the study of perception. It has been employed to explain important auditory perceptual phenomena, and it has inspired theoretical, experimental and computational modelling efforts aimed at describing how the auditory system parses the complex sound input into meaningful units (auditory scene analysis). These efforts have uncovered some vital questions, addressing which could help to further specify predictive coding and clarify some of its basic assumptions. The goal of the current review is to motivate these questions and show how unresolved issues in explaining some auditory phenomena lead to general questions of the theoretical framework. We focus on experimental and computational modelling issues related to sequential grouping in auditory scene analysis (auditory pattern detection and bistable perception), as we believe that this is the research topic where predictive coding has the highest potential for advancing our understanding. In addition to specific questions, our analysis led us to identify three more general questions that require further clarification: (1) What exactly is meant by prediction in predictive coding? (2) What governs which generative models make the predictions? and (3) What (if it exists) is the correlate of perceptual experience within the predictive coding framework

A Spiking Self-Organising Map Combining STDP, Oscillations and Continuous Learning

Open Access article EPSRC EP/C010841/1, EP/J004561/

Modelling the Emergence and Dynamics of Perceptual Organisation in Auditory Streaming

Many sound sources can only be recognised from the pattern of sounds they emit, and not from the individual sound events that make up their emission sequences. Auditory scene analysis addresses the difficult task of interpreting the sound world in terms of an unknown number of discrete sound sources (causes) with possibly overlapping signals, and therefore of associating each event with the appropriate source. There are potentially many different ways in which incoming events can be assigned to different causes, which means that the auditory system has to choose between them. This problem has been studied for many years using the auditory streaming paradigm, and recently it has become apparent that instead of making one fixed perceptual decision, given sufficient time, auditory perception switches back and forth between the alternatives—a phenomenon known as perceptual bi- or multi-stability. We propose a new model of auditory scene analysis at the core of which is a process that seeks to discover predictable patterns in the ongoing sound sequence. Representations of predictable fragments are created on the fly, and are maintained, strengthened or weakened on the basis of their predictive success, and conflict with other representations. Auditory perceptual organisation emerges spontaneously from the nature of the competition between these representations. We present detailed comparisons between the model simulations and data from an auditory streaming experiment, and show that the model accounts for many important findings, including: the emergence of, and switching between, alternative organisations; the influence of stimulus parameters on perceptual dominance, switching rate and perceptual phase durations; and the build-up of auditory streaming. The principal contribution of the model is to show that a two-stage process of pattern discovery and competition between incompatible patterns can account for both the contents (perceptual organisations) and the dynamics of human perception in auditory streaming

Auditory Multi-Stability: Idiosyncratic Perceptual Switching Patterns, Executive Functions and Personality Traits

Multi-stability refers to the phenomenon of perception stochastically switching between possible interpretations of an unchanging stimulus. Despite considerable variability, individuals show stable idiosyncratic patterns of switching between alternative perceptions in the auditory streaming paradigm. We explored correlates of the individual switching patterns with executive functions, personality traits, and creativity. The main dimensions on which individual switching patterns differed from each other were identified using multidimensional scaling. Individuals with high scores on the dimension explaining the largest portion of the inter-individual variance switched more often between the alternative perceptions than those with low scores. They also perceived the most unusual interpretation more often, and experienced all perceptual alternatives with a shorter delay from stimulus onset. The ego-resiliency personality trait, which reflects a tendency for adaptive flexibility and experience seeking, was significantly positively related to this dimension. Taking these results together we suggest that this dimension may reflect the individual?s tendency for exploring the auditory environment. Executive functions were significantly related to some of the variables describing global properties of the switching patterns, such as the average number of switches. Thus individual patterns of perceptual switching in the auditory streaming paradigm are related to some personality traits and executive functions.</p

Functional brain networks underlying idiosyncratic switching patterns in multi-stable auditory perception

In perceptual multi-stability, perception stochastically switches between alternative interpretations of the stimulus allowing examination of perceptual experience independent of stimulus parameters. Previous studies found that listeners show temporally stable idiosyncratic switching patterns when listening to a multi-stable auditory stimulus, such as in the auditory streaming paradigm. This inter-individual variability can be described along two dimensions, Exploration and Segregation. In the current study, we explored the functional brain networks associated with these dimensions and their constituents using electroencephalography. Results showed that Segregation and its constituents are related to brain networks operating in the theta EEG band, whereas Exploration and its constituents are related to networks in the lower and upper alpha and beta bands. Thus, the dimensions on which individuals' perception differ from each other in the auditory streaming paradigm probably reflect separate perceptual processes in the human brain. Further, the results suggest that networks mainly located in left auditory areas underlie the perception of integration, whereas perceiving the alternative patterns is accompanied by stronger interhemispheric connections

Our gift to all of Us: GA(Y)AM: Preface

This special issue of AVANT is all about Cognitive Innovation. It is not about CogNovo, the interdisciplinary and international doctoral training programme that produced three different Off the Lip events. It is not about Off the Lip 2017, the novel symposium format we developed to collaboratively create a publication resulting in this special issue of AVANT. It is not about the seemingly heterogeneous collection of papers that follow this preface. Collaborative Approaches to Cognitive Innovation required something else, something we are starting to capture in the four GIFT principles. While this special issue is not solely about CogNovo, Off the Lip events, or the content of the following submissions, all these aforementioned elements were necessary to shape our current understanding of Cognitive Innovation, the very process which led to numerous publications, exhibitions, and events during the past three years. In a sense, all of our previous endeavours have culminated in this collection of 26 distinct pieces of work, yet we hope and believe that this special issue also marks a beginning. Let us explain. [...

The ‘Right’ Side of Creativity: Creative Personality and Social Risk-Taking Predict Political Party Affiliation

Vaibhav Tyagi - ORCID: 0000-0003-2756-1513 https://orcid.org/0000-0003-2756-1513This is an Accepted Manuscript of an article published by Taylor & Francis in Creativity Research Journal on 10 November 2018, available online: https://doi.org/10.1080/10400419.2018.1540252Factors that predict political party affiliation are of particular importance in research due to the wider implications in politics and policy making. Extending this line of work, the idea that creativity predicts party affiliation was tested using two conceptualizations of creativity: creative personality and creative ideation. Participants (N = 406) based in the US completed measures of creativity, socio-political attitudes, domain specific risk-taking and indicated their party affiliation. Results revealed a significant link between creative personality and political party affiliation. Furthermore, in addition to the socio-political attitudes, this link was explained, in part, by individuals’ social risk-taking. Specifically, individuals with higher scores on creative personality were more likely to affiliate to the Democratic party, whereas the reverse was true for affiliation to the Republican party. This article provides new insights into factors that predict political party affiliation and presents wider social implications of the findings.This research was funded by the Marie Curie Initial Training Network FP7-PEOPLE-2013-ITN, grant number 604764.30pubpub

Do audio-visual motion cues promote segregation of auditory streams?

An audio-visual experiment using moving sound sources was designed to investigate whether the analysis of auditory scenes is modulated by synchronous presentation of visual information. Listeners were presented with an alternating sequence of two pure tones delivered by two separate sound sources. In different conditions, the two sound sources were either stationary or moving on random trajectories around the listener. Both the sounds and the movement trajectories were derived from recordings in which two humans were moving with loudspeakers attached to their heads. Visualized movement trajectories modeled by a computer animation were presented together with the sounds. In the main experiment, behavioral reports on sound organization were collected from young healthy volunteers. The proportion and stability of the different sound organizations were compared between the conditions in which the visualized trajectories matched the movement of the sound sources and when the two were independent of each other. The results corroborate earlier findings that separation of sound sources in space promotes segregation. However, no additional effect of auditory movement per se on the perceptual organization of sounds was obtained. Surprisingly, the presentation of movement-congruent visual cues did not strengthen the effects of spatial separation on segregating auditory streams. Our findings are consistent with the view that bistability in the auditory modality can occur independently from other modalities

Radiotherapy dose-distribution to the perirectal fat space (PRS) is related to gastrointestinal control-related complications.

Traditionally rectal symptoms following pelvic/prostate radiotherapy are correlated to the dosimetry of the anorectum or a substructure of this. It has been suggested that the perirectal fat space (PRS) surrounding the rectum may also be relevant. This study considers the delineation and dosimetry of the PRS related to both rectal bleeding and control-related toxicity. Initially, a case-control cohort of 100 patients from the RADAR study were chosen based on presence/absence of rectal control-related toxicity. Automated contouring was developed to delineate the PRS. 79 of the 100 auto-segmentations were considered successful. Balanced case-control cohorts were defined from these cases. Atlas of Complication Incidence (ACI) were generated to relate the DVH of the PRS with specific rectal symptoms; rectal bleeding and control-related symptoms (LENT/SOM). ACI demonstrated that control-related symptoms were related to the dose distribution to the PRS which was confirmed with Wilcoxon rank sum test (p < 0.05). To the authors knowledge this is the first study implicating the dose distribution to the PRS to the incidence of control-related symptoms of rectal toxicity

The development of cross-cultural recognition of vocal emotion during childhood and adolescence

Humans have an innate set of emotions recognised universally. However, emotion recognition also depends on socio-cultural rules. Although adults recognise vocal emotions universally, they identify emotions more accurately in their native language. We examined developmental trajectories of universal vocal emotion recognition in children. Eighty native English speakers completed a vocal emotion recognition task in their native language (English) and foreign languages (Spanish, Chinese, and Arabic) expressing anger, happiness, sadness, fear, and neutrality. Emotion recognition was compared across 8-to-10, 11-to-13-year-olds, and adults. Measures of behavioural and emotional problems were also taken. Results showed that although emotion recognition was above chance for all languages, native English speaking children were more accurate in recognising vocal emotions in their native language. There was a larger improvement in recognising vocal emotion from the native language during adolescence. Vocal anger recognition did not improve with age for the non-native languages. This is the first study to demonstrate universality of vocal emotion recognition in children whilst supporting an “in-group advantage” for more accurate recognition in the native language. Findings highlight the role of experience in emotion recognition, have implications for child development in modern multicultural societies and address important theoretical questions about the nature of emotions