Disentangling Neural Synchronization and Sustained Neural Activity in the Processing of Auditory Temporal Patterns

First paragraph: Temporal regularity within sensory input, can be defined as a uniformly structured and recurring stimulation. Perceiving temporal regularity is integral to effectively perceiving the world around us, such as in speech and music perception. Indeed, natural environments constantly present our perceptual systems with different forms of temporal regularities and rhythms. Efficient sensitivity to temporal changes not only allows us to maintain a coherent perception of our experiences, but importantly, also allows us to build expectations and predict future events (Gutschalk et al., 2002; Nobre and van Ede, 2017). Previous work investigating the underlying neural mechanisms of temporal pattern perception have focused on neural synchronization (NS). This is defined as the ability of neural oscillations to synchronize with temporal regularity in external stimuli (Lakatos et al., 2008; Henry and Obleser, 2012), further suggesting that temporal regularity boosts neural activity at the same frequency as that of the external stimulus. This externally-synchronized neural activity can then be used to predict future auditory activity (Nobre and van Ede, 2017). More recently, the role of sustained activity (SA) has also been investigated in temporal regularity perception, using electroencephalography (EEG) and magnetoencephalography (Barascud et al., 2016; Southwell and Chait, 2018). For instance, detection of regularity in short auditory sequences is demarcated by increased sustained low-frequency evoked magnetoencephalographic activity, which occurs irrespective of the temporal structure (Barascud et al., 2016). The precise relationship between NS and SA is not fully understood. One suggestion is that NS allows the recognition of auditory patterns, while SA subsequently allows the processing of this information in the higher order brain regions. A recently published study by Herrmann and Johnsrude (2018) examined the relationship between NS and SA in the processing of auditory temporal patterns using EEG

Perception, Causally Efficacious Particulars, and the Range of Phenomenal Consciousness: Reply to Commentaries

This paper responds to critical commentaries on my book, Perceiving Reality (OUP, 2012), by Laura Guerrero, Matthew MacKenzie, and Anand Vaidya. Guerrero focuses on the metaphysics of causation, and its role in the broader question of whether the ‘two truths’ framework of Buddhist philosophy can be reconciled with the claim that science provides the best account of our experienced world. MacKenzie pursues two related questions: (i) Is reflexive awareness (svasaṃvedana) identical with the subjective pole of a dual-aspect cognition or are there alternative, perhaps better, ways of understanding this self-intimating character of mental states? (ii) Is perception constitutively intentional or is it representational? Vaidya argues that, in so far as Husserlian phenomenology and Buddhism differ in terms of their fundamental ontological commit- ments, they must be incompatible, thus rendering any cross-cultural philosophical project that seeks their rapprochement tenuous. One of my aims in Perceiving Reality is to show how accounts of perception informed by metaphysical realism can be problematic on both metaphysical and epistemological grounds, especially when relying on conceptions of consciousness that ignore its properly phenomenological features

Speech and music discrimination: Human detection of differences between music and speech based on rhythm

Rhythm in speech and singing forms one of its basic acoustic components. Therefore, it is interesting to investigate the capability of subjects to distinguish between speech and singing when only the rhythm remains as an acoustic cue. For this study we developed a method to eliminate all linguistic components but rhythm from the speech and singing signals. The study was conducted online and participants could listen to the stimuli via loudspeakers or headphones. The analysis of the survey shows that people are able to significantly discriminate between speech and singing after they have been altered. Furthermore, our results reveal specific features, which supported participants in their decision, such as differences in regularity and tempo between singing and speech samples. The hypothesis that music trained people perform more successfully on the task was not proved. The results of the study are important for the understanding of the structure of and differences between speech and singing, for the use in further studies and for future application in the field of speech recognition

Predictive Processing and the Phenomenology of Time Consciousness: A Hierarchical Extension of Rick Grush’s Trajectory Estimation Model

This chapter explores to what extent some core ideas of predictive processing can be applied to the phenomenology of time consciousness. The focus is on the experienced continuity of consciously perceived, temporally extended phenomena (such as enduring processes and successions of events). The main claim is that the hierarchy of representations posited by hierarchical predictive processing models can contribute to a deepened understanding of the continuity of consciousness. Computationally, such models show that sequences of events can be represented as states of a hierarchy of dynamical systems. Phenomenologically, they suggest a more fine-grained analysis of the perceptual contents of the specious present, in terms of a hierarchy of temporal wholes. Visual perception of static scenes not only contains perceived objects and regions but also spatial gist; similarly, auditory perception of temporal sequences, such as melodies, involves not only perceiving individual notes but also slightly more abstract features (temporal gist), which have longer temporal durations (e.g., emotional character or rhythm). Further investigations into these elusive contents of conscious perception may be facilitated by findings regarding its neural underpinnings. Predictive processing models suggest that sensorimotor areas may influence these contents

Infants’ perception of rhythmic patterns

We explored 9-month-old infants perception of auditory temporal sequences in a series of three experiments. In Experiment 1, we presented some infants with tone sequences that were expected to induce a strongly metric framework and others with a sequence that was expected to induce a weakly metric framework or no such framework. Infants detected a change in the context of the former sequences but not in the latter sequence. In Experiment 2, infants listened to a tone sequence with temporal cues to duple or triple meter. Infants detected a change in the pattern with duple meter but not in the pattern with triple meter. In Experiment 3, infants listened to a tone sequence with harmonic cues to duple or triple meter. As in Experiment 2, infants detected a change in the context of the duple meter pattern but not in the context of triple meter. These findings are consistent with processing predispositions for auditory temporal sequences that induce a metric framework, particularly those in duple meter

The influence of external and internal motor processes on human auditory rhythm perception

Musical rhythm is composed of organized temporal patterns, and the processes underlying rhythm perception are found to engage both auditory and motor systems. Despite behavioral and neuroscience evidence converging to this audio-motor interaction, relatively little is known about the effect of specific motor processes on auditory rhythm perception. This doctoral thesis was devoted to investigating the influence of both external and internal motor processes on the way we perceive an auditory rhythm. The first half of the thesis intended to establish whether overt body movement had a facilitatory effect on our ability to perceive the auditory rhythmic structure, and whether this effect was modulated by musical training. To this end, musicians and non-musicians performed a pulse-finding task either using natural body movement or through listening only, and produced their identified pulse by finger tapping. The results showed that overt movement benefited rhythm (pulse) perception especially for non-musicians, confirming the facilitatory role of external motor activities in hearing the rhythm, as well as its interaction with musical training. The second half of the thesis tested the idea that indirect, covert motor input, such as that transformed from the visual stimuli, could influence our perceived structure of an auditory rhythm. Three experiments examined the subjectively perceived tempo of an auditory sequence under different visual motion stimulations, while the auditory and visual streams were presented independently of each other. The results revealed that the perceived auditory tempo was accordingly influenced by the concurrent visual motion conditions, and the effect was related to the increment or decrement of visual motion speed. This supported the hypothesis that the internal motor information extracted from the visuomotor stimulation could be incorporated into the percept of an auditory rhythm. Taken together, the present thesis concludes that, rather than as a mere reaction to the given auditory input, our motor system plays an important role in contributing to the perceptual process of the auditory rhythm. This can occur via both external and internal motor activities, and may not only influence how we hear a rhythm but also under some circumstances improve our ability to hear the rhythm.Musikalische Rhythmen bestehen aus zeitlich strukturierten Mustern akustischer Stimuli. Es konnte gezeigt werden, dass die Prozesse, welche der Rhythmuswahrnehmung zugrunde liegen, sowohl motorische als auch auditive Systeme nutzen. Obwohl sich für diese auditiv-motorischen Interaktionen sowohl in den Verhaltenswissenschaften als auch Neurowissenschaften übereinstimmende Belege finden, weiß man bislang relativ wenig über die Auswirkungen spezifischer motorischer Prozesse auf die auditive Rhythmuswahrnehmung. Diese Doktorarbeit untersucht den Einfluss externaler und internaler motorischer Prozesse auf die Art und Weise, wie auditive Rhythmen wahrgenommen werden. Der erste Teil der Arbeit diente dem Ziel herauszufinden, ob körperliche Bewegungen es dem Gehirn erleichtern können, die Struktur von auditiven Rhythmen zu erkennen, und, wenn ja, ob dieser Effekt durch ein musikalisches Training beeinflusst wird. Um dies herauszufinden wurde Musikern und Nichtmusikern die Aufgabe gegeben, innerhalb von präsentierten auditiven Stimuli den Puls zu finden, wobei ein Teil der Probanden währenddessen Körperbewegungen ausführen sollte und der andere Teil nur zuhören sollte. Anschließend sollten die Probanden den gefundenen Puls durch Finger-Tapping ausführen, wobei die Reizgaben sowie die Reaktionen mittels eines computerisierten Systems kontrolliert wurden. Die Ergebnisse zeigen, dass offen ausgeführte Bewegungen die Wahrnehmung des Pulses vor allem bei Nichtmusikern verbesserten. Diese Ergebnisse bestätigen, dass Bewegungen beim Hören von Rhythmen unterstützend wirken. Außerdem zeigte sich, dass hier eine Wechselwirkung mit dem musikalischen Training besteht. Der zweite Teil der Doktorarbeit überprüfte die Idee, dass indirekte, verdeckte Bewegungsinformationen, wie sie z.B. in visuellen Stimuli enthalten sind, die wahrgenommene Struktur von auditiven Rhythmen beeinflussen können. Drei Experimente untersuchten, inwiefern das subjektiv wahrgenommene Tempo einer akustischen Sequenz durch die Präsentation unterschiedlicher visueller Bewegungsreize beeinflusst wird, wobei die akustischen und optischen Stimuli unabhängig voneinander präsentiert wurden. Die Ergebnisse zeigten, dass das wahrgenommene auditive Tempo durch die visuellen Bewegungsinformationen beeinflusst wird, und dass der Effekt in Verbindung mit der Zunahme oder Abnahme der visuellen Geschwindigkeit steht. Dies unterstützt die Hypothese, dass internale Bewegungsinformationen, welche aus visuomotorischen Reizen extrahiert werden, in die Wahrnehmung eines auditiven Rhythmus integriert werden können. Zusammen genommen, 5 zeigt die vorgestellte Arbeit, dass unser motorisches System eine wichtige Rolle im Wahrnehmungsprozess von auditiven Rhythmen spielt. Dies kann sowohl durch äußere als auch durch internale motorische Aktivitäten geschehen, und beeinflusst nicht nur die Art, wie wir Rhythmen hören, sondern verbessert unter bestimmten Bedingungen auch unsere Fähigkeit Rhythmen zu identifizieren

The Extended Importance of the Social Creation of Value in Evolutionary Processes

This is a single-authored paper delivered at the biennial European Conference on Artificial Intelligence (ECAI) in Riva del Garda, Italy 28 – 29 August 2006 and published in proceedings. The paper proposed that computational modelling be employed in order to test two processes that might hypothetically distinguish particular dimensions of human creativity. The first process is identified by the researcher as one in which the pursuit of novelty in artistic invention – especially music – tends to words the production of increasingly perceptually complex artefacts. The second process moves from a perspective orientated towards the individual artist and the individual art work’s reception to a more collective one: namely, whether cultural behaviour that tends towards novelty might find itself being reinforced by clustering of similar activities. This latter process would be one that explains why the process of “making special” – that may distinguish art in an anthropological sense – is one that forms particularly strong community bonds. These bonds between novelty seekers – which in the case of the researchers paper can be understood as musicians or artists – may reciprocally reinforce to support yet more novelty seeking. The relation of art and the new is not itself innovative. Boris Groys’ “On The New” provides a scoping of that territory. What is innovative is the proposal to use of computer simulation of individual and collective behaviour as a kind of artificial laboratory to determine the complex tendencies that animate these processes of novelty seeking and, by extension, artistic production. Computationally simulating behaviour that parallels both novelty-seeking as an individual practice (the artist) and the emergence of clusters of novelty seekers (the artistic styles) may, according to the researcher, provide us with new insights the historical evolution of creativity