EEG-informed fMRI reveals spatiotemporal characteristics of perceptual decision making

Single-unit and multiunit recordings in primates have already established that decision making involves at least two general stages of neural processing: representation of evidence from early sensory areas and accumulation of evidence to a decision threshold from decision-related regions. However, the relay of information from early sensory to decision areas, such that the accumulation process is instigated, is not well understood. Using a cued paradigm and single-trial analysis of electroencephalography (EEG), we previously reported on temporally specific components related to perceptual decision making. Here, we use information derived from our previous EEG recordings to inform the analysis of fMRI data collected for the same behavioral task to ascertain the cortical origins of each of these EEG components. We demonstrate that a cascade of events associated with perceptual decision making takes place in a highly distributed neural network. Of particular importance is an activation in the lateral occipital complex implicating perceptual persistence as a mechanism by which object decision making in the human brain is instigated

Human scalp potentials reflect a mixture of decision-related signals during perceptual choices

Single-unit animal studies have consistently reported decision-related activity mirroring a process of temporal accumulation of sensory evidence to a fixed internal decision boundary. To date, our understanding of how response patterns seen in single-unit data manifest themselves at the macroscopic level of brain activity obtained from human neuroimaging data remains limited. Here, we use single-trial analysis of human electroencephalography data to show that population responses on the scalp can capture choice-predictive activity that builds up gradually over time with a rate proportional to the amount of sensory evidence, consistent with the properties of a drift-diffusion-like process as characterized by computational modeling. Interestingly, at time of choice, scalp potentials continue to appear parametrically modulated by the amount of sensory evidence rather than converging to a fixed decision boundary as predicted by our model. We show that trial-to-trial fluctuations in these response-locked signals exert independent leverage on behavior compared with the rate of evidence accumulation earlier in the trial. These results suggest that in addition to accumulator signals, population responses on the scalp reflect the influence of other decision-related signals that continue to covary with the amount of evidence at time of choice

Temporal characteristics of the influence of punishment on perceptual decision making in the human brain

Perceptual decision making is the process by which information from sensory systems is combined and used to influence our behavior. In addition to the sensory input, this process can be affected by other factors, such as reward and punishment for correct and incorrect responses. To investigate the temporal dynamics of how monetary punishment influences perceptual decision making in humans, we collected electroencephalography (EEG) data during a perceptual categorization task whereby the punishment level for incorrect responses was parametrically manipulated across blocks of trials. Behaviorally, we observed improved accuracy for high relative to low punishment levels. Using multivariate linear discriminant analysis of the EEG, we identified multiple punishment-induced discriminating components with spatially distinct scalp topographies. Compared with components related to sensory evidence, components discriminating punishment levels appeared later in the trial, suggesting that punishment affects primarily late postsensory, decision-related processing. Crucially, the amplitude of these punishment components across participants was predictive of the size of the behavioral improvements induced by punishment. Finally, trial-by-trial changes in prestimulus oscillatory activity in the alpha and gamma bands were good predictors of the amplitude of these components. We discuss these findings in the context of increased motivation/attention, resulting from increases in punishment, which in turn yields improved decision-related processing

Single-trial analysis of EEG during rapid visual discrimination: enabling cortically-coupled computer vision

We describe our work using linear discrimination of multi-channel electroencephalography for single-trial detection of neural signatures of visual recognition events. We demonstrate the approach as a methodology for relating neural variability to response variability, describing studies for response accuracy and response latency during visual target detection. We then show how the approach can be utilized to construct a novel type of brain-computer interface, which we term cortically-coupled computer vision. In this application, a large database of images is triaged using the detected neural signatures. We show how ‘corticaltriaging’ improves image search over a strictly behavioral response

Space-by-time non-negative matrix factorization for single-trial decoding of M/EEG activity

We develop a novel methodology for the single-trial analysis of multichannel time-varying neuroimaging signals. We introduce the space-by-time M/EEG decomposition, based on Non-negative Matrix Factorization (NMF), which describes single-trial M/EEG signals using a set of non-negative spatial and temporal components that are linearly combined with signed scalar activation coefficients. We illustrate the effectiveness of the proposed approach on an EEG dataset recorded during the performance of a visual categorization task. Our method extracts three temporal and two spatial functional components achieving a compact yet full representation of the underlying structure, which validates and summarizes succinctly results from previous studies. Furthermore, we introduce a decoding analysis that allows determining the distinct functional role of each component and relating them to experimental conditions and task parameters. In particular, we demonstrate that the presented stimulus and the task difficulty of each trial can be reliably decoded using specific combinations of components from the identified space-by-time representation. When comparing with a sliding-window linear discriminant algorithm, we show that our approach yields more robust decoding performance across participants. Overall, our findings suggest that the proposed space-by-time decomposition is a meaningful low-dimensional representation that carries the relevant information of single-trial M/EEG signals

Human VMPFC encodes early signatures of confidence in perceptual decisions

Choice confidence, an individual’s internal estimate of judgment accuracy, plays a critical role in adaptive behaviour, yet its neural representations during decision formation remain underexplored. Here, we recorded simultaneous EEG-fMRI while participants performed a direction discrimination task and rated their confidence on each trial. Using multivariate single-trial discriminant analysis of the EEG, we identified a stimulus-independent component encoding confidence, which appeared prior to subjects’ explicit choice and confidence report, and was consistent with a confidence measure predicted by an accumulation-to-bound model of decisionmaking. Importantly, trial-to-trial variability in this electrophysiologically-derived confidence signal was uniquely associated with fMRI responses in the ventromedial prefrontal cortex (VMPFC), a region not typically associated with confidence for perceptual decisions. Furthermore, activity in the VMPFC was functionally coupled with regions of the frontal cortex linked to perceptual decision-making and metacognition. Our results suggest that the VMPFC holds an early confidence representation arising from decision dynamics, preceding and potentially informing metacognitive evaluation

The Leaky Integrating Threshold and its impact on evidence accumulation models of choice RT

A common assumption in choice response time (RT) modeling is that after evidence accumulation reaches a certain decision threshold, the choice is categorically communicated to the motor system that then executes the response. However, neurophysiological findings suggest that motor preparation partly overlaps with evidence accumulation, and is not independent from stimulus difficulty level. We propose to model this entanglement by changing the nature of the decision criterion from a simple threshold to an actual process. More specifically, we propose a secondary, motor preparation related, leaky accumulation process that takes the accumulated evidence of the original decision process as a continuous input, and triggers the actual response when it reaches its own threshold. We analytically develop this Leaky Integrating Threshold (LIT), applying it to a simple constant drift diffusion model, and show how its parameters can be estimated with the D*M method. Reanalyzing 3 different data sets, the LIT extension is shown to outperform a standard drift diffusion model using multiple statistical approaches. Further, the LIT leak parameter is shown to be better at explaining the speed/accuracy trade-off manipulation than the commonly used boundary separation parameter. These improvements can also be verified using traditional diffusion model analyses, for which the LIT predicts the violation of several common selective parameter influence assumptions. These predictions are consistent with what is found in the data and with what is reported experimentally in the literature. Crucially, this work offers a new benchmark against which to compare neural data to offer neurobiological validation for the proposed processes

Neural correlates of weighted reward prediction error during reinforcement learning classify response to cognitive behavioral therapy in depression

While cognitive behavioral therapy (CBT) is an effective treatment for major depressive disorder, only up to 45% of depressed patients will respond to it. At present, there is no clinically viable neuroimaging predictor of CBT response. Notably, the lack of a mechanistic understanding of treatment response has hindered identification of predictive biomarkers. To obtain mechanistically meaningful fMRI predictors of CBT response, we capitalize on pretreatment neural activity encoding a weighted reward prediction error (RPE), which is implicated in the acquisition and processing of feedback information during probabilistic learning. Using a conventional mass-univariate fMRI analysis, we demonstrate that, at the group level, responders exhibit greater pretreatment neural activity encoding a weighted RPE in the right striatum and right amygdala. Crucially, using multivariate methods, we show that this activity offers significant out-of-sample classification of treatment response. Our findings support the feasibility and validity of neurocomputational approaches to treatment prediction in psychiatry

Fully overlapped rolled hollow section welded joints in trusses

The designer of lattice trusses has been traditionally encouraged to avoid extra joint bending moments by ensuring 'noding' of member centre lines. This can however cause problems in the design of RHS trusses with small (economical) branch members by causing large gaps at joints with undesirable flexibility for slender chord walls. 100% overlap joints overcome this problem while still maintaining economic single cut branch ends. The research programme set out first to highlight the difference in behaviour of trusses with large gap noding and completely overlapping joints. Two similar trusses - one gap, the other lap - with matched sections were tested to failure. It was concluded that the gap joint truss (branch/chord width ratio = 0.4) was much less efficient than the corresponding 100% overlap truss despite the large eccentricities. The collapse load of the latter was some 35% greater, while the stiffness properties were better, and remained linear for a substantial proportion of the loading. On the other hand the gap joint truss soon became non-linear, with large overall deflections. Local connecting chord wall deflections were quite small in the lap joints while appreciable deflections occurred at gap joints under service loads. Elastic frame analyses were carried out for all the six test trusses (one gap and five lap). For the overlap trusses, axial forces and bending moments could be predicted fairly accurately but a non-linear analysis was required for the gap jointed truss even at fairly modest loads. The effects of ß ratio, chord slenderness and branch angle were all examined within the parameter range tested. The advantages of truss continuity moments as well as plastic redistribution of moments have been observed to reduce the occurrence of the local chord buckling mode of failure (L7), compared with previous isolated joint tests. Results obtained from tests on isolated joints can give good agreement with those obtained from truss tests, both with respect to strength and failure mode. However, as the isolated joint testing cannot always reproduce the support conditions in a truss, the failure modes (and hence strengths) can differ. The current CIDECT design strength equations and recommendations for gap and overlap joints are largely based on the results of isolated joint testing. The suitability of the CIDECT strength equations and recommendations for designing RHS lattice trusses has been reviewed. Consequently, for the 100% overlap joint trusses a simple design method has been presented in conjunction with practical design recommendations. The problems associated with the analysis and design of the gap joint truss are described in detail

Precision and neuronal dynamics in the human posterior parietal cortex during evidence accumulation

Primate studies show slow ramping activity in posterior parietal cortex (PPC) neurons during perceptual decision-making. These findings have inspired a rich theoretical literature to account for this activity. These accounts are largely unrelated to Bayesian theories of perception and predictive coding, a related formulation of perceptual inference in the cortical hierarchy. Here, we tested a key prediction of such hierarchical inference, namely that the estimated precision (reliability) of information ascending the cortical hierarchy plays a key role in determining both the speed of decision-making and the rate of increase of PPC activity. Using dynamic causal modelling of magnetoencephalographic (MEG) evoked responses, recorded during a simple perceptual decision-making task, we recover ramping-activity from an anatomically and functionally plausible network of regions, including early visual cortex, the middle temporal area (MT) and PPC. Precision, as reflected by the gain on pyramidal cell activity, was strongly correlated with both the speed of decision making and the slope of PPC ramping activity. Our findings indicate that the dynamics of neuronal activity in the human PPC during perceptual decision-making recapitulate those observed in the macaque, and in so doing we link observations from primate electrophysiology and human choice behaviour. Moreover, the synaptic gain control modulating these dynamics is consistent with predictive coding formulations of evidence accumulation