Hierarchy and Dynamics of Neural Networks

Contains fulltext : 88364.pdf (publisher's version ) (Open Access

Unravelling the Intrinsic Functional Organization of the Human Lateral Frontal Cortex: A Parcellation Scheme Based on Resting State fMRI

Human and nonhuman primates exhibit flexible behavior. Functional, anatomical, and lesion studies indicate that the lateral frontal cortex (LFC) plays a pivotal role in such behavior. LFC consists of distinct subregions exhibiting distinct connectivity patterns that possibly relate to functional specializations. Inference about the border of each subregion in the human brain is performed with the aid of macroscopic landmarks and/or cytoarchitectonic parcellations extrapolated in a stereotaxic system. However, the high interindividual variability, the limited availability of cytoarchitectonic probabilistic maps, and the absence of robust functional localizers render the in vivo delineation and examination of the LFC subregions challenging. In this study, we use resting state fMRI for the in vivo parcellation of the human LFC on a subjectwise and data-driven manner. This approach succeeds in uncovering neuroanatomically realistic subregions, with potential anatomical substrates includingBA46, 44, 45, 9 and related (sub)divisions. Ventral LFC subregions exhibit different functional connectivity (FC), which can account for different contributions in the language domain, while more dorsal adjacent subregions mark a transition to visuospatial/sensorimotor networks. Dorsal LFC subregions participate in known large-scale networks obeying an external/internal information processing dichotomy. Furthermore, we traced “families” of LFC subregions organized along the dorsal–ventral and anterior–posterior axis with distinct functional networks also encompassing specialized cingulate divisions. Similarities with the connectivity of macaque candidate homologs were observed, such as the premotor affiliation of presumed BA 46. The current findings partially support dominant LFC models

Resting-State Functional Connectivity in Late-Life Depression: Higher Global Connectivity and More Long Distance Connections

Functional magnetic resonance imaging recordings in the resting-state (RS) from the human brain are characterized by spontaneous low-frequency fluctuations in the blood oxygenation level dependent signal that reveal functional connectivity (FC) via their spatial synchronicity. This RS study applied network analysis to compare FC between late-life depression (LLD) patients and control subjects. Raw cross-correlation matrices (CM) for LLD were characterized by higher FC. We analyzed the small-world (SW) and modular organization of these networks consisting of 110 nodes each as well as the connectivity patterns of individual nodes of the basal ganglia. Topological network measures showed no significant differences between groups. The composition of top hubs was similar between LLD and control subjects, however in the LLD group posterior medial-parietal regions were more highly connected compared to controls. In LLD, a number of brain regions showed connections with more distant neighbors leading to an increase of the average Euclidean distance between connected regions compared to controls. In addition, right caudate nucleus connectivity was more diffuse in LLD. In summary, LLD was associated with overall increased FC strength and changes in the average distance between connected nodes, but did not lead to global changes in SW or modular organization

Trends and Topics: Characterizing Echo Chambers' Topological Stability and In-group Attitudes

Social Network sites are fertile ground for several polluting phenomena affecting online and offline spaces. Among these phenomena are included echo chambers, closed systems in which the opinions expressed by the people inside are exacerbated for the effect of the repetition, while opposite views are actively excluded. This paper offers a framework to explore, in a platform-independent manner, the topological changes through time of echo chambers, while considering the content posted by users and the attitude conveyed in discussing specific controversial issues. The proposed framework consists of four steps: (i) data collection and annotation of users' ideology regarding a controversial topic, (ii) construction of a dynamic network of interactions, (iii) ECs extraction and analysis of their dynamics, and (iv) topic extraction and valence analysis. The paper then enhances the formalization of the framework by conducting a case study on Reddit threads about sociopolitical issues (gun control, American politics, and minorities discrimination) during the first two years and a half of Donald Trump's presidency. The results unveil that users often stay inside echo chambers over time. Furthermore, in the analyzed discussions, the focus is on controversies related to right-wing parties and specific events in American and Canadian politics. The analysis of the attitude conveyed in the discussions shows a slight inclination toward a more negative or neutral attitude when discussing particularly sensitive issues, such as fascism, school shootings, or police violence.Comment: 24 pages, including 8 pages of Supplementary materials. Submitted to IEEE Acces

Modular and Hierarchically Modular Organization of Brain Networks

Brain networks are increasingly understood as one of a large class of information processing systems that share important organizational principles in common, including the property of a modular community structure. A module is topologically defined as a subset of highly inter-connected nodes which are relatively sparsely connected to nodes in other modules. In brain networks, topological modules are often made up of anatomically neighboring and/or functionally related cortical regions, and inter-modular connections tend to be relatively long distance. Moreover, brain networks and many other complex systems demonstrate the property of hierarchical modularity, or modularity on several topological scales: within each module there will be a set of sub-modules, and within each sub-module a set of sub-sub-modules, etc. There are several general advantages to modular and hierarchically modular network organization, including greater robustness, adaptivity, and evolvability of network function. In this context, we review some of the mathematical concepts available for quantitative analysis of (hierarchical) modularity in brain networks and we summarize some of the recent work investigating modularity of structural and functional brain networks derived from analysis of human neuroimaging data

Echo state model of non-Markovian reinforcement learning, An

Department Head: Dale H. Grit.2008 Spring.Includes bibliographical references (pages 137-142).There exists a growing need for intelligent, autonomous control strategies that operate in real-world domains. Theoretically the state-action space must exhibit the Markov property in order for reinforcement learning to be applicable. Empirical evidence, however, suggests that reinforcement learning also applies to domains where the state-action space is approximately Markovian, a requirement for the overwhelming majority of real-world domains. These domains, termed non-Markovian reinforcement learning domains, raise a unique set of practical challenges. The reconstruction dimension required to approximate a Markovian state-space is unknown a priori and can potentially be large. Further, spatial complexity of local function approximation of the reinforcement learning domain grows exponentially with the reconstruction dimension. Parameterized dynamic systems alleviate both embedding length and state-space dimensionality concerns by reconstructing an approximate Markovian state-space via a compact, recurrent representation. Yet this representation extracts a cost; modeling reinforcement learning domains via adaptive, parameterized dynamic systems is characterized by instability, slow-convergence, and high computational or spatial training complexity. The objectives of this research are to demonstrate a stable, convergent, accurate, and scalable model of non-Markovian reinforcement learning domains. These objectives are fulfilled via fixed point analysis of the dynamics underlying the reinforcement learning domain and the Echo State Network, a class of parameterized dynamic system. Understanding models of non-Markovian reinforcement learning domains requires understanding the interactions between learning domains and their models. Fixed point analysis of the Mountain Car Problem reinforcement learning domain, for both local and nonlocal function approximations, suggests a close relationship between the locality of the approximation and the number and severity of bifurcations of the fixed point structure. This research suggests the likely cause of this relationship: reinforcement learning domains exist within a dynamic feature space in which trajectories are analogous to states. The fixed point structure maps dynamic space onto state-space. This explanation suggests two testable hypotheses. Reinforcement learning is sensitive to state-space locality because states cluster as trajectories in time rather than space. Second, models using trajectory-based features should exhibit good modeling performance and few changes in fixed point structure. Analysis of performance of lookup table, feedforward neural network, and Echo State Network (ESN) on the Mountain Car Problem reinforcement learning domain confirm these hypotheses. The ESN is a large, sparse, randomly-generated, unadapted recurrent neural network, which adapts a linear projection of the target domain onto the hidden layer. ESN modeling results on reinforcement learning domains show it achieves performance comparable to lookup table and neural network architectures on the Mountain Car Problem with minimal changes to fixed point structure. Also, the ESN achieves lookup table caliber performance when modeling Acrobot, a four-dimensional control problem, but is less successful modeling the lower dimensional Modified Mountain Car Problem. These performance discrepancies are attributed to the ESN’s excellent ability to represent complex short term dynamics, and its inability to consolidate long temporal dependencies into a static memory. Without memory consolidation, reinforcement learning domains exhibiting attractors with multiple dynamic scales are unlikely to be well-modeled via ESN. To mediate this problem, a simple ESN memory consolidation method is presented and tested for stationary dynamic systems. These results indicate the potential to improve modeling performance in reinforcement learning domains via memory consolidation

Genetic influences on cost-efficient organization of human cortical functional networks

The human cerebral cortex is a complex network of functionally specialized regions interconnected by axonal fibers, but the organizational principles underlying cortical connectivity remain unknown. Here, we report evidence that one such principle for functional cortical networks involves finding a balance between maximizing communication efficiency and minimizing connection cost, referred to as optimization of network cost-efficiency. We measured spontaneous fluctuations of the blood oxygenation level-dependent signal using functional magnetic resonance imaging in healthy monozygotic (16 pairs) and dizygotic (13 pairs) twins and characterized cost-efficient properties of brain network functional connectivity between 1041 distinct cortical regions. At the global network level, 60% of the interindividual variance in cost-efficiency of cortical functional networks was attributable to additive genetic effects. Regionally, significant genetic effects were observed throughout the cortex in a largely bilateral pattern, including bilateral posterior cingulate and medial prefrontal cortices, dorsolateral prefrontal and superior parietal cortices, and lateral temporal and inferomedial occipital regions. Genetic effects were stronger for cost-efficiency than for other metrics considered, and were more clearly significant in functional networks operating in the 0.09–0.18 Hz frequency interval than at higher or lower frequencies. These findings are consistent with the hypothesis that brain networks evolved to satisfy competitive selection criteria of maximizing efficiency and minimizing cost, and that optimization of network cost-efficiency represents an important principle for the brain's functional organization