27,383 research outputs found
Relevance of Dynamic Clustering to Biological Networks
Network of nonlinear dynamical elements often show clustering of
synchronization by chaotic instability. Relevance of the clustering to
ecological, immune, neural, and cellular networks is discussed, with the
emphasis of partially ordered states with chaotic itinerancy. First, clustering
with bit structures in a hypercubic lattice is studied. Spontaneous formation
and destruction of relevant bits are found, which give self-organizing, and
chaotic genetic algorithms. When spontaneous changes of effective couplings are
introduced, chaotic itinerancy of clusterings is widely seen through a feedback
mechanism, which supports dynamic stability allowing for complexity and
diversity, known as homeochaos. Second, synaptic dynamics of couplings is
studied in relation with neural dynamics. The clustering structure is formed
with a balance between external inputs and internal dynamics. Last, an
extension allowing for the growth of the number of elements is given, in
connection with cell differentiation. Effective time sharing system of
resources is formed in partially ordered states.Comment: submitted to Physica D, no figures include
Synchronization in complex networks
Synchronization processes in populations of locally interacting elements are
in the focus of intense research in physical, biological, chemical,
technological and social systems. The many efforts devoted to understand
synchronization phenomena in natural systems take now advantage of the recent
theory of complex networks. In this review, we report the advances in the
comprehension of synchronization phenomena when oscillating elements are
constrained to interact in a complex network topology. We also overview the new
emergent features coming out from the interplay between the structure and the
function of the underlying pattern of connections. Extensive numerical work as
well as analytical approaches to the problem are presented. Finally, we review
several applications of synchronization in complex networks to different
disciplines: biological systems and neuroscience, engineering and computer
science, and economy and social sciences.Comment: Final version published in Physics Reports. More information
available at http://synchronets.googlepages.com
Contextualized Non-local Neural Networks for Sequence Learning
Recently, a large number of neural mechanisms and models have been proposed
for sequence learning, of which self-attention, as exemplified by the
Transformer model, and graph neural networks (GNNs) have attracted much
attention. In this paper, we propose an approach that combines and draws on the
complementary strengths of these two methods. Specifically, we propose
contextualized non-local neural networks (CN), which can both
dynamically construct a task-specific structure of a sentence and leverage rich
local dependencies within a particular neighborhood.
Experimental results on ten NLP tasks in text classification, semantic
matching, and sequence labeling show that our proposed model outperforms
competitive baselines and discovers task-specific dependency structures, thus
providing better interpretability to users.Comment: Accepted by AAAI201
Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications
Wireless sensor networks monitor dynamic environments that change rapidly
over time. This dynamic behavior is either caused by external factors or
initiated by the system designers themselves. To adapt to such conditions,
sensor networks often adopt machine learning techniques to eliminate the need
for unnecessary redesign. Machine learning also inspires many practical
solutions that maximize resource utilization and prolong the lifespan of the
network. In this paper, we present an extensive literature review over the
period 2002-2013 of machine learning methods that were used to address common
issues in wireless sensor networks (WSNs). The advantages and disadvantages of
each proposed algorithm are evaluated against the corresponding problem. We
also provide a comparative guide to aid WSN designers in developing suitable
machine learning solutions for their specific application challenges.Comment: Accepted for publication in IEEE Communications Surveys and Tutorial
- …