Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey

Dynamic networks are used in a wide range of fields, including social network analysis, recommender systems, and epidemiology. Representing complex networks as structures changing over time allow network models to leverage not only structural but also temporal patterns. However, as dynamic network literature stems from diverse fields and makes use of inconsistent terminology, it is challenging to navigate. Meanwhile, graph neural networks (GNNs) have gained a lot of attention in recent years for their ability to perform well on a range of network science tasks, such as link prediction and node classification. Despite the popularity of graph neural networks and the proven benefits of dynamic network models, there has been little focus on graph neural networks for dynamic networks. To address the challenges resulting from the fact that this research crosses diverse fields as well as to survey dynamic graph neural networks, this work is split into two main parts. First, to address the ambiguity of the dynamic network terminology we establish a foundation of dynamic networks with consistent, detailed terminology and notation. Second, we present a comprehensive survey of dynamic graph neural network models using the proposed terminologyComment: 28 pages, 9 figures, 8 table

Testing for Structural Breaks in Nonlinear Dynamic Models Using Artificial Neural Network Approximations

In this paper we suggest a number of statistical tests based on neural network models, that are designed to be powerful against structural breaks in otherwise stationary time series processes while allowing for a variety of nonlinear specifications for the dynamic model underlying them. It is clear that in the presence of nonlinearity standard tests of structural breaks for linear models may not have the expected performance under the null hypothesis of no breaks because the model is misspecified. We therefore proceed by approximating the conditional expectation of the dependent variable through a neural network. Then, the residual from this approximation is tested using standard residual based structural break tests. We investigate the asymptoptic behaviour of residual based structural break tests in nonlinear regression models. Monte Carlo evidence suggests that the new tests are powerful against a variety of structural breaks while allowing for stationary nonlinearities.Nonlinearity, Structural breaks, Neural networks

Dynamic Structural Neural Network

The file attached to this record is the author's final peer reviewed version.Artificial neural network (ANN) has been well applied in pattern recognition, classification and machine learning thanks to its high performance. Most ANNs are designed by a static structure whose weights are trained during a learning process by supervised or unsupervised methods. These training methods require a set of initial weights values, which are normally randomly generated, with different initial sets of weight values leading to different convergent ANNs for the same training set. Dealing with these drawbacks, a trend of dynamic ANN was invoked in the past year. However, they are either too complex or far from practical applications such as in the pathology predictor in binary multi-input multi-output (MIMO) problems, when the role of a symptom is considered as an agent, a pathology predictor’s outcome is formed by action of active agents while other agents’ activities seem to be ignored or have mirror effects. In this paper, we propose a new dynamic structural ANN for MIMO problems based on the dependency graph, which gives clear cause and result relationships between inputs and outputs. The new ANN has the dynamic structure of hidden layer as a directed graph showing the relation between input, hidden and output nodes. The properties of the new dynamic structural ANN are experienced with a pathology problem and its learning methods’ performances are compared on a real well known dataset. The result shows that both approaches for structural learning process improve the quality of ANNs during learning iteration

Controllability of structural brain networks.

Cognitive function is driven by dynamic interactions between large-scale neural circuits or networks, enabling behaviour. However, fundamental principles constraining these dynamic network processes have remained elusive. Here we use tools from control and network theories to offer a mechanistic explanation for how the brain moves between cognitive states drawn from the network organization of white matter microstructure. Our results suggest that densely connected areas, particularly in the default mode system, facilitate the movement of the brain to many easily reachable states. Weakly connected areas, particularly in cognitive control systems, facilitate the movement of the brain to difficult-to-reach states. Areas located on the boundary between network communities, particularly in attentional control systems, facilitate the integration or segregation of diverse cognitive systems. Our results suggest that structural network differences between cognitive circuits dictate their distinct roles in controlling trajectories of brain network function

Combining dynamic relaxation method with artificial neural networks to enhance simulation of tensegrity structures

Abstract: Structural analyses of tensegrity structures must account for geometrical nonlinearity. The dynamic relaxation method correctly models static behavior in most situations. However, the requirements for precision increase when these structures are actively controlled. This paper describes the use of neural networks to improve the accuracy of the dynamic relaxation method in order to correspond more closely to data measured from a full-scale laboratory structure. An additional investigation evaluates training the network during the service life for further increases in accuracy. Tests showed that artificial neural networks increased model accuracy when used with the dynamic relaxation method. Replacing the dynamic relaxation method completely by a neural network did not provide satisfactory results. First tests involving training the neural network online showed potential to adapt the model to changes during the service life of the structure. DOI: 10.1061/�ASCE�0733-9445�2003�129:5�672