Quality of internal representation shapes learning performance in feedback neural networks

A fundamental feature of complex biological systems is the ability to form feedback interactions with their environment. A prominent model for studying such interactions is reservoir computing, where learning acts on low-dimensional bottlenecks. Despite the simplicity of this learning scheme, the factors contributing to or hindering the success of training in reservoir networks are in general not well understood. In this work, we study non-linear feedback networks trained to generate a sinusoidal signal, and analyze how learning performance is shaped by the interplay between internal network dynamics and target properties. By performing exact mathematical analysis of linearized networks, we predict that learning performance is maximized when the target is characterized by an optimal, intermediate frequency which monotonically decreases with the strength of the internal reservoir connectivity. At the optimal frequency, the reservoir representation of the target signal is high-dimensional, de-synchronized, and thus maximally robust to noise. We show that our predictions successfully capture the qualitative behaviour of performance in non-linear networks. Moreover, we find that the relationship between internal representations and performance can be further exploited in trained non-linear networks to explain behaviours which do not have a linear counterpart. Our results indicate that a major determinant of learning success is the quality of the internal representation of the target, which in turn is shaped by an interplay between parameters controlling the internal network and those defining the task

A Geometrical Analysis of Global Stability in Trained Feedback Networks

Recurrent neural networks have been extensively studied in the context of neuroscience and machine learning due to their ability to implement complex computations. While substantial progress in designing effective learning algorithms has been achieved in the last years, a full understanding of trained recurrent networks is still lacking. Specifically, the mechanisms that allow computations to emerge from the underlying recurrent dynamics are largely unknown. Here we focus on a simple, yet underexplored computational setup: a feedback architecture trained to associate a stationary output to a stationary input. As a starting point, we derive an approximate analytical description of global dynamics in trained networks which assumes uncorrelated connectivity weights in the feedback and in the random bulk. The resulting mean-field theory suggests that the task admits several classes of solutions, which imply different stability properties. Different classes are characterized in terms of the geometrical arrangement of the readout with respect to the input vectors, defined in the high-dimensional space spanned by the network population. We find that such approximate theoretical approach can be used to understand how standard training techniques implement the input-output task in finite-size feedback networks. In particular, our simplified description captures the local and the global stability properties of the target solution, and thus predicts training performance

Titan's cold case files - Outstanding questions after Cassini-Huygens

The entry of the Cassini-Huygens spacecraft into orbit around Saturn in July 2004 marked the start of a golden era in the exploration of Titan, Saturn's giant moon. During the Prime Mission (2004–2008), ground-breaking discoveries were made by the Cassini orbiter including the equatorial dune fields (flyby T3, 2005), northern lakes and seas (T16, 2006), and the large positive and negative ions (T16 & T18, 2006), to name a few. In 2005 the Huygens probe descended through Titan's atmosphere, taking the first close-up pictures of the surface, including large networks of dendritic channels leading to a dried-up seabed, and also obtaining detailed profiles of temperature and gas composition during the atmospheric descent. The discoveries continued through the Equinox Mission (2008–2010) and Solstice Mission (2010–2017) totaling 127 targeted flybys of Titan in all. Now at the end of the mission, we are able to look back on the high-level scientific questions from the start of the mission, and assess the progress that has been made towards answering these. At the same time, new scientific questions regarding Titan have emerged from the discoveries that have been made. In this paper we review a cross-section of important scientific questions that remain partially or completely unanswered, ranging from Titan's deep interior to the exosphere. Our intention is to help formulate the science goals for the next generation of planetary missions to Titan, and to stimulate new experimental, observational and theoretical investigations in the interim

Titan's cold case files - Outstanding questions after Cassini-Huygens

Abstract The entry of the Cassini-Huygens spacecraft into orbit around Saturn in July 2004 marked the start of a golden era in the exploration of Titan, Saturn's giant moon. During the Prime Mission (2004–2008), ground-breaking discoveries were made by the Cassini orbiter including the equatorial dune fields (flyby T3, 2005), northern lakes and seas (T16, 2006), and the large positive and negative ions (T16 & T18, 2006), to name a few. In 2005 the Huygens probe descended through Titan's atmosphere, taking the first close-up pictures of the surface, including large networks of dendritic channels leading to a dried-up seabed, and also obtaining detailed profiles of temperature and gas composition during the atmospheric descent. The discoveries continued through the Equinox Mission (2008–2010) and Solstice Mission (2010–2017) totaling 127 targeted flybys of Titan in all. Now at the end of the mission, we are able to look back on the high-level scientific questions from the start of the mission, and assess the progress that has been made towards answering these. At the same time, new scientific questions regarding Titan have emerged from the discoveries that have been made. In this paper we review a cross-section of important scientific questions that remain partially or completely unanswered, ranging from Titan's deep interior to the exosphere. Our intention is to help formulate the science goals for the next generation of planetary missions to Titan, and to stimulate new experimental, observational and theoretical investigations in the interim

Science goals and new mission concepts for future exploration of Titan's atmosphere geology and habitability: Titan POlar Scout/orbitEr and In situ lake lander and DrONe explorer (POSEIDON)

In response to ESA’s “Voyage 2050” announcement of opportunity, we propose an ambitious L-class mission to explore one of the most exciting bodies in the Solar System, Saturn’s largest moon Titan. Titan, a “world with two oceans”, is an organic-rich body with interior-surface-atmosphere interactions that are comparable in complexity to the Earth. Titan is also one of the few places in the Solar System with habitability potential. Titan’s remarkable nature was only partly revealed by the Cassini-Huygens mission and still holds mysteries requiring a complete exploration using a variety of vehicles and instruments. The proposed mission concept POSEIDON (Titan POlar Scout/orbitEr and In situ lake lander DrONe explorer) would perform joint orbital and in situ investigations of Titan. It is designed to build on and exceed the scope and scientific/technological accomplishments of Cassini-Huygens, exploring Titan in ways that were not previously possible, in particular through full close-up and in situ coverage over long periods of time. In the proposed mission architecture, POSEIDON consists of two major elements: a spacecraft with a large set of instruments that would orbit Titan, preferably in a low-eccentricity polar orbit, and a suite of in situ investigation components, i.e. a lake lander, a “heavy” drone (possibly amphibious) and/or a fleet of mini-drones, dedicated to the exploration of the polar regions. The ideal arrival time at Titan would be slightly before the next northern Spring equinox (2039), as equinoxes are the most active periods to monitor still largely unknown atmospheric and surface seasonal changes. The exploration of Titan’s northern latitudes with an orbiter and in situ element(s) would be highly complementary in terms of timing (with possible mission timing overlap), locations, and science goals with the upcoming NASA New Frontiers Dragonfly mission that will provide in situ exploration of Titan’s equatorial regions, in the mid-2030s

The spatiotemporal organization of episodic memory and its disruption in a neurodevelopmental disorder

Recent theories of episodic memory (EM) posit that the hippocampus provides a spatiotemporal framework necessary for representing events. If such theories hold true, then does the development of EM in children depend on the ability to first\ua0bind spatial and temporal information? And does this ability rely, at least in part, on normal hippocampal function? We investigated the development of EM in children 2\u20138 years of age (Study 1) and its impairment in Williams Syndrome, a genetic neurodevelopmental disorder characterized by visuospatial deficits and irregular hippocampal function, (Study 2) by implementing a nonverbal object-placement task that dissociates the what, where, and when components of EM. Consistent with the spatiotemporal-framework view of hippocampal EM, our results indicate that the binding of where and when in memory emerges earliest in development, around the age of 3, and is specifically impaired in WS. Space-time binding both preceded and was critical to full EM (what + where + when), and the successful\ua0association of objects to spatial locations seemed to mediate this developmental process

Application of Fire Safety Engineering to steel structures of industrial halls according to national regulations

The design in case of fire of steel structures for industrial buildings has been the subject of numerous research activities in Europe [1, 2], focused in particular on the application of the safety assessment criteria using performance-based approach. This issue was addressed with particular interest by the national Technical Committee for Fire Safety of Steel Constructions of Fondazione Promozione Acciaio [7-9], who wanted to provide useful contributions to the evolution of the national regulations, that on this issue has found a place in the Decree of Ministry of Interior of 3 August 2015 (Technical Code of Fire Prevention)