Experience-driven formation of parts-based representations in a model of layered visual memory

Growing neuropsychological and neurophysiological evidence suggests that the visual cortex uses parts-based representations to encode, store and retrieve relevant objects. In such a scheme, objects are represented as a set of spatially distributed local features, or parts, arranged in stereotypical fashion. To encode the local appearance and to represent the relations between the constituent parts, there has to be an appropriate memory structure formed by previous experience with visual objects. Here, we propose a model how a hierarchical memory structure supporting efficient storage and rapid recall of parts-based representations can be established by an experience-driven process of self-organization. The process is based on the collaboration of slow bidirectional synaptic plasticity and homeostatic unit activity regulation, both running at the top of fast activity dynamics with winner-take-all character modulated by an oscillatory rhythm. These neural mechanisms lay down the basis for cooperation and competition between the distributed units and their synaptic connections. Choosing human face recognition as a test task, we show that, under the condition of open-ended, unsupervised incremental learning, the system is able to form memory traces for individual faces in a parts-based fashion. On a lower memory layer the synaptic structure is developed to represent local facial features and their interrelations, while the identities of different persons are captured explicitly on a higher layer. An additional property of the resulting representations is the sparseness of both the activity during the recall and the synaptic patterns comprising the memory traces.Comment: 34 pages, 12 Figures, 1 Table, published in Frontiers in Computational Neuroscience (Special Issue on Complex Systems Science and Brain Dynamics), http://www.frontiersin.org/neuroscience/computationalneuroscience/paper/10.3389/neuro.10/015.2009

Predictive Coding for Dynamic Visual Processing: Development of Functional Hierarchy in a Multiple Spatio-Temporal Scales RNN Model

The current paper proposes a novel predictive coding type neural network model, the predictive multiple spatio-temporal scales recurrent neural network (P-MSTRNN). The P-MSTRNN learns to predict visually perceived human whole-body cyclic movement patterns by exploiting multiscale spatio-temporal constraints imposed on network dynamics by using differently sized receptive fields as well as different time constant values for each layer. After learning, the network becomes able to proactively imitate target movement patterns by inferring or recognizing corresponding intentions by means of the regression of prediction error. Results show that the network can develop a functional hierarchy by developing a different type of dynamic structure at each layer. The paper examines how model performance during pattern generation as well as predictive imitation varies depending on the stage of learning. The number of limit cycle attractors corresponding to target movement patterns increases as learning proceeds. And, transient dynamics developing early in the learning process successfully perform pattern generation and predictive imitation tasks. The paper concludes that exploitation of transient dynamics facilitates successful task performance during early learning periods.Comment: Accepted in Neural Computation (MIT press

Analysis of science textbook pictures about energy and pupils' readings of them

This article outlines the findings of the part of the "Science Teacher Training in an Information Society" (STTIS) project concerned with describing the possible difficulties the pupils have when "reading" science textbook pictures about "energy". Six documents were selected on the basis that they had some of the textual/graphical features previously identified by the project as potentially presenting difficulties to pupils. The pupils' readings of these were investigated using a questionnaire and a follow-up interview. The analysis of three of the documents and of twelve pupils' readings of them is reported in this paper. The results confirm the hypothesis that the "reading" of science textbook pictures is not at all trivial for pupils and conclude that teachers need to spend time and effort talking through the meaning of the images with them. They also suggest that the list of textual/graphical features used in this research is a good starting point for this kind of critical examination

I'm sorry to say, but your understanding of image processing fundamentals is absolutely wrong

The ongoing discussion whether modern vision systems have to be viewed as visually-enabled cognitive systems or cognitively-enabled vision systems is groundless, because perceptual and cognitive faculties of vision are separate components of human (and consequently, artificial) information processing system modeling.Comment: To be published as chapter 5 in "Frontiers in Brain, Vision and AI", I-TECH Publisher, Viena, 200

How Many CMEs Have Flux Ropes? Deciphering the Signatures of Shocks, Flux Ropes, and Prominences in Coronagraph Observations of CMEs

We intend to provide a comprehensive answer to the question on whether all Coronal Mass Ejections (CMEs) have flux rope structure. To achieve this, we present a synthesis of the LASCO CME observations over the last sixteen years, assisted by 3D MHD simulations of the breakout model, EUV and coronagraphic observations from STEREO and SDO, and statistics from a revised LASCO CME database. We argue that the bright loop often seen as the CME leading edge is the result of pileup at the boundary of the erupting flux rope irrespective of whether a cavity or, more generally, a 3-part CME can be identified. Based on our previous work on white light shock detection and supported by the MHD simulations, we identify a new type of morphology, the `two-front' morphology. It consists of a faint front followed by diffuse emission and the bright loop-like CME leading edge. We show that the faint front is caused by density compression at a wave (or possibly shock) front driven by the CME. We also present high-detailed multi-wavelength EUV observations that clarify the relative positioning of the prominence at the bottom of a coronal cavity with clear flux rope structure. Finally, we visually check the full LASCO CME database for flux rope structures. In the process, we classify the events into two clear flux rope classes (`3-part', `Loop'), jets and outflows (no clear structure). We find that at least 40% of the observed CMEs have clear flux rope structures. We propose a new definition for flux rope CMEs (FR-CMEs) as a coherent magnetic, twist-carrying coronal structure with angular width of at least 40 deg and able to reach beyond 10 Rsun which erupts on a time scale of a few minutes to several hours. We conclude that flux ropes are a common occurrence in CMEs and pose a challenge for future studies to identify CMEs that are clearly not FR-CMEs.Comment: 26 pages, 9 figs, to be published in Solar Physics Topical Issue "Flux Rope Structure of CMEs

Henri Matisse Drawing: An Eye-Hand Interaction Study Based on Archival Film.

Henri Matisse (1869-1954) attached fundamental importance to his drawings, in particular to the famous Themes et Variations series. These were accomplished following a precise method, starting with arduous life studies and evolving into brilliant spontaneous drawings. A 1946 archival documentary film showing the artist drawing four portraits of his grandson Gerard was shot in such a way as to allow the present author to undertake a detailed eye-hand interaction analysis of the drawing process. It was found that Matisse’s temporal working rhythm and use of motor memory resulted in a more direct approach than that used by most painters. Taken together with remarks the artist made throughout his lifetime, these results provide a cognitive interpretation of his drawing method

Solar meridional circulation from twenty-one years of SOHO/MDI and SDO/HMI observations: Helioseismic travel times and forward modeling in the ray approximation

The south-north travel-time differences are measured by applying time-distance helioseismology to the MDI and HMI medium-degree Dopplergrams covering May 1996-April 2017. Our data analysis corrects for several sources of systematic effects: P-angle error, surface magnetic field effects, and center-to-limb variations. An interpretation of the travel-time measurements is obtained using a forward-modeling approach in the ray approximation. The travel-time differences are similar in the southern hemisphere for cycles 23 and 24. However, they differ in the northern hemisphere between cycles 23 and 24. Except for cycle 24's northern hemisphere, the measurements favor a single-cell meridional circulation model where the poleward flows persist down to $\sim$0.8 $R_\odot$, accompanied by local inflows toward the activity belts in the near-surface layers. Cycle 24's northern hemisphere is anomalous: travel-time differences are significantly smaller when travel distances are greater than 20$^\circ$. This asymmetry between northern and southern hemispheres during cycle 24 was not present in previous measurements (e.g., Rajaguru & Antia 2015), which assumed a different P-angle error correction where south-north travel-time differences are shifted to zero at the equator for all travel distances. In our measurements, the travel-time differences at the equator are zero for travel distances less than $\sim$30$^\circ$, but they do not vanish for larger travel distances. This equatorial offset for large travel distances need not be interpreted as a deep cross-equator flow; it could be due to the presence of asymmetrical local flows at the surface near the end points of the acoustic ray paths.Comment: accepted for publication in A&