On-Line Learning Theory of Soft Committee Machines with Correlated Hidden Units - Steepest Gradient Descent and Natural Gradient Descent -

The permutation symmetry of the hidden units in multilayer perceptrons causes the saddle structure and plateaus of the learning dynamics in gradient learning methods. The correlation of the weight vectors of hidden units in a teacher network is thought to affect this saddle structure, resulting in a prolonged learning time, but this mechanism is still unclear. In this paper, we discuss it with regard to soft committee machines and on-line learning using statistical mechanics. Conventional gradient descent needs more time to break the symmetry as the correlation of the teacher weight vectors rises. On the other hand, no plateaus occur with natural gradient descent regardless of the correlation for the limit of a low learning rate. Analytical results support these dynamics around the saddle point.Comment: 7 pages, 6 figure

Field Theoretical Analysis of On-line Learning of Probability Distributions

On-line learning of probability distributions is analyzed from the field theoretical point of view. We can obtain an optimal on-line learning algorithm, since renormalization group enables us to control the number of degrees of freedom of a system according to the number of examples. We do not learn parameters of a model, but probability distributions themselves. Therefore, the algorithm requires no a priori knowledge of a model.Comment: 4 pages, 1 figure, RevTe

Les bassins quaternaires du Sahel central de la Tunisie : genèse et évolution des sebkhas en contexte décrochant compressif et distensif

Les études géologiques et les profils sismiques du Sahel central de la Tunisie suggèrent que la genèse et l'évolution des lagunes côtières et des sebkhas de cette région ont été contrôlés par une tectonique décrochante compressive post-villafranchienne, suivie de mouvements distensifs décrochants d'âge tyrrhénie

Quantum state decorrelation

We address the general problem of removing correlations from quantum states while preserving local quantum information as much as possible. We provide a complete solution in the case of two qubits, by evaluating the minimum amount of noise that is necessary to decorrelate covariant sets of bipartite states. We show that two harmonic oscillators in arbitrary Gaussian state can be decorrelated by a Gaussian covariant map. Finally, for finite-dimensional Hilbert spaces, we prove that states obtained from most cloning channels (e.g., universal and phase-covariant cloning) can be decorrelated only at the expense of a complete erasure of information about the copied state. More generally, in finite dimension, cloning without correlations is impossible for continuous sets of states. On the contrary, for continuos variables cloning, a slight modification of the customary set-up for cloning coherent states allows one to obtain clones without correlations.Comment: 11 pages, 2 figures, RevTex

Nonlinear force-free and potential field models of active-region and global coronal fields during the Whole Heliospheric Interval

Between 2008/3/24 and 2008/4/2, the three active regions NOAA active regions 10987, 10988 and 10989 were observed daily by the Synoptic Optical Long-term Investigations of the Sun (SOLIS) Vector Spectro-Magnetograph (VSM) while they traversed the solar disk. We use these measurements and the nonlinear force-free magnetic field code XTRAPOL to reconstruct the coronal magnetic field for each active region and compare model field lines with images from the Solar Terrestrial RElations Observatory (STEREO) and Hinode X-ray Telescope (XRT) telescopes. Synoptic maps made from continuous, round-the-clock Global Oscillations Network Group (GONG) magnetograms provide information on the global photospheric field and potential-field source-surface models based on these maps describe the global coronal field during the Whole Heliospheric Interval (WHI) and its neighboring rotations. Features of the modeled global field, such as the coronal holes and streamer belt locations, are discussed in comparison with extreme ultra-violet and coronagraph observations from STEREO. The global field is found to be far from a minimum, dipolar state. From the nonlinear models we compute physical quantities for the active regions such as the photospheric magnetic and electric current fluxes, the free magnetic energy and the relative helicity for each region each day where observations permit. The interconnectivity of the three regions is addressed in the context of the potential-field source-surface model. Using local and global quantities derived from the models, we briefly discuss the different observed activity levels of the regions.Comment: Accepted for publication in the Solar Physics Whole Heliospheric Interval (WHI) topical issue. We had difficulty squeezing this paper into arXiv's 15 Mb limit. The full paper is available here ftp://gong2.nso.edu/dsds_user/petrie/PetrieCanouAmari.pd

Flux Rope Formation Preceding Coronal Mass Ejection Onset

We analyse the evolution of a sigmoidal (S shaped) active region toward eruption, which includes a coronal mass ejection (CME) but leaves part of the filament in place. The X-ray sigmoid is found to trace out three different magnetic topologies in succession: a highly sheared arcade of coronal loops in its long-lived phase, a bald-patch separatrix surface (BPSS) in the hours before the CME, and the first flare loops in its major transient intensity enhancement. The coronal evolution is driven by photospheric changes which involve the convergence and cancellation of flux elements under the sigmoid and filament. The data yield unambiguous evidence for the existence of a BPSS, and hence a flux rope, in the corona prior to the onset of the CME.Comment: ApJ Letters, in pres

Statistical physics of independent component analysis

Statistical physics is used to investigate independent component analysis with polynomial contrast functions. While the replica method fails, an adapted cavity approach yields valid results. The learning curves, obtained in a suitable thermodynamic limit, display a first order phase transition from poor to perfect generalization.Comment: 7 pages, 1 figure, to appear in Europhys. Lett

Magnetohydrostatic solar prominences in near-potential coronal magnetic fields

We present numerical magnetohydrostatic solutions describing the gravitationally stratified, bulk equilibrium of cool, dense prominence plasma embedded in a near-potential coronal field. These solutions are calculated using the FINESSE magnetohydrodynamics equilibrium solver and describe the morphologies of magnetic field distributions in and around prominences and the cool prominence plasma that these fields support. The equilibrium condition for this class of problem is usually different in distinct subdomains, separated by free boundaries, across which solutions are matched by suitable continuity or jump conditions describing force balance. We employ our precise finite element elliptic solver to calculate solutions not accessible by previous analytical techniques with temperature or entropy prescribed as free functions of the magnetic flux function, including a range of values of the polytropic index, temperature variations mainly across magnetic field lines and photospheric field profiles sheared close to the polarity inversion line. Out of the many examples computed here, perhaps the most noteworthy is one which reproduces precisely the three-part structure often encountered in observations: a cool dense prominence within a cavity/flux rope embedded in a hot corona. The stability properties of these new equilibria, which may be relevant to solar eruptions, can be determined in the form of a full resistive MHD spectrum using a companion hyperbolic stability solver.Comment: To appear in ApJ August 200

Storage and recall of weak coherent optical pulses with an efficiency of 25%

We demonstrate experimentally a quantum memory scheme for the storage of weak coherent light pulses in an inhomogeneously broadened optical transition in a Pr^{3+}: YSO crystal at 2.1 K. Precise optical pumping using a frequency stable (about 1kHz linewidth) laser is employed to create a highly controllable Atomic Frequency Comb (AFC) structure. We report single photon storage and retrieval efficiencies of 25%, based on coherent photon echo type re-emission in the forward direction. The coherence property of the quantum memory is proved through interference between a super Gaussian pulse and the emitted echo. Backward retrieval of the photon echo emission has potential for increasing storage and recall efficiency.Comment: 5,

HR4049: signature of nova nucleosynthesis ?

The post-Asymptotic Giant Branch (AGB) star HR4049 is in an eccentric binary system with a relatively short period probably surrounded by a dusty circumbinary disk. Extremely anomalous oxygen isotopic ratios, O16/O17 ~ O16/O18 ~ 7, have been measured from CO_2 molecules likely residing in the disk. Such a composition cannot be explained in the framework of AGB and post-AGB evolution while it can be qualitatively associated with the nucleosynthesis occurring during nova outbursts. We discuss nova models, the presence of a white dwarf companion to HR4049 and possible scenarios for the dynamical evolution of this binary system. Circumbinary disks in which mixing occurs between red-giant and nova material may also be invoked as the site of formation of some rare types of meteoritic presolar grains.Comment: 4 pages, 2 figures, submitted for the proceedings of the 8th Nuclei in the Cosmos symposium (Vancouver, Canada, 19-23 July 2004