A class of robust numerical methods for solving dynamical systems with multiple time scales

In this paper, we develop a class of robust numerical methods for solving dynamical systems with multiple time scales. We first represent the solution of a multiscale dynamical system as a transformation of a slowly varying solution. Then, under the scale separation assumption, we provide a systematic way to construct the transformation map and derive the dynamic equation for the slowly varying solution. We also provide the convergence analysis of the proposed method. Finally, we present several numerical examples, including ODE system with three and four separated time scales to demonstrate the accuracy and efficiency of the proposed method. Numerical results verify that our method is robust in solving ODE systems with multiple time scale, where the time step does not depend on the multiscale parameters

Non-Abelian Kubo Formula and the Multiple Time-Scale Method

The non-Abelian Kubo formula is derived from the kinetic theory. That expression is compared with the one obtained using the eikonal for a Chern-Simons theory. The multiple time-scale method is used to solve the non-Abelian Kubo formula, and the damping rate for longitudinal color waves is computed.Comment: 18 pages, latex , to be pblished in Ann. Phys.(N,Y)(1996

Toward Abstraction from Multi-modal Data: Empirical Studies on Multiple Time-scale Recurrent Models

The abstraction tasks are challenging for multi- modal sequences as they require a deeper semantic understanding and a novel text generation for the data. Although the recurrent neural networks (RNN) can be used to model the context of the time-sequences, in most cases the long-term dependencies of multi-modal data make the back-propagation through time training of RNN tend to vanish in the time domain. Recently, inspired from Multiple Time-scale Recurrent Neural Network (MTRNN), an extension of Gated Recurrent Unit (GRU), called Multiple Time-scale Gated Recurrent Unit (MTGRU), has been proposed to learn the long-term dependencies in natural language processing. Particularly it is also able to accomplish the abstraction task for paragraphs given that the time constants are well defined. In this paper, we compare the MTRNN and MTGRU in terms of its learning performances as well as their abstraction representation on higher level (with a slower neural activation). This was done by conducting two studies based on a smaller data- set (two-dimension time sequences from non-linear functions) and a relatively large data-set (43-dimension time sequences from iCub manipulation tasks with multi-modal data). We conclude that gated recurrent mechanisms may be necessary for learning long-term dependencies in large dimension multi-modal data-sets (e.g. learning of robot manipulation), even when natural language commands was not involved. But for smaller learning tasks with simple time-sequences, generic version of recurrent models, such as MTRNN, were sufficient to accomplish the abstraction task.Comment: Accepted by IJCNN 201

A two-layer multiple-time-scale turbulence model and grid independence study

A two-layer multiple-time-scale turbulence model is presented. The near-wall model is based on the classical Kolmogorov-Prandtl turbulence hypothesis and the semi-empirical logarithmic law of the wall. In the two-layer model presented, the computational domain of the conservation of mass equation and the mean momentum equation penetrated up to the wall, where no slip boundary condition has been prescribed; and the near wall boundary of the turbulence equations has been located at the fully turbulent region, yet very close to the wall, where the standard wall function method has been applied. Thus, the conservation of mass constraint can be satisfied more rigorously in the two-layer model than in the standard wall function method. In most of the two-layer turbulence models, the number of grid points to be used inside the near-wall layer posed the issue of computational efficiency. The present finite element computational results showed that the grid independent solutions were obtained with as small as two grid points, i.e., one quadratic element, inside the near wall layer. Comparison of the computational results obtained by using the two-layer model and those obtained by using the wall function method is also presented

Large-Scale User Modeling with Recurrent Neural Networks for Music Discovery on Multiple Time Scales

The amount of content on online music streaming platforms is immense, and most users only access a tiny fraction of this content. Recommender systems are the application of choice to open up the collection to these users. Collaborative filtering has the disadvantage that it relies on explicit ratings, which are often unavailable, and generally disregards the temporal nature of music consumption. On the other hand, item co-occurrence algorithms, such as the recently introduced word2vec-based recommenders, are typically left without an effective user representation. In this paper, we present a new approach to model users through recurrent neural networks by sequentially processing consumed items, represented by any type of embeddings and other context features. This way we obtain semantically rich user representations, which capture a user's musical taste over time. Our experimental analysis on large-scale user data shows that our model can be used to predict future songs a user will likely listen to, both in the short and long term.Comment: Author pre-print version, 20 pages, 6 figures, 4 table

On the unsteady behavior of turbulence models

Periodically forced turbulence is used as a test case to evaluate the predictions of two-equation and multiple-scale turbulence models in unsteady flows. The limitations of the two-equation model are shown to originate in the basic assumption of spectral equilibrium. A multiple-scale model based on a picture of stepwise energy cascade overcomes some of these limitations, but the absence of nonlocal interactions proves to lead to poor predictions of the time variation of the dissipation rate. A new multiple-scale model that includes nonlocal interactions is proposed and shown to reproduce the main features of the frequency response correctly

HMC algorithm with multiple time scale integration and mass preconditioning

We describe a new HMC algorithm variant we have recently introduced and extend the published results by preliminary results of a simulation with a pseudo scalar mass value of about 300 MeV. This new run confirms our expectation that simulations with such pseudo scalar mass values become feasible and affordable with our HMC variant. In addition we discuss simulations from hot and cold starts at a pseudo scalar mass value of about 300 MeV, which we performed in order to test for possible meta-stabilities.Comment: 6 pages, Talk presented at Lattice 2005 (machines and algorithms

Complex population dynamics as a competition between multiple time-scale phenomena

The role of the selection pressure and mutation amplitude on the behavior of a single-species population evolving on a two-dimensional lattice, in a periodically changing environment, is studied both analytically and numerically. The mean-field level of description allows to highlight the delicate interplay between the different time-scale processes in the resulting complex dynamics of the system. We clarify the influence of the amplitude and period of the environmental changes on the critical value of the selection pressure corresponding to a phase-transition "extinct-alive" of the population. However, the intrinsic stochasticity and the dynamically-built in correlations among the individuals, as well as the role of the mutation-induced variety in population's evolution are not appropriately accounted for. A more refined level of description, which is an individual-based one, has to be considered. The inherent fluctuations do not destroy the phase transition "extinct-alive", and the mutation amplitude is strongly influencing the value of the critical selection pressure. The phase diagram in the plane of the population's parameters -- selection and mutation is discussed as a function of the environmental variation characteristics. The differences between a smooth variation of the environment and an abrupt, catastrophic change are also addressesd.Comment: 15 pages, 12 figures. Accepted for publication in Phys. Rev.