343 research outputs found
Scalable Population Synthesis with Deep Generative Modeling
Population synthesis is concerned with the generation of synthetic yet
realistic representations of populations. It is a fundamental problem in the
modeling of transport where the synthetic populations of micro-agents represent
a key input to most agent-based models. In this paper, a new methodological
framework for how to 'grow' pools of micro-agents is presented. The model
framework adopts a deep generative modeling approach from machine learning
based on a Variational Autoencoder (VAE). Compared to the previous population
synthesis approaches, including Iterative Proportional Fitting (IPF), Gibbs
sampling and traditional generative models such as Bayesian Networks or Hidden
Markov Models, the proposed method allows fitting the full joint distribution
for high dimensions. The proposed methodology is compared with a conventional
Gibbs sampler and a Bayesian Network by using a large-scale Danish trip diary.
It is shown that, while these two methods outperform the VAE in the
low-dimensional case, they both suffer from scalability issues when the number
of modeled attributes increases. It is also shown that the Gibbs sampler
essentially replicates the agents from the original sample when the required
conditional distributions are estimated as frequency tables. In contrast, the
VAE allows addressing the problem of sampling zeros by generating agents that
are virtually different from those in the original data but have similar
statistical properties. The presented approach can support agent-based modeling
at all levels by enabling richer synthetic populations with smaller zones and
more detailed individual characteristics.Comment: 27 pages, 15 figures, 4 table
A Static Time Analysis of 1-bit to 32-page SCA architecture for Logic Test
This research proposes the Static Time Analysis of 32 page Single cycle access (SCA) architecture for Logic test. The timing analysis of each and very path of Logic test are observed that is setup and hold timings are calculated. It also eliminates the peak power consumption problem of conventional shift-based scan chains and reduces the activity during shift and capture cycles using Clock-Gating technique. This leads to more realistic circuit behavior during at-speed tests. It enables the complete test to run at much higher frequencies equal or close to the one in functional mode. It will be shown, that a lesser number of test cycles can be achieved compared to other published solutions. The test cycle per net based on a simple test pattern generator algorithm without test pattern compression is below 1 for larger designs and is independent of the design size. The structure allows an additional on-chip debugging signal visibility for each register. The method is backward compatible to full scan designs and existing test pattern generators and simulators can be used with a minor enhancement. It is shown how to combine the proposed solution with built-in self-test (BIST) and massive parallel scan chains. The results are observed on Xilinx XC3s1600e-5fgg48
Optimal Recombination in Genetic Algorithms
This paper surveys results on complexity of the optimal recombination problem
(ORP), which consists in finding the best possible offspring as a result of a
recombination operator in a genetic algorithm, given two parent solutions. We
consider efficient reductions of the ORPs, allowing to establish polynomial
solvability or NP-hardness of the ORPs, as well as direct proofs of hardness
results
MIMO Systems
In recent years, it was realized that the MIMO communication systems seems to be inevitable in accelerated evolution of high data rates applications due to their potential to dramatically increase the spectral efficiency and simultaneously sending individual information to the corresponding users in wireless systems. This book, intends to provide highlights of the current research topics in the field of MIMO system, to offer a snapshot of the recent advances and major issues faced today by the researchers in the MIMO related areas. The book is written by specialists working in universities and research centers all over the world to cover the fundamental principles and main advanced topics on high data rates wireless communications systems over MIMO channels. Moreover, the book has the advantage of providing a collection of applications that are completely independent and self-contained; thus, the interested reader can choose any chapter and skip to another without losing continuity
A structured prediction approach for robot imitation learning
We propose a structured prediction approach for robot imitation learning from demonstrations. Among various tools for robot imitation learning, supervised learning has been observed to have a prominent role. Structured prediction is a form of supervised learning that enables learning models to operate on output spaces with complex structures. Through the lens of structured prediction, we show how robots can learn to imitate trajectories belonging to not only Euclidean spaces but also Riemannian manifolds. Exploiting ideas from information theory, we propose a class of loss functions based on the f-divergence to measure the information loss between the demonstrated and reproduced probabilistic trajectories. Different types of f-divergence will result in different policies, which we call imitation modes. Furthermore, our approach enables the incorporation of spatial and temporal trajectory modulation, which is necessary for robots to be adaptive to the change in working conditions. We benchmark our algorithm against state-of-the-art methods in terms of trajectory reproduction and adaptation. The quantitative evaluation shows that our approach outperforms other algorithms regarding both accuracy and efficiency. We also report real-world experimental results on learning manifold trajectories in a polishing task with a KUKA LWR robot arm, illustrating the effectiveness of our algorithmic framework
Numerical Methods for Algorithmic Systems and Neural Networks
These lecture notes are devoted to numerical concepts and solution of algorithmic systems and neural networks. The course is divided into four parts: traditional AI (artificial intelligence), deep learning in neural networks, applications to (and with) differential equations, and project work. Throughout this course an emphasis is on mathematical ingredients from which several are rigorously proven. In the project work, the participants usually form groups and work together on a given problem to train themselves on mathematical modeling, design of algorithms, implementation, and analysis and intepretation of the simulation results
A Structured Prediction Approach for Robot Imitation Learning
We propose a structured prediction approach for robot imitation learning from
demonstrations. Among various tools for robot imitation learning, supervised
learning has been observed to have a prominent role. Structured prediction is a
form of supervised learning that enables learning models to operate on output
spaces with complex structures. Through the lens of structured prediction, we
show how robots can learn to imitate trajectories belonging to not only
Euclidean spaces but also Riemannian manifolds. Exploiting ideas from
information theory, we propose a class of loss functions based on the
f-divergence to measure the information loss between the demonstrated and
reproduced probabilistic trajectories. Different types of f-divergence will
result in different policies, which we call imitation modes. Furthermore, our
approach enables the incorporation of spatial and temporal trajectory
modulation, which is necessary for robots to be adaptive to the change in
working conditions. We benchmark our algorithm against state-of-the-art methods
in terms of trajectory reproduction and adaptation. The quantitative evaluation
shows that our approach outperforms other algorithms regarding both accuracy
and efficiency. We also report real-world experimental results on learning
manifold trajectories in a polishing task with a KUKA LWR robot arm,
illustrating the effectiveness of our algorithmic framework
Representation Learning with Adversarial Latent Autoencoders
A large number of deep learning methods applied to computer vision problems require encoder-decoder maps. These methods include, but are not limited to, self-representation learning, generalization, few-shot learning, and novelty detection. Encoder-decoder maps are also useful for photo manipulation, photo editing, superresolution, etc. Encoder-decoder maps are typically learned using autoencoder networks.Traditionally, autoencoder reciprocity is achieved in the image-space using pixel-wisesimilarity loss, which has a widely known flaw of producing non-realistic reconstructions. This flaw is typical for the Variational Autoencoder (VAE) family and is not only limited to pixel-wise similarity losses, but is common to all methods relying upon the explicit maximum likelihood training paradigm, as opposed to an implicit one. Likelihood maximization, coupled with poor decoder distribution leads to poor or blurry reconstructions at best. Generative Adversarial Networks (GANs) on the other hand, perform an implicit maximization of the likelihood by solving a minimax game, thus bypassing the issues derived from the explicit maximization. This provides GAN architectures with remarkable generative power, enabling the generation of high-resolution images of humans, which are indistinguishable from real photos to the naked eye. However, GAN architectures lack inference capabilities, which makes them unsuitable for training encoder-decoder maps, effectively limiting their application space.We introduce an autoencoder architecture that (a) is free from the consequences ofmaximizing the likelihood directly, (b) produces reconstructions competitive in quality with state-of-the-art GAN architectures, and (c) allows learning disentangled representations, which makes it useful in a variety of problems. We show that the proposed architecture and training paradigm significantly improves the state-of-the-art in novelty and anomaly detection methods, it enables novel kinds of image manipulations, and has significant potential for other applications
Mixed-Variable Bayesian Optimization
The optimization of expensive to evaluate, black-box, mixed-variable
functions, i.e. functions that have continuous and discrete inputs, is a
difficult and yet pervasive problem in science and engineering. In Bayesian
optimization (BO), special cases of this problem that consider fully continuous
or fully discrete domains have been widely studied. However, few methods exist
for mixed-variable domains and none of them can handle discrete constraints
that arise in many real-world applications. In this paper, we introduce MiVaBo,
a novel BO algorithm for the efficient optimization of mixed-variable functions
combining a linear surrogate model based on expressive feature representations
with Thompson sampling. We propose an effective method to optimize its
acquisition function, a challenging problem for mixed-variable domains, making
MiVaBo the first BO method that can handle complex constraints over the
discrete variables. Moreover, we provide the first convergence analysis of a
mixed-variable BO algorithm. Finally, we show that MiVaBo is significantly more
sample efficient than state-of-the-art mixed-variable BO algorithms on several
hyperparameter tuning tasks, including the tuning of deep generative models.Comment: IJCAI 2020 camera-ready; 17 pages, extended version with
supplementary materia
- …