The Effect of Explicit Structure Encoding of Deep Neural Networks for Symbolic Music Generation

With recent breakthroughs in artificial neural networks, deep generative models have become one of the leading techniques for computational creativity. Despite very promising progress on image and short sequence generation, symbolic music generation remains a challenging problem since the structure of compositions are usually complicated. In this study, we attempt to solve the melody generation problem constrained by the given chord progression. This music meta-creation problem can also be incorporated into a plan recognition system with user inputs and predictive structural outputs. In particular, we explore the effect of explicit architectural encoding of musical structure via comparing two sequential generative models: LSTM (a type of RNN) and WaveNet (dilated temporal-CNN). As far as we know, this is the first study of applying WaveNet to symbolic music generation, as well as the first systematic comparison between temporal-CNN and RNN for music generation. We conduct a survey for evaluation in our generations and implemented Variable Markov Oracle in music pattern discovery. Experimental results show that to encode structure more explicitly using a stack of dilated convolution layers improved the performance significantly, and a global encoding of underlying chord progression into the generation procedure gains even more.Comment: 8 pages, 13 figure

Computation of rotor aerodynamic loads in forward flight using a full-span free wake analysis

The development of an advanced computational analysis of unsteady aerodynamic loads on isolated helicopter rotors in forward flight is described. The primary technical focus of the development was the implementation of a freely distorting filamentary wake model composed of curved vortex elements laid out along contours of constant vortex sheet strength in the wake. This model captures the wake generated by the full span of each rotor blade and makes possible a unified treatment of the shed and trailed vorticity in the wake. This wake model was coupled to a modal analysis of the rotor blade dynamics and a vortex lattice treatment of the aerodynamic loads to produce a comprehensive model for rotor performance and air loads in forward flight dubbed RotorCRAFT (Computation of Rotor Aerodynamics in Forward Flight). The technical background on the major components of this analysis are discussed and the correlation of predictions of performance, trim, and unsteady air loads with experimental data from several representative rotor configurations is examined. The primary conclusions of this study are that the RotorCRAFT analysis correlates well with measured loads on a variety of configurations and that application of the full span free wake model is required to capture several important features of the vibratory loading on rotor blades in forward flight

Shape-based Object Detection via Boundary Structure

We address the problem of object detection and segmentation using global holistic properties of object shape. Global shape representations are highly susceptible to clutter inevitably present in realistic images, and can be applied robustly only using a precise segmentation of the object. To this end, we propose a figure/ground segmentation method for extraction of image regions that resemble the global properties of a model boundary structure and are perceptually salient. Our shape representation, called the chordiogram, is based on geometric relationships of object boundary edges, while the perceptual saliency cues we use favor coherent regions distinct from the background. We formulate the segmentation problem as an integer quadratic program and use a semdefinite programming relaxation to solve it. Obtained solutions provide the segmentation of an object as well as a detection score used for object recognition. Our single-step approach achieves state-of-the-art performance on several object detection and segmentation benchmarks

Rotor design optimization using a free wake analysis

The aim of this effort was to develop a comprehensive performance optimization capability for tiltrotor and helicopter blades. The analysis incorporates the validated EHPIC (Evaluation of Hover Performance using Influence Coefficients) model of helicopter rotor aerodynamics within a general linear/quadratic programming algorithm that allows optimization using a variety of objective functions involving the performance. The resulting computer code, EHPIC/HERO (HElicopter Rotor Optimization), improves upon several features of the previous EHPIC performance model and allows optimization utilizing a wide spectrum of design variables, including twist, chord, anhedral, and sweep. The new analysis supports optimization of a variety of objective functions, including weighted measures of rotor thrust, power, and propulsive efficiency. The fundamental strength of the approach is that an efficient search for improved versions of the baseline design can be carried out while retaining the demonstrated accuracy inherent in the EHPIC free wake/vortex lattice performance analysis. Sample problems are described that demonstrate the success of this approach for several representative rotor configurations in hover and axial flight. Features that were introduced to convert earlier demonstration versions of this analysis into a generally applicable tool for researchers and designers is also discussed

Boundary-Conforming Finite Element Methods for Twin-Screw Extruders using Spline-Based Parameterization Techniques

This paper presents a novel spline-based meshing technique that allows for usage of boundary-conforming meshes for unsteady flow and temperature simulations in co-rotating twin-screw extruders. Spline-based descriptions of arbitrary screw geometries are generated using Elliptic Grid Generation. They are evaluated in a number of discrete points to yield a coarse classical mesh. The use of a special control mapping allows to fine-tune properties of the coarse mesh like orthogonality at the boundaries. The coarse mesh is used as a 'scaffolding' to generate a boundary-conforming mesh out of a fine background mesh at run-time. Storing only a coarse mesh makes the method cheap in terms of memory storage. Additionally, the adaptation at run-time is extremely cheap compared to computing the flow solution. Furthermore, this method circumvents the need for expensive re-meshing and projections of solutions making it efficient and accurate. It is incorporated into a space-time finite element framework. We present time-dependent test cases of non-Newtonian fluids in 2D and 3D for complex screw designs. They demonstrate the potential of the method also for arbitrarily complex industrial applications

Deep Learning Techniques for Music Generation -- A Survey

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical content is to be generated? Examples are: melody, polyphony, accompaniment or counterpoint. - For what destination and for what use? To be performed by a human(s) (in the case of a musical score), or by a machine (in the case of an audio file). Representation - What are the concepts to be manipulated? Examples are: waveform, spectrogram, note, chord, meter and beat. - What format is to be used? Examples are: MIDI, piano roll or text. - How will the representation be encoded? Examples are: scalar, one-hot or many-hot. Architecture - What type(s) of deep neural network is (are) to be used? Examples are: feedforward network, recurrent network, autoencoder or generative adversarial networks. Challenge - What are the limitations and open challenges? Examples are: variability, interactivity and creativity. Strategy - How do we model and control the process of generation? Examples are: single-step feedforward, iterative feedforward, sampling or input manipulation. For each dimension, we conduct a comparative analysis of various models and techniques and we propose some tentative multidimensional typology. This typology is bottom-up, based on the analysis of many existing deep-learning based systems for music generation selected from the relevant literature. These systems are described and are used to exemplify the various choices of objective, representation, architecture, challenge and strategy. The last section includes some discussion and some prospects.Comment: 209 pages. This paper is a simplified version of the book: J.-P. Briot, G. Hadjeres and F.-D. Pachet, Deep Learning Techniques for Music Generation, Computational Synthesis and Creative Systems, Springer, 201

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

This paper discusses real-time alignment of audio signals of music performance to the corresponding score (a.k.a. score following) which can handle tempo changes, errors and arbitrary repeats and/or skips (repeats/skips) in performances. This type of score following is particularly useful in automatic accompaniment for practices and rehearsals, where errors and repeats/skips are often made. Simple extensions of the algorithms previously proposed in the literature are not applicable in these situations for scores of practical length due to the problem of large computational complexity. To cope with this problem, we present two hidden Markov models of monophonic performance with errors and arbitrary repeats/skips, and derive efficient score-following algorithms with an assumption that the prior probability distributions of score positions before and after repeats/skips are independent from each other. We confirmed real-time operation of the algorithms with music scores of practical length (around 10000 notes) on a modern laptop and their tracking ability to the input performance within 0.7 s on average after repeats/skips in clarinet performance data. Further improvements and extension for polyphonic signals are also discussed.Comment: 12 pages, 8 figures, version accepted in IEEE/ACM Transactions on Audio, Speech, and Language Processin

A Knowledge-Based Optimization Method for Aerodynamic Design

A new aerodynamic design method, CODISC, has been developed that combines a legacy knowledge-based design method, CDISC, with a simple optimization module known as SOUP. The primary goal of this new design system is to improve the performance gains obtained using CDISC without adding significant computational time. An additional objective of this approach is to reduce the need for a priori knowledge of good initial input variable values, as well as for subsequent manual revisions of those values as the design progresses. Several test cases illustrate the development of the process to date and some of the options available at transonic and supersonic speeds for turbulent flow designs. The test cases generally start from good baseline configurations and, in all cases, were able to improve the performance. Several new guidelines for good initial values for the design variables, as well as new design rules within CDISC itself, were developed from these cases