PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network

Music creation is typically composed of two parts: composing the musical score, and then performing the score with instruments to make sounds. While recent work has made much progress in automatic music generation in the symbolic domain, few attempts have been made to build an AI model that can render realistic music audio from musical scores. Directly synthesizing audio with sound sample libraries often leads to mechanical and deadpan results, since musical scores do not contain performance-level information, such as subtle changes in timing and dynamics. Moreover, while the task may sound like a text-to-speech synthesis problem, there are fundamental differences since music audio has rich polyphonic sounds. To build such an AI performer, we propose in this paper a deep convolutional model that learns in an end-to-end manner the score-to-audio mapping between a symbolic representation of music called the piano rolls and an audio representation of music called the spectrograms. The model consists of two subnets: the ContourNet, which uses a U-Net structure to learn the correspondence between piano rolls and spectrograms and to give an initial result; and the TextureNet, which further uses a multi-band residual network to refine the result by adding the spectral texture of overtones and timbre. We train the model to generate music clips of the violin, cello, and flute, with a dataset of moderate size. We also present the result of a user study that shows our model achieves higher mean opinion score (MOS) in naturalness and emotional expressivity than a WaveNet-based model and two commercial sound libraries. We open our source code at https://github.com/bwang514/PerformanceNetComment: 8 pages, 6 figures, AAAI 2019 camera-ready versio

Airborne LiDAR for DEM generation: some critical issues

Airborne LiDAR is one of the most effective and reliable means of terrain data collection. Using LiDAR data for DEM generation is becoming a standard practice in spatial related areas. However, the effective processing of the raw LiDAR data and the generation of an efficient and high-quality DEM remain big challenges. This paper reviews the recent advances of airborne LiDAR systems and the use of LiDAR data for DEM generation, with special focus on LiDAR data filters, interpolation methods, DEM resolution, and LiDAR data reduction. Separating LiDAR points into ground and non-ground is the most critical and difficult step for DEM generation from LiDAR data. Commonly used and most recently developed LiDAR filtering methods are presented. Interpolation methods and choices of suitable interpolator and DEM resolution for LiDAR DEM generation are discussed in detail. In order to reduce the data redundancy and increase the efficiency in terms of storage and manipulation, LiDAR data reduction is required in the process of DEM generation. Feature specific elements such as breaklines contribute significantly to DEM quality. Therefore, data reduction should be conducted in such a way that critical elements are kept while less important elements are removed. Given the highdensity characteristic of LiDAR data, breaklines can be directly extracted from LiDAR data. Extraction of breaklines and integration of the breaklines into DEM generation are presented

Distributed video coding for wireless video sensor networks: a review of the state-of-the-art architectures

Distributed video coding (DVC) is a relatively new video coding architecture originated from two fundamental theorems namely, Slepian–Wolf and Wyner–Ziv. Recent research developments have made DVC attractive for applications in the emerging domain of wireless video sensor networks (WVSNs). This paper reviews the state-of-the-art DVC architectures with a focus on understanding their opportunities and gaps in addressing the operational requirements and application needs of WVSNs

Decline and fall:a biological, developmental, and psycholinguistic account of deliberative language processes and ageing

Background: This paper reviews the role of deliberative processes in language: those language processes that require central resources, in contrast to the automatic processes of lexicalisation, word retrieval, and parsing. 10 Aims: We describe types of deliberative processing, and show how these processes underpin high-level processes that feature strongly in language. We focus on metalin- guistic processing, strategic processing, inhibition, and planning. We relate them to frontal-lobe function and the development of the fronto-striate loop. We then focus on the role of deliberative processes in normal and pathological development and ageing, 15 and show how these processes are particularly susceptible to deterioration with age. In particular, many of the commonly observed language impairments encountered in ageing result from a decline in deliberative processing skills rather than in automatic language processes. Main Contribution: We argue that central processing plays a larger and more important 20 role in language processing and acquisition than is often credited. Conclusions: Deliberative language processes permeate language use across the lifespan. They are particularly prone to age-related loss. We conclude by discussing implications for therapy

Parkinson's disease dementia: a neural networks perspective.

In the long-term, with progression of the illness, Parkinson's disease dementia affects up to 90% of patients with Parkinson's disease. With increasing life expectancy in western countries, Parkinson's disease dementia is set to become even more prevalent in the future. However, current treatments only give modest symptomatic benefit at best. New treatments are slow in development because unlike the pathological processes underlying the motor deficits of Parkinson's disease, the neural mechanisms underlying the dementing process and its associated cognitive deficits are still poorly understood. Recent insights from neuroscience research have begun to unravel the heterogeneous involvement of several distinct neural networks underlying the cognitive deficits in Parkinson's disease dementia, and their modulation by both dopaminergic and non-dopaminergic transmitter systems in the brain. In this review we collate emerging evidence regarding these distinct brain networks to give a novel perspective on the pathological mechanisms underlying Parkinson's disease dementia, and discuss how this may offer new therapeutic opportunities