Automating Metadata Extraction: Genre Classification

A problem that frequently arises in the management and integration of scientific data is the lack of context and semantics that would link data encoded in disparate ways. To bridge the discrepancy, it often helps to mine scientific texts to aid the understanding of the database. Mining relevant text can be significantly aided by the availability of descriptive and semantic metadata. The Digital Curation Centre (DCC) has undertaken research to automate the extraction of metadata from documents in PDF([22]). Documents may include scientific journal papers, lab notes or even emails. We suggest genre classification as a first step toward automating metadata extraction. The classification method will be built on looking at the documents from five directions; as an object of specific visual format, a layout of strings with characteristic grammar, an object with stylo-metric signatures, an object with meaning and purpose, and an object linked to previously classified objects and external sources. Some results of experiments in relation to the first two directions are described here; they are meant to be indicative of the promise underlying this multi-faceted approach.

Smart environment monitoring through micro unmanned aerial vehicles

In recent years, the improvements of small-scale Unmanned Aerial Vehicles (UAVs) in terms of flight time, automatic control, and remote transmission are promoting the development of a wide range of practical applications. In aerial video surveillance, the monitoring of broad areas still has many challenges due to the achievement of different tasks in real-time, including mosaicking, change detection, and object detection. In this thesis work, a small-scale UAV based vision system to maintain regular surveillance over target areas is proposed. The system works in two modes. The first mode allows to monitor an area of interest by performing several flights. During the first flight, it creates an incremental geo-referenced mosaic of an area of interest and classifies all the known elements (e.g., persons) found on the ground by an improved Faster R-CNN architecture previously trained. In subsequent reconnaissance flights, the system searches for any changes (e.g., disappearance of persons) that may occur in the mosaic by a histogram equalization and RGB-Local Binary Pattern (RGB-LBP) based algorithm. If present, the mosaic is updated. The second mode, allows to perform a real-time classification by using, again, our improved Faster R-CNN model, useful for time-critical operations. Thanks to different design features, the system works in real-time and performs mosaicking and change detection tasks at low-altitude, thus allowing the classification even of small objects. The proposed system was tested by using the whole set of challenging video sequences contained in the UAV Mosaicking and Change Detection (UMCD) dataset and other public datasets. The evaluation of the system by well-known performance metrics has shown remarkable results in terms of mosaic creation and updating, as well as in terms of change detection and object detection

Subitizing with Variational Autoencoders

Numerosity, the number of objects in a set, is a basic property of a given visual scene. Many animals develop the perceptual ability to subitize: the near-instantaneous identification of the numerosity in small sets of visual items. In computer vision, it has been shown that numerosity emerges as a statistical property in neural networks during unsupervised learning from simple synthetic images. In this work, we focus on more complex natural images using unsupervised hierarchical neural networks. Specifically, we show that variational autoencoders are able to spontaneously perform subitizing after training without supervision on a large amount images from the Salient Object Subitizing dataset. While our method is unable to outperform supervised convolutional networks for subitizing, we observe that the networks learn to encode numerosity as basic visual property. Moreover, we find that the learned representations are likely invariant to object area; an observation in alignment with studies on biological neural networks in cognitive neuroscience

FOUR YEARS OF UNMANNED AERIAL SYSTEM IMAGERY REVEALS VEGETATION CHANGE IN A SUB-ARCTIC MIRE DUE TO PERMAFROST THAW

Warming trends in sub-arctic regions have resulted in thawing of permafrost which in turn induces change in vegetation across peatlands both in areal extent and composition. Collapse of palsas (i.e. permafrost plateaus) has also been correlated with increases in methane (CH4) emission to the atmosphere. Vegetation change provides new microenvironments that promote CH4 production and emission, specifically through plant interactions and structure. By quantifying the changes in vegetation at the landscape scale, we will be able to scale the impact of thaw on CH4 emissions in these complex climate-sensitive northern ecosystems. We combine field-based measurements of vegetation composition and Unmanned Aerial Systems (UAS) high resolution (3 cm) imagery to characterize vegetation change in a sub-arctic mire. The objective of this study is to analyze how vegetation from Stordalen Mire, Abisko, Sweden, has changed over time in response to permafrost thaw. At Stordalen Mire, we flew a fixed-wing UAS in July of each of four years, 2014 through 2017, over a 1 km x 0.5 km area. High precision GPS ground control points were used to georeference the imagery. Randomized square-meter plots were measured for vegetation composition and individually classified into one of five vegetation cover types, each representing a different stage of permafrost degradation. Using these training data, each year of imagery was classified by cover type in Google Earth Engine using a Random Forest Classifier. Textural information was extracted from the imagery, which provided additional spatial context information and improved classification accuracy. Twenty five percent of the training data were held back from the classification and used for validation, while the remaining seventy five percent of the training data were used to classify the imagery. The overall classification accuracy for 2014-2017 was 80.6%, 79.1%, 82.0%, and 82.9%, respectively. Percent cover across the landscape was calculated from each classification map and compared between years. Hummock sites, representing intact permafrost, decreased coverage by 9% from 2014-2017, while semi-wet sites increased coverage by 18%. This four-year comparison of vegetation cover indicated a rapid response to permafrost thaw. The use of a UAS allowed us to effectively capture the spatial heterogeneity of a northern peatland ecosystem. Estimation of vegetation cover types is vital in our understanding of the evolution of northern peatlands and their future role in the global carbon cycle

Spoken affect classification : algorithms and experimental implementation : a thesis presented in partial fulfilment of the requirements for the degree of Master of Science in Computer Science at Massey University, Palmerston North, New Zealand

Machine-based emotional intelligence is a requirement for natural interaction between humans and computer interfaces and a basic level of accurate emotion perception is needed for computer systems to respond adequately to human emotion. Humans convey emotional information both intentionally and unintentionally via speech patterns. These vocal patterns are perceived and understood by listeners during conversation. This research aims to improve the automatic perception of vocal emotion in two ways. First, we compare two emotional speech data sources: natural, spontaneous emotional speech and acted or portrayed emotional speech. This comparison demonstrates the advantages and disadvantages of both acquisition methods and how these methods affect the end application of vocal emotion recognition. Second, we look at two classification methods which have gone unexplored in this field: stacked generalisation and unweighted vote. We show how these techniques can yield an improvement over traditional classification methods