Spoken language processing: piecing together the puzzle

Attempting to understand the fundamental mechanisms underlying spoken language processing, whether it is viewed as behaviour exhibited by human beings or as a faculty simulated by machines, is one of the greatest scientific challenges of our age. Despite tremendous achievements over the past 50 or so years, there is still a long way to go before we reach a comprehensive explanation of human spoken language behaviour and can create a technology with performance approaching or exceeding that of a human being. It is argued that progress is hampered by the fragmentation of the field across many different disciplines, coupled with a failure to create an integrated view of the fundamental mechanisms that underpin one organism's ability to communicate with another. This paper weaves together accounts from a wide variety of different disciplines concerned with the behaviour of living systems - many of them outside the normal realms of spoken language - and compiles them into a new model: PRESENCE (PREdictive SENsorimotor Control and Emulation). It is hoped that the results of this research will provide a sufficient glimpse into the future to give breath to a new generation of research into spoken language processing by mind or machine. (c) 2007 Elsevier B.V. All rights reserved

A Survey and Evaluation of Android-Based Malware Evasion Techniques and Detection Frameworks

Android platform security is an active area of research where malware detection techniques continuously evolve to identify novel malware and improve the timely and accurate detection of existing malware. Adversaries are constantly in charge of employing innovative techniques to avoid or prolong malware detection effectively. Past studies have shown that malware detection systems are susceptible to evasion attacks where adversaries can successfully bypass the existing security defenses and deliver the malware to the target system without being detected. The evolution of escape-resistant systems is an open research problem. This paper presents a detailed taxonomy and evaluation of Android-based malware evasion techniques deployed to circumvent malware detection. The study characterizes such evasion techniques into two broad categories, polymorphism and metamorphism, and analyses techniques used for stealth malware detection based on the malware’s unique characteristics. Furthermore, the article also presents a qualitative and systematic comparison of evasion detection frameworks and their detection methodologies for Android-based malware. Finally, the survey discusses open-ended questions and potential future directions for continued research in mobile malware detection

Low vision assistance with mobile devices

Low vision affects many people, both young and old. Low vision conditions can range from near- and far-sightedness to conditions such as blind spots and tunnel vision. With the growing popularity of mobile devices such as smartphones, there is large opportunity for use of these multipurpose devices to provide low vision assistance. Furthermore, Google\u27s Android operating system provides a robust environment for applications in various fields, including low vision assistance. The objective of this thesis research is to develop a system for low vision assistance that displays important information at the preferred location of the user\u27s visual field. To that end, a first release of a prototype blind spot/tunnel vision assistance system was created and demonstrated on an Android smartphone. Various algorithms for face detection and face tracking were implemented on the Android platform and their performance was assessed with regards to metrics such as throughput and battery usage. Specifically, Viola-Jones, Support Vector Machines, and a color-based method from Pai et al were used for face detection. Template matching, CAMShift, and Lucas-Kanade methods were used for face tracking. It was found that face detection and tracking could be successfully executed within acceptable bounds of time and battery usage, and in some cases performed faster than it would take a comparable cloud-based system for offloading algorithm usage to complete execution

Research on Brain and Mind Inspired Intelligence

To address the problems of scientific theory, common technology and engineering application of multimedia and multimodal information computing, this paper is focused on the theoretical model, algorithm framework, and system architecture of brain and mind inspired intelligence (BMI) based on the structure mechanism simulation of the nervous system, the function architecture emulation of the cognitive system and the complex behavior imitation of the natural system. Based on information theory, system theory, cybernetics and bionics, we define related concept and hypothesis of brain and mind inspired computing (BMC) and design a model and framework for frontier BMI theory. Research shows that BMC can effectively improve the performance of semantic processing of multimedia and cross-modal information, such as target detection, classification and recognition. Based on the brain mechanism and mind architecture, a semantic-oriented multimedia neural, cognitive computing model is designed for multimedia semantic computing. Then a hierarchical cross-modal cognitive neural computing framework is proposed for cross-modal information processing. Furthermore, a cross-modal neural, cognitive computing architecture is presented for remote sensing intelligent information extraction platform and unmanned autonomous system

An FPGA platform for real-time simulation of spiking neuronal networks

In the last years, the idea to dynamically interface biological neurons with artificial ones has become more and more urgent. The reason is essentially due to the design of innovative neuroprostheses where biological cell assemblies of the brain can be substituted by artificial ones. For closed-loop experiments with biological neuronal networks interfaced with in silico modeled networks, several technological challenges need to be faced, from the low-level interfacing between the living tissue and the computational model to the implementation of the latter in a suitable form for real-time processing. Field programmable gate arrays (FPGAs) can improve flexibility when simple neuronal models are required, obtaining good accuracy, real-time performance, and the possibility to create a hybrid system without any custom hardware, just programming the hardware to achieve the required functionality. In this paper, this possibility is explored presenting a modular and efficient FPGA design of an in silico spiking neural network exploiting the Izhikevich model. The proposed system, prototypically implemented on a Xilinx Virtex 6 device, is able to simulate a fully connected network counting up to 1,440 neurons, in real-time, at a sampling rate of 10 kHz, which is reasonable for small to medium scale extra-cellular closed-loop experiments

Experimental Methods To Support Robot Behavior Design For Legged Locomotion On Granular Media

Most models of legged locomotion assume a rigid ground contact, but this is not a reasonable assumption for robots in unstructured, outdoor environments, and especially not for field robots in dry desert environments. Locomotion on sand, a highly dissipative substrate, presents the additional challenge of a high energetic cost of transport. Many legged robots can be adapted for desert locomotion by simple morphological changes like increasing foot size or gearing down the motors. However, the Minitaur robot has direct-drive (no gearbox) legs which are sensitive enough to measure ground properties of interest to geoscientists, and its legs would lose their sensitivity if they were geared down or the footsize increased substantially. This thesis has two main contributions. First, a controller for jumping on sand with a direct-drive robot that saves significant energy in comparison to a nominal compression-extension Raibert-style controller without sacrificing jump height. This controller was developed by examining the complex interaction between the jumping leg and the ground, and devising a force to add to the leg controller which will push the robot’s foot into a more favorable state that does not transfer as much energy to the ground. The second contribution is a ground emulator robot which can be programmed to exert ground force functions of arbitrary shape. With the ground emulator, it is possible for a robot on a linear rail to jump dozens of times per experiment, whereas traditional experiments on granular media would require the ground to be reset between individual jumps. Results from the simulation experiments used to develop the controller and the ground emulator experiments used to test it on a physical robot leg are validated with experiments on a prepared granular media bed. Finally, the contributions of this thesis are contextualized in a broader project of building explainable artificially intelligent systems by composing robust, mostly reactive controllers

Neural network emulation of a rainfall-runoff model

International audienceThe potential of an artificial neural network to perform simple non-linear hydrological transformations is examined. Four neural network models were developed to emulate different facets of a recognised non-linear hydrological transformation equation that possessed a small number of variables and contained no temporal component. The modeling process was based on a set of uniform random distributions. The cloning operation facilitated a direct comparison with the exact equation-based relationship. It also provided broader information about the power of a neural network to emulate existing equations and model non-linear relationships. Several comparisons with least squares multiple linear regression were performed. The first experiment involved a direct emulation of the Xinanjiang Rainfall-Runoff Model. The next two experiments were designed to assess the competencies of two neural solutions that were developed on a reduced number of inputs. This involved the omission and conflation of previous inputs. The final experiment used derived variables to model intrinsic but otherwise concealed internal relationships that are of hydrological interest. Two recent studies have suggested that neural solutions offer no worthwhile improvements in comparison to traditional weighted linear transfer functions for capturing the non-linear nature of hydrological relationships. Yet such fundamental properties are intrinsic aspects of catchment processes that cannot be excluded or ignored. The results from the four experiments that are reported in this paper are used to challenge the interpretations from these two earlier studies and thus further the debate with regards to the appropriateness of neural networks for hydrological modelling

Survey of FPGA applications in the period 2000 – 2015 (Technical Report)

Romoth J, Porrmann M, Rückert U. Survey of FPGA applications in the period 2000 – 2015 (Technical Report).; 2017.Since their introduction, FPGAs can be seen in more and more different fields of applications. The key advantage is the combination of software-like flexibility with the performance otherwise common to hardware. Nevertheless, every application field introduces special requirements to the used computational architecture. This paper provides an overview of the different topics FPGAs have been used for in the last 15 years of research and why they have been chosen over other processing units like e.g. CPUs

Towards Autonomous Computer Networks in Support of Critical Systems

L'abstract è presente nell'allegato / the abstract is in the attachmen