Intelligent Wireless Sensor Nodes for Human Footstep Sound Classification for Security Application

Sensor nodes present in a wireless sensor network (WSN) for security surveillance applications should preferably be small, energy-efficient and inexpensive with on-sensor computational abilities. An appropriate data processing scheme in the sensor node can help in reducing the power dissipation of the transceiver through compression of information to be communicated. In this paper, authors have attempted a simulation-based study of human footstep sound classification in natural surroundings using simple time-domain features. We used a spiking neural network (SNN), a computationally low weight classifier, derived from an artificial neural network (ANN), for classification. A classification accuracy greater than 85% is achieved using an SNN, degradation of ~5% as compared to ANN. The SNN scheme, along with the required feature extraction scheme, can be amenable to low power sub-threshold analog implementation. Results show that all analog implementation of the proposed SNN scheme can achieve significant power savings over the digital implementation of the same computing scheme and also over other conventional digital architectures using frequency-domain feature extraction and ANN-based classification.Comment: 12 pages, Journa

Efficient Time of Arrival Calculation for Acoustic Source Localization Using Wireless Sensor Networks

Acoustic source localization is a very useful tool in surveillance and tracking applications. Potential exists for ubiquitous presence of acoustic source localization systems. However, due to several significant challenges they are currently limited in their applications. Wireless Sensor Networks (WSN) offer a feasible solution that can allow for large, ever present acoustic localization systems. Some fundamental challenges remain. This thesis presents some ideas for helping solve the challenging problems faced by networked acoustic localization systems. We make use of a low-power WSN designed specifically for distributed acoustic source localization. Our ideas are based on three important observations. First, sounds emanating from a source will be free of reflections at the beginning of the sound. We make use of this observation by selectively processing only the initial parts of a sound to be localized. Second, the significant features of a sound are more robust to various interference sources. We perform key feature recognition such as the locations of significant zero crossings and local peaks. Third, these features which are compressed descriptors, can also be used for distributed pattern matching. For this we perform basic pattern analysis by comparing sampled signals from various nodes in order to determine better Time Of Arrivals (TOA). Our implementation tests these ideas in a predictable test environment. A complete system for general sounds is left for future wor

Efficient Time of Arrival Calculation for Acoustic Source Localization Using Wireless Sensor Networks

Acoustic source localization is a very useful tool in surveillance and tracking applications. Potential exists for ubiquitous presence of acoustic source localization systems. However, due to several significant challenges they are currently limited in their applications. Wireless Sensor Networks (WSN) offer a feasible solution that can allow for large, ever present acoustic localization systems. Some fundamental challenges remain. This thesis presents some ideas for helping solve the challenging problems faced by networked acoustic localization systems. We make use of a low-power WSN designed specifically for distributed acoustic source localization. Our ideas are based on three important observations. First, sounds emanating from a source will be free of reflections at the beginning of the sound. We make use of this observation by selectively processing only the initial parts of a sound to be localized. Second, the significant features of a sound are more robust to various interference sources. We perform key feature recognition such as the locations of significant zero crossings and local peaks. Third, these features which are compressed descriptors, can also be used for distributed pattern matching. For this we perform basic pattern analysis by comparing sampled signals from various nodes in order to determine better Time Of Arrivals (TOA). Our implementation tests these ideas in a predictable test environment. A complete system for general sounds is left for future wor

Efficient Time of Arrival Calculation for Acoustic Source Localization Using Wireless Sensor Networks

Acoustic source localization is a very useful tool in surveillance and tracking applications. Potential exists for ubiquitous presence of acoustic source localization systems. However, due to several significant challenges they are currently limited in their applications. Wireless Sensor Networks (WSN) offer a feasible solution that can allow for large, ever present acoustic localization systems. Some fundamental challenges remain. This thesis presents some ideas for helping solve the challenging problems faced by networked acoustic localization systems. We make use of a low-power WSN designed specifically for distributed acoustic source localization. Our ideas are based on three important observations. First, sounds emanating from a source will be free of reflections at the beginning of the sound. We make use of this observation by selectively processing only the initial parts of a sound to be localized. Second, the significant features of a sound are more robust to various interference sources. We perform key feature recognition such as the locations of significant zero crossings and local peaks. Third, these features which are compressed descriptors, can also be used for distributed pattern matching. For this we perform basic pattern analysis by comparing sampled signals from various nodes in order to determine better Time Of Arrivals (TOA). Our implementation tests these ideas in a predictable test environment. A complete system for general sounds is left for future wor

Auditory Displays and Assistive Technologies: the use of head movements by visually impaired individuals and their implementation in binaural interfaces

Visually impaired people rely upon audition for a variety of purposes, among these are the use of sound to identify the position of objects in their surrounding environment. This is limited not just to localising sound emitting objects, but also obstacles and environmental boundaries, thanks to their ability to extract information from reverberation and sound reflections- all of which can contribute to effective and safe navigation, as well as serving a function in certain assistive technologies thanks to the advent of binaural auditory virtual reality. It is known that head movements in the presence of sound elicit changes in the acoustical signals which arrive at each ear, and these changes can improve common auditory localisation problems in headphone-based auditory virtual reality, such as front-to-back reversals. The goal of the work presented here is to investigate whether the visually impaired naturally engage head movement to facilitate auditory perception and to what extent it may be applicable to the design of virtual auditory assistive technology. Three novel experiments are presented; a field study of head movement behaviour during navigation, a questionnaire assessing the self-reported use of head movement in auditory perception by visually impaired individuals (each comparing visually impaired and sighted participants) and an acoustical analysis of inter-aural differences and cross- correlations as a function of head angle and sound source distance. It is found that visually impaired people self-report using head movement for auditory distance perception. This is supported by head movements observed during the field study, whilst the acoustical analysis showed that interaural correlations for sound sources within 5m of the listener were reduced as head angle or distance to sound source were increased, and that interaural differences and correlations in reflected sound were generally lower than that of direct sound. Subsequently, relevant guidelines for designers of assistive auditory virtual reality are proposed

Device-free indoor localisation with non-wireless sensing techniques : a thesis by publications presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Electronics and Computer Engineering, Massey University, Albany, New Zealand

Global Navigation Satellite Systems provide accurate and reliable outdoor positioning to support a large number of applications across many sectors. Unfortunately, such systems do not operate reliably inside buildings due to the signal degradation caused by the absence of a clear line of sight with the satellites. The past two decades have therefore seen intensive research into the development of Indoor Positioning System (IPS). While considerable progress has been made in the indoor localisation discipline, there is still no widely adopted solution. The proliferation of Internet of Things (IoT) devices within the modern built environment provides an opportunity to localise human subjects by utilising such ubiquitous networked devices. This thesis presents the development, implementation and evaluation of several passive indoor positioning systems using ambient Visible Light Positioning (VLP), capacitive-flooring, and thermopile sensors (low-resolution thermal cameras). These systems position the human subject in a device-free manner (i.e., the subject is not required to be instrumented). The developed systems improve upon the state-of-the-art solutions by offering superior position accuracy whilst also using more robust and generalised test setups. The developed passive VLP system is one of the first reported solutions making use of ambient light to position a moving human subject. The capacitive-floor based system improves upon the accuracy of existing flooring solutions as well as demonstrates the potential for automated fall detection. The system also requires very little calibration, i.e., variations of the environment or subject have very little impact upon it. The thermopile positioning system is also shown to be robust to changes in the environment and subjects. Improvements are made over the current literature by testing across multiple environments and subjects whilst using a robust ground truth system. Finally, advanced machine learning methods were implemented and benchmarked against a thermopile dataset which has been made available for other researchers to use

Application-driven data processing in wireless sensor networks

Wireless sensor networks (WSNs) are composed of spatially distributed, low-cost, low-power, resource-constrained devices using sensors and actuators to cooperatively monitor and operate into the environment. These systems are being used in a wide range of applications. The design and implementation of an effective WSN requires dealing with several challenges involving multiple disciplines, such as wireless communications and networking, software engineering, embedded systems and signal processing. Besides, the technical solutions found to these issues are closely interconnected and determine the capability of the system to successfully fulfill the requirements posed by each application domain. The large and heterogeneous amount of data collected in a WSN need to be efficiently processed in order to improve the end-user comprehension and control of the observed phenomena. The thesis focuses on a) the development of centralized and distributed data processing methods optimized for the requirements and characteristics of the considered application domains, and b) the design and implementation of suitable system architectures and protocols with respect to critical application-specific parameters. The thesis comprehends a summary and nine publications, equally divided over three different application domains, i.e. wireless automation, structural health monitoring (SHM) and indoor situation awareness (InSitA). In the first one, a wireless joystick control system for human adaptive mechatronics is developed. Also, the effect of packet losses on the performance of a wireless control system is analyzed and validated with an unstable process. A remotely reconfigurable, time synchronized wireless system for SHM enables a precise estimation of the modal properties of the monitored structure. Furthermore, structural damages are detected and localized through a distributed data processing method based on the Goertzel algorithm. In the context of InSitA, the short-time, low quality acoustic signals collected by the nodes composing the network are processed in order to estimate the number of people located in the monitored indoor environment. In a second phase, text- and language-independent speaker identification is performed. Finally, device-free localization and tracking of the movements of people inside the monitored indoor environment is achieved by means of distributed processing of the radio signal strength indicator (RSSI) signals. The results presented in the thesis demonstrate the adaptability of WSNs to different application domains and the importance of an optimal co-design of the system architecture and data processing methods

Soundscape and the Experience of Positive Silence

This body of work employs a practice-based research methodology to explore the experience of silence as positive, of benefit to the individual and, by extension, wider society. The research is positioned within the related fields of Sound Art and Sound Studies with the practice component including soundwalks, sound installation, exhibition and phenomenological enquiry initiated through listenings and reflections. Current research in this area has explored the value of silence through quiet space studies, acoustics and psychoacoustics as well as research in the field of psychology around the human experience of solitude, mindful awareness and distraction. This doctoral research draws upon the insights of these disciplines to inform both the artworks and thinking that cohered into the themes explored in this commentary. Solitary and shared silences characterised by thresholds, masking, sounds of nature, simplicity, familiarity, safety and quality of attention are explored. In so doing, psychological theories of extended mind, construal level and psychological distance are considered in relation to the web of interactions between individual and soundscape. In all, these investigations revealed auditory distraction as a feature of the soundscape that consistently undermined the experience of silence as positive. Acknowledging the growing influence of the ‘attention economy,’ the work explores the psychoacoustic basis for auditory attention and concludes by forwarding practical strategies for working with distraction that have been developed and refined through listening exercises and participatory arts practice