Channel State Information based Device Free Wireless Sensing for IoT Devices Employing TinyML

The channel state information (CSI) of the sub-carriers employed in orthogonal frequency division multiplexing (OFDM) systems has been employed traditionally for channel equalisation. However, the CSI intrinsically is a signature of the operational RF environment and can serve as a proxy for certain activities in the operational environment. For instance, the CSI gets influenced by scatterers and therefore can be an indicator of how many scatterers or if there are mobile scatterers etc. The mapping between the activities whose signature CSI encodes and the raw data is not deterministic. Nevertheless, machine learning (ML) based approaches can provide a reliable classification for patterns of life. Most of these approaches have only been implemented in lab environments. This is mainly because the hardware requirements for capturing CSI, processing it and performing signal-processing algorithms are too complex to be implemented in commercial devices. The increased proliferation of IoT sensors and the development of edge-based ML capabilities using the TinyML framework opens up possibilities for the implementation of these techniques at scale on commercial devices. Using RF signature instead of more invasive methods e.g. cameras or wearable devices provide ease of deployment, intrinsic privacy and better usability. The design space of device-free wireless sensing (DFWS) is complex and involves device, firmware and ML considerations. In this article, we present a comprehensive overview and key considerations for the implementation of such solutions. We also demonstrate the viability of these approaches using a simple case study

Advanced Sensing and Control for Connected and Automated Vehicles

Connected and automated vehicles (CAVs) are a transformative technology that is expected to change and improve the safety and efficiency of mobility. As the main functional components of CAVs, advanced sensing technologies and control algorithms, which gather environmental information, process data, and control vehicle motion, are of great importance. The development of novel sensing technologies for CAVs has become a hotspot in recent years. Thanks to improved sensing technologies, CAVs are able to interpret sensory information to further detect obstacles, localize their positions, navigate themselves, and interact with other surrounding vehicles in the dynamic environment. Furthermore, leveraging computer vision and other sensing methods, in-cabin humans’ body activities, facial emotions, and even mental states can also be recognized. Therefore, the aim of this Special Issue has been to gather contributions that illustrate the interest in the sensing and control of CAVs

Augmented reality and scene examination

The research presented in this thesis explores the impact of Augmented Reality on human performance, and compares this technology with Virtual Reality using a head-mounted video-feed for a variety of tasks that relate to scene examination. The motivation for the work was the question of whether Augmented Reality could provide a vehicle for training in crime scene investigation. The Augmented Reality application was developed using fiducial markers in the Windows Presentation Foundation, running on a wearable computer platform; Virtual Reality was developed using the Crytek game engine to present a photo-realistic 3D environment; and a video-feed was provided through head-mounted webcam. All media were presented through head-mounted displays of similar resolution to provide the sole source of visual information to participants in the experiments. The experiments were designed to increase the amount of mobility required to conduct the search task, i.e., from rotation in the horizontal or vertical plane through to movement around a room. In each experiment, participants were required to find objects and subsequently recall their location. It is concluded that human performance is affected not merely via the medium through which the world is perceived but moreover, the constraints governing how movement in the world is controlled

Multimodal, intermodal and terminals

The chapter looks at rail freight terminals, rail--sea interfaces, in particular, as part of a multimodal, or integrated transportation network. Terminals are key infrastructure for linking individual transport modes and governing and managing their interchange in a manner that creates a seamless and sustainable transportation system. Therefore, their performance is critical for maximising transport efficiency and modes integration. This chapter focused on how to measure the operational performance of rail freight terminals in a framework of integrated transportation network. In an increasingly competitive and commercialised world, there is an increasing demand to be able to rank transport options and routes in some way. Drawing on new material, this talk attempts to outline possible methods for how to measure the performance of rail terminals. It focuses on the identification of suitable methods to assess performance by key indicators. Intermodality demands for going beyond safeguarding the individual modes to ensuring the security of the intermodal inter-faces (terminals), the nodes that link and integrate passenger and freight flows. That demands for an integrated holistic approach built on the collaboration between international, national organisations and operators. The study put emphasis on the security challenges and threats to freight transport generally and in rail-sea interfaces more specifically. It moves onto the regulations already governing security in rail-sea interfaces. Finally, it focus on the role that infrastructure planning can play in improving security and offer some conclusions and recommendations for the futur

Visible Light Communication Cyber Security Vulnerabilities For Indoor And Outdoor Vehicle-To-Vehicle Communication

Light fidelity (Li-Fi), developed from the approach of Visible Light Communication (VLC), is a great replacement or complement to existing radio frequency-based (RF) networks. Li-Fi is expected to be deployed in various environments were, due to Wi-Fi congestion and health limitations, RF should not be used. Moreover, VLC can provide the future fifth generation (5G) wireless technology with higher data rates for device connectivity which will alleviate the traffic demand. 5G is playing a vital role in encouraging the modern applications. In 2023, the deployment of all the cellular networks will reach more than 5 billion users globally. As a result, the security and privacy of 5G wireless networks is an essential problem as those modern applications are in people\u27s life everywhere. VLC security is as one of the core physical-layer security (PLS) solutions for 5G networks. Due to the fact that light does not penetrate through solid objects or walls, VLC naturally has higher security and privacy for indoor wireless networks compared to RF networks. However, the broadcasting nature of VLC caused concerns, e.g., eavesdropping, have created serious attention as it is a crucial step to validate the success of VLC in wild. The aim of this thesis is to properly address the security issues of VLC and further enhance the VLC nature security. We analyzed the secrecy performance of a VLC model by studying the characteristics of the transmitter, receiver and the visible light channel. Moreover, we mitigated the security threats in the VLC model for the legitimate user, by 1) implementing more access points (APs) in a multiuser VLC network that are cooperated, 2) reducing the semi-angle of LED to help improve the directivity and secrecy and, 3) using the protected zone strategy around the AP where eavesdroppers are restricted. According to the model\u27s parameters, the results showed that the secrecy performance in the proposed indoor VLC model and the vehicle-to-vehicle (V2V) VLC outdoor model using a combination of multiple PLS techniques as beamforming, secure communication zones, and friendly jamming is enhanced. The proposed model security performance was measured with respect to the signal to noise ratio (SNR), received optical power, and bit error rate (BER) Matlab simulation results

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Indoor localization utilizing existing infrastructure in smart homes : a thesis by publications presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Computer and Electronics Engineering, Massey University, Albany, New Zealand

Listed in 2019 Dean's List of Exceptional ThesesIndoor positioning system (IPS) have received significant interest from the research community over the past decade. However, this has not eventuated into widespread adoption of IPS and few commercial solutions exist. Integration into Smart Homes could allow for secondary services including location-based services, targeted user experiences and intrusion detection, to be enabled using the existing underlying infrastructure. Since New Zealand has an aging population, we must ensure that the elderly are well looked after. An IPS solution could detect whether a person has been immobile for an extended period and alert medical personnel. A major shortcoming of existing IPS is their reliance on end-users to undertake a significant infrastructure investment to facilitate the localization tasks. An IPS that does not require extensive installation and calibration procedures, could potentially see significant uptake from end users. In order to expedite the widespread adoption of IPS technology, this thesis focuses on four major areas of improvement, namely: infrastructure reuse, reduced node density, algorithm improvement and reduced end user calibration requirements. The work presented demonstrates the feasibility of utilizing existing wireless and lighting infrastructure for positioning and implements novel spring-relaxation and potential fields-based localization approaches that allow for robust target tracking, with minimal calibration requirements. The developed novel localization algorithms are benchmarked against the existing state of the art and show superior performance

Satellite Networks: Architectures, Applications, and Technologies

Since global satellite networks are moving to the forefront in enhancing the national and global information infrastructures due to communication satellites' unique networking characteristics, a workshop was organized to assess the progress made to date and chart the future. This workshop provided the forum to assess the current state-of-the-art, identify key issues, and highlight the emerging trends in the next-generation architectures, data protocol development, communication interoperability, and applications. Presentations on overview, state-of-the-art in research, development, deployment and applications and future trends on satellite networks are assembled