An intra-vehicular wireless multimedia sensor network for smartphone-based low-cost advanced driver-assistance systems

Advanced driver-assistance system(s) (ADAS) are more prevalent in high-end vehicles than in low-end vehicles. Wired solutions of vision sensors in ADAS already exist, but are costly and do not cater for low-end vehicles. General ADAS use wired harnessing for communication; this approach eliminates the need for cable harnessing and, therefore, the practicality of a novel wireless ADAS solution was tested. A low-cost alternative is proposed that extends a smartphone’s sensor perception, using a camera-based wireless sensor network. This paper presents the design of a low-cost ADAS alternative that uses an intra-vehicle wireless sensor network structured by a Wi-Fi Direct topology, using a smartphone as the processing platform. The proposed system makes ADAS features accessible to cheaper vehicles and investigates the possibility of using a wireless network to communicate ADAS information in a intra-vehicle environment. Other ADAS smartphone approaches make use of a smartphone’s onboard sensors; however, this paper shows the application of essential ADAS features developed on the smartphone’s ADAS application, carrying out both lane detection and collision detection on a vehicle by using wireless sensor data. A smartphone’s processing power was harnessed and used as a generic object detector through a convolution neural network, using the sensory network’s video streams. The network’s performance was analysed to ensure that the network could carry out detection in real-time. A low-cost CMOS camera sensor network with a smartphone found an application, using Wi-Fi Direct, to create an intra-vehicle wireless network as a low-cost advanced driver-assistance system.DATA AVAILABLITY STATEMENT : Publicly available datasets were analysed in this study. There data can be found here: https://github.com/TuSimple/tusimple-benchmark and https://boxy-dataset.com/ boxy/ accessed on 25 November 2021.https://www.mdpi.com/journal/sensorsam2023Electrical, Electronic and Computer Engineerin

A DATA-DRIVEN APPROACH TO SUPPORTING USERS’ ADAPTATION TO SMART IN-VEHICLE SYSTEMS

The utilization of data to understand user behavior and support user needs began to develop in areas such as internet services, smartphone apps development, and the gaming industry. This bloom of data-driven services and applications forced OEMs to consider possible solutions for better in-vehicle connectivity. However, digital transformation in the automotive sector presents numerous challenges. One of those challenges is identifying and establishing the relevant user-related data that will cover current and future needs to help the automotive industry cope with the digital transformation pace. At the same time, this development should not be sporadic, without a clear purpose or vision of how newly-generated data can support engineers to create better systems for drivers. The important issue is to learn how to extract the knowledge from the immense data we possess, and to understand the extent to which this data can be used.Another challenge is the lack of established approaches towards vehicle data utilization for user-related studies. This area is relatively new to the automotive industry. Despite the positive examples from other fields that demonstrate the potential for data-driven context-aware applications, automotive practices still have gaps in capturing the driving context and driver behavior. This lack of user-related data can partially be explained by the multitasking activities that the driver performs while driving the car and the higher complexity of the automotive context compared to other domains. Thus, more research is needed to explore the capacity of vehicle data to support users in different tasks.Considering all the interrelations between the driver and in-vehicle system in the defined context of use helps to obtain more comprehensive information and better understand how the system under evaluation can be improved to meet driver needs. Tracking driver behavior with the help of vehicle data may provide developers with quick and reliable user feedback on how drivers are using the system. Compared to vehicle data, the driver’s feedback is often incomplete and perception-based since the driver cannot always correlate his behavior to complex processes of vehicle performance or clearly remember the context conditions. Thus, this research aims to demonstrate the ability of vehicle data to support product design and evaluation processes with data-driven automated user insights. This research does not disregard the driver’s qualitative input as unimportant but provides insights into how to better combine quantitative and qualitative methods for more effective results.According to the aim, the research focuses on three main aspects:•\ua0\ua0\ua0\ua0\ua0 Identifying the extent to which vehicle data can contribute to driver behavior understanding.\ua0 •\ua0\ua0\ua0\ua0\ua0 Expanding the concepts for vehicle data utilization to support drivers.•\ua0\ua0\ua0\ua0\ua0 Developing the methodology for a more effective combination of quantitative (vehicle data-based) and qualitative (based on users’ feedback) studies. Additionally, special consideration is given to describing the drawbacks and limitations, to enhance future data-driven applications

Hybrid mobile computing for connected autonomous vehicles

With increasing urbanization and the number of cars on road, there are many global issues on modern transport systems, Autonomous driving and connected vehicles are the most promising technologies to tackle these issues. The so-called integrated technology connected autonomous vehicles (CAV) can provide a wide range of safety applications for safer, greener and more efficient intelligent transport systems (ITS). As computing is an extreme component for CAV systems,various mobile computing models including mobile local computing, mobile edge computing and mobile cloud computing are proposed. However it is believed that none of these models fits all CAV applications, which have highly diverse quality of service (QoS) requirements such as communication delay, data rate, accuracy, reliability and/or computing latency.In this thesis, we are motivated to propose a hybrid mobile computing model with objective of overcoming limitations of individual models and maximizing the performances for CAV applications.In proposed hybrid mobile computing model three basic computing models and/or their combinations are chosen and applied to different CAV applications, which include mobile local computing, mobile edge computing and mobile cloud computing. Different computing models and their combinations are selected according to the QoS requirements of the CAV applications.Following the idea, we first investigate the job offloading and allocation of computing and communication resources at the local hosts and external computing centers with QoS aware and resource awareness. Distributed admission control and resource allocation algorithms are proposed including two baseline non-cooperative algorithms and a matching theory based cooperative algorithm. Experiment results demonstrate the feasibility of the hybrid mobile computing model and show large improvement on the service quality and capacity over existing individual computing models. The matching algorithm also largely outperforms the baseline non-cooperative algorithms.In addition, two specific use cases of the hybrid mobile computing for CAV applications are investigated: object detection with mobile local computing where only local computing resources are used, and movie recommendation with mobile cloud computing where remote cloud resources are used. For object detection, we focus on the challenges of detecting vehicles, pedestrians and cyclists in driving environment and propose three methods to an existing CNN based object detector. Large detection performance improvement is obtained over the KITTI benchmark test dataset. For movie recommendation we propose two recommendation models based on a general framework of integrating machine learning and collaborative filtering approach.The experiment results on Netix movie dataset show that our models are very effective for cold start items recommendatio