221 research outputs found

    A Dual Sensor Computational Camera for High Quality Dark Videography

    Full text link
    Videos captured under low light conditions suffer from severe noise. A variety of efforts have been devoted to image/video noise suppression and made large progress. However, in extremely dark scenarios, extensive photon starvation would hamper precise noise modeling. Instead, developing an imaging system collecting more photons is a more effective way for high-quality video capture under low illuminations. In this paper, we propose to build a dual-sensor camera to additionally collect the photons in NIR wavelength, and make use of the correlation between RGB and near-infrared (NIR) spectrum to perform high-quality reconstruction from noisy dark video pairs. In hardware, we build a compact dual-sensor camera capturing RGB and NIR videos simultaneously. Computationally, we propose a dual-channel multi-frame attention network (DCMAN) utilizing spatial-temporal-spectral priors to reconstruct the low-light RGB and NIR videos. In addition, we build a high-quality paired RGB and NIR video dataset, based on which the approach can be applied to different sensors easily by training the DCMAN model with simulated noisy input following a physical-process-based CMOS noise model. Both experiments on synthetic and real videos validate the performance of this compact dual-sensor camera design and the corresponding reconstruction algorithm in dark videography

    An Overview of Carbon Footprint Mitigation Strategies. Machine Learning for Societal Improvement, Modernization, and Progress

    Get PDF
    Among the most pressing issues in the world today is the impact of globalization and energy consumption on the environment. Despite the growing regulatory framework to prevent ecological degradation, sustainability continues to be a problem. Machine learning can help with the transition toward a net-zero carbon society. Substantial work has been done in this direction. Changing electrical systems, transportation, buildings, industry, and land use are all necessary to reduce greenhouse gas emissions. Considering the carbon footprint aspect of sustainability, this chapter provides a detailed overview of how machine learning can be applied to forge a path to ecological sustainability in each of these areas. The chapter highlights how various machine learning algorithms are used to increase the use of renewable energy, efficient transportation, and waste management systems to reduce the carbon footprint. The authors summarize the findings from the current research literature and conclude by providing a few future directions

    Safety and Illumination of Rural and Suburban Roundabouts (Phase II)

    Get PDF
    RP19-11This project focused on establishing the relationship between the presence/absence or levels of illumination and other geometric and traffic characteristics on nighttime safety at rural and suburban roundabouts. Eighty roundabouts from thirty-seven counties across Georgia were selected to provide a wide range of conditions in terms of illumination layout, illumination levels, number of legs, number of circulating lanes, daily entering volumes, approach speeds, etc. for field measurements of illumination levels. Urban roundabouts with significant pedestrian activity were excluded. Field data collection at each site included both direct measurements of illumination levels as well as a civil site survey to verify the geometric characteristics of the roundabout and were conducted by measurement teams from Georgia Institute of Technology and Georgia Southern University. The resulting data were processed, joined, and aggregated to the individual site level and used to establish statistical relationships between observed nighttime crash rates, severity, and crash types (e.g., single vs. multiple vehicles, impaired drivers, etc.) and underlying geometric factors and measured illuminance levels. The variation in observed crash rates were modeled against known parameters of the roundabouts to develop a predictive model as to how single vehicle nighttime crash rates were impacted by illumination and other factors. As expected, multiple vehicle crashes showed no statistically significant dependence on illumination levels as the vehicles themselves, through their head- and taillights, are important contributors to nighttime visibility at the roundabout. This was not the case for single vehicle crashes. Single vehicle crashes were shown to increase for 3-leg roundabouts for illumination values less than 5 lux. No such trend was observed in either 4 or 5-leg roundabouts and these sites showed no statistically significant variation in nighttime single vehicle crash rates at any level of illumination. An overarching conclusion of the study is that there was no observed evidence of illumination values exceeding 5 lux resulting in a statistically significant reduction in nighttime crash rates for rural and suburban roundabouts. These results suggest that for rural and suburban roundabouts with no significant pedestrian volumes, illumination values significantly lower than current standards may still prove effective as a safety treatment and that, in the absence of a need to protect pedestrians or cyclists at nighttime at a particular location, a reduction in lighting levels or the use of passive retroreflective safety treatments may be a cost-effective treatment

    Enhancing City Sustainability through Smart Technologies: A Framework for Automatic Pre-Emptive Action to Promote Safety and Security Using Lighting and ICT-Based Surveillance

    Get PDF
    The scope of the present paper is to promote social, cultural and environmental sustainability in cities by establishing a conceptual framework and the relationship amongst safety in urban public space (UPS), lighting and Information and Communication Technology (ICT)-based surveillance. This framework uses available technologies and tools, as these can be found in urban equipment such as lighting posts, to enhance security and safety in UPS, ensuring protection against attempted criminal activity. Through detailed literary research, publications on security and safety concerning crime and lighting can be divided into two periods, the first one pre-1994, and the second one from 2004–2008. Since then, a significant reduction in the number of publications dealing with lighting and crime is observed, while at the same time, the urban nightscape has been reshaped with the immersion of light-emitting diode (LED) technologies. Especially in the last decade, where most municipalities in the EU28 (European Union of all the member states from the accession of Croatia in 2013 to the withdrawal of the United Kingdom in 2020) are refurbishing their road lighting with LED technology and the consideration of smart networks and surveillance is under development, the use of lighting to deter possible attempted felonies in UPS is not addressed. To capitalize on the potential of lighting as a deterrent, this paper proposes a framework that uses existing technology, namely, dimmable LED light sources, presence sensors, security cameras, as well as emerging techniques such as artificial intelligence (AI)-enabled image recognition algorithms and big data analytics and presents a possible system that could be developed as a stand-alone product to alert possible dangerous situations, deter criminal activity and promote the perception of safety thus linking lighting and ICT-based surveillance towards safety and security in UPS

    A Context Aware Classification System for Monitoring Driver’s Distraction Levels

    Get PDF
    Understanding the safety measures regarding developing self-driving futuristic cars is a concern for decision-makers, civil society, consumer groups, and manufacturers. The researchers are trying to thoroughly test and simulate various driving contexts to make these cars fully secure for road users. Including the vehicle’ surroundings offer an ideal way to monitor context-aware situations and incorporate the various hazards. In this regard, different studies have analysed drivers’ behaviour under different case scenarios and scrutinised the external environment to obtain a holistic view of vehicles and the environment. Studies showed that the primary cause of road accidents is driver distraction, and there is a thin line that separates the transition from careless to dangerous. While there has been a significant improvement in advanced driver assistance systems, the current measures neither detect the severity of the distraction levels nor the context-aware, which can aid in preventing accidents. Also, no compact study provides a complete model for transitioning control from the driver to the vehicle when a high degree of distraction is detected. The current study proposes a context-aware severity model to detect safety issues related to driver’s distractions, considering the physiological attributes, the activities, and context-aware situations such as environment and vehicle. Thereby, a novel three-phase Fast Recurrent Convolutional Neural Network (Fast-RCNN) architecture addresses the physiological attributes. Secondly, a novel two-tier FRCNN-LSTM framework is devised to classify the severity of driver distraction. Thirdly, a Dynamic Bayesian Network (DBN) for the prediction of driver distraction. The study further proposes the Multiclass Driver Distraction Risk Assessment (MDDRA) model, which can be adopted in a context-aware driving distraction scenario. Finally, a 3-way hybrid CNN-DBN-LSTM multiclass degree of driver distraction according to severity level is developed. In addition, a Hidden Markov Driver Distraction Severity Model (HMDDSM) for the transitioning of control from the driver to the vehicle when a high degree of distraction is detected. This work tests and evaluates the proposed models using the multi-view TeleFOT naturalistic driving study data and the American University of Cairo dataset (AUCD). The evaluation of the developed models was performed using cross-correlation, hybrid cross-correlations, K-Folds validation. The results show that the technique effectively learns and adopts safety measures related to the severity of driver distraction. In addition, the results also show that while a driver is in a dangerous distraction state, the control can be shifted from driver to vehicle in a systematic manner

    Socio-Cognitive and Affective Computing

    Get PDF
    Social cognition focuses on how people process, store, and apply information about other people and social situations. It focuses on the role that cognitive processes play in social interactions. On the other hand, the term cognitive computing is generally used to refer to new hardware and/or software that mimics the functioning of the human brain and helps to improve human decision-making. In this sense, it is a type of computing with the goal of discovering more accurate models of how the human brain/mind senses, reasons, and responds to stimuli. Socio-Cognitive Computing should be understood as a set of theoretical interdisciplinary frameworks, methodologies, methods and hardware/software tools to model how the human brain mediates social interactions. In addition, Affective Computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects, a fundamental aspect of socio-cognitive neuroscience. It is an interdisciplinary field spanning computer science, electrical engineering, psychology, and cognitive science. Physiological Computing is a category of technology in which electrophysiological data recorded directly from human activity are used to interface with a computing device. This technology becomes even more relevant when computing can be integrated pervasively in everyday life environments. Thus, Socio-Cognitive and Affective Computing systems should be able to adapt their behavior according to the Physiological Computing paradigm. This book integrates proposals from researchers who use signals from the brain and/or body to infer people's intentions and psychological state in smart computing systems. The design of this kind of systems combines knowledge and methods of ubiquitous and pervasive computing, as well as physiological data measurement and processing, with those of socio-cognitive and affective computing

    Implicit personalization in driving assistance: State-of-the-art and open issues

    Get PDF
    In recent decades, driving assistance systems have been evolving towards personalization for adapting to different drivers. With the consideration of driving preferences and driver characteristics, these systems become more acceptable and trustworthy. This article presents a survey on recent advances in implicit personalized driving assistance. We classify the collection of work into three main categories: 1) personalized Safe Driving Systems (SDS), 2) personalized Driver Monitoring Systems (DMS), and 3) personalized In-vehicle Information Systems (IVIS). For each category, we provide a comprehensive review of current applications and related techniques along with the discussion of industry status, benefits of personalization, application prospects, and future focal points. Both relevant driving datasets and open issues about personalized driving assistance are discussed to facilitate future research. By creating an organized categorization of the field, we hope that this survey could not only support future research and the development of new technologies for personalized driving assistance but also facilitate the application of these techniques within the driving automation community</h2
    • …
    corecore