11,253 research outputs found

    Audio-visual multi-modality driven hybrid feature learning model for crowd analysis and classification

    Get PDF
    The high pace emergence in advanced software systems, low-cost hardware and decentralized cloud computing technologies have broadened the horizon for vision-based surveillance, monitoring and control. However, complex and inferior feature learning over visual artefacts or video streams, especially under extreme conditions confine majority of the at-hand vision-based crowd analysis and classification systems. Retrieving event-sensitive or crowd-type sensitive spatio-temporal features for the different crowd types under extreme conditions is a highly complex task. Consequently, it results in lower accuracy and hence low reliability that confines existing methods for real-time crowd analysis. Despite numerous efforts in vision-based approaches, the lack of acoustic cues often creates ambiguity in crowd classification. On the other hand, the strategic amalgamation of audio-visual features can enable accurate and reliable crowd analysis and classification. Considering it as motivation, in this research a novel audio-visual multi-modality driven hybrid feature learning model is developed for crowd analysis and classification. In this work, a hybrid feature extraction model was applied to extract deep spatio-temporal features by using Gray-Level Co-occurrence Metrics (GLCM) and AlexNet transferrable learning model. Once extracting the different GLCM features and AlexNet deep features, horizontal concatenation was done to fuse the different feature sets. Similarly, for acoustic feature extraction, the audio samples (from the input video) were processed for static (fixed size) sampling, pre-emphasis, block framing and Hann windowing, followed by acoustic feature extraction like GTCC, GTCC-Delta, GTCC-Delta-Delta, MFCC, Spectral Entropy, Spectral Flux, Spectral Slope and Harmonics to Noise Ratio (HNR). Finally, the extracted audio-visual features were fused to yield a composite multi-modal feature set, which is processed for classification using the random forest ensemble classifier. The multi-class classification yields a crowd-classification accurac12529y of (98.26%), precision (98.89%), sensitivity (94.82%), specificity (95.57%), and F-Measure of 98.84%. The robustness of the proposed multi-modality-based crowd analysis model confirms its suitability towards real-world crowd detection and classification tasks

    IoT-Based Vehicle Monitoring and Driver Assistance System Framework for Safety and Smart Fleet Management

    Get PDF
    Curbing road accidents has always been one of the utmost priorities in every country. In Malaysia, Traffic Investigation and Enforcement Department reported that Malaysia’s total number of road accidents has increased from 373,071 to 533,875 in the last decade. One of the significant causes of road accidents is driver’s behaviours. However, drivers’ behaviour was challenging to regulate by the enforcement team or fleet operators, especially heavy vehicles. We proposed adopting the Internet of Things (IoT) and its’ emerging technologies to monitor and alert driver’s behavioural and driving patterns in reducing road accidents. In this work, we proposed a lane tracking and iris detection algorithm to monitor and alert the driver’s behaviour when the vehicle sways away from the lane and the driver feeling drowsy, respectively. We implemented electronic devices such as cameras, a global positioning system module, a global system communication module, and a microcontroller as an intelligent transportation system in the vehicle. We implemented face recognition for person identification using the same in-vehicle camera and recorded the working duration for authentication and operation health monitoring, respectively. With the GPS module, we monitored and alerted against permissible vehicle’s speed accordingly. We integrated IoT on the system for the fleet centre to monitor and alert the driver’s behavioural activities in real-time through the user access portal. We validated it successfully on Malaysian roads.  The outcome of this pilot project benefits the safety of drivers, public road users, and passengers. The impact of this framework leads to a new regulation by the government agencies towards merit and demerit system, real-time fleet monitoring of intelligent transportation systems, and socio-economy such as cheaper health premiums. The big data can be used to predict the driver’s behavioural in the future

    Challenges in the Design and Implementation of IoT Testbeds in Smart-Cities : A Systematic Review

    Get PDF
    Advancements in wireless communication and the increased accessibility to low-cost sensing and data processing IoT technologies have increased the research and development of urban monitoring systems. Most smart city research projects rely on deploying proprietary IoT testbeds for indoor and outdoor data collection. Such testbeds typically rely on a three-tier architecture composed of the Endpoint, the Edge, and the Cloud. Managing the system's operation whilst considering the security and privacy challenges that emerge, such as data privacy controls, network security, and security updates on the devices, is challenging. This work presents a systematic study of the challenges of developing, deploying and managing urban monitoring testbeds, as experienced in a series of urban monitoring research projects, followed by an analysis of the relevant literature. By identifying the challenges in the various projects and organising them under the V-model development lifecycle levels, we provide a reference guide for future projects. Understanding the challenges early on will facilitate current and future smart-cities IoT research projects to reduce implementation time and deliver secure and resilient testbeds

    Japanese Expert Teachers' Understanding of the Application of Rhythm in Judo: a New Pedagogy

    Get PDF
    Aim The aim of this research is to understand the application of rhythm in judo through the experience of expert Japanese coaches. Background Scientists and experienced coaches agree rhythm is an important skill in people’s everyday life. There is currently no research that investigates the importance of rhythm in judo. People with a highly developed sense of rhythm, move properly, breathe properly, or begin and finish work at the right time. Where sport is concerned, motion and dance can play an important role not only in the improvement of performance, but also in the reduction, or even prevention of, injuries. Those who are naturally musically inclined (have a musical ear) may find they can improve their technique faster than others, and this is something that, by investigating the way expert coaches understand the application of rhythm in judo, this research seeks to understand. As Lange, (1970) stated, factors of movement are ‘weight, space, time, and flow on the background of the general flux of movement in proportional arrangements’ (Bradley, 2008; Selioni, 2013; Youngerman, 1976), therefore, this research will investigate the interaction of body and mind. Dance training as well as judo are somatic experiences that have as their ultimate goal the attainment of a skilled body. With quality training an athlete gains an increased awareness of their body which leads to better control of movement and is very important for judo athletes. This training is found in Japanese kabuki dance (Hahn, 2007), the Greek syrtaki dance (Zografou & Pateraki, 2007), and in walking techniques used in the traditional and Olympic sports of Japanese judo and Greek wrestling. Methods Interpretative phenomenological analysis (IPA) was the most suitable data analysis approach for this study for a number of reasons, mainly because it was considered to most closely reflect the author's realist epistemological view. The idiographic approach and framework, particularly on IPA, was regarded as a useful framework in which the current topic could meaningfully be explored. As this study is one of the first to explore this new thematic area, IPA was the preferred approach to address the goal of providing a detailed account of the expert’s experience. Therefore, semi-structured interviews were used as a data source. This is the most conventional form of data collection using IPA and most closely reflects the researcher-participant relationship. Semi-structured interviews provide considerable flexibility by allowing the researcher to be guided by the phenomena of interest to the participant. In this study, purposive sampling was achieved using inclusion criteria pertaining to the research question. Using the ranking system criteria based on the belt in combination with age employed by the International Judo Federation (IJF) and Kodokan Judo Institute, six expert coaches of forty years old and over with a minimum belt rank of 6th dan were selected as a sample. Results Both interviews and the codification process contributed to new findings regarding the application of rhythm to judo, and judo itself as a pedagogical tool. The diagrammatic model can be considered a 'guideline' to the phenomena deemed most significant. The personal significance of rhythm in judo was evidenced by the frequency with which the interviewees naturally referred to it during the interviews. A number of interviewees said that it was important for rhythm to be second nature. Rhythm was also described as an integrated and representative element in the context of training. This framework was seen as essential in providing the reader with a contextualised understanding of the phenomena considered most important for the current research. Interviewees reported various motives for employing training in rhythm such as faster technical development, better attack/defence, fitness, speed, skills acquisition, personal and spiritual growth, competition results. Conclusions This study offers first-hand accounts from professional coaches of a previously unknown phenomena, namely the use of rhythm in judo, and sheds insight on how judo experts understand rhythm in terms of training, competition, and personal growth. These findings suggest that outside of training, coaches play an important role in teaching, mentoring, and leading students. In conclusion, the research revealed four important points which form the basis of a new method of teaching judo: pedagogy, skills, rhythm and movement

    The State of the Art in Deep Learning Applications, Challenges, and Future Prospects::A Comprehensive Review of Flood Forecasting and Management

    Get PDF
    Floods are a devastating natural calamity that may seriously harm both infrastructure and people. Accurate flood forecasts and control are essential to lessen these effects and safeguard populations. By utilizing its capacity to handle massive amounts of data and provide accurate forecasts, deep learning has emerged as a potent tool for improving flood prediction and control. The current state of deep learning applications in flood forecasting and management is thoroughly reviewed in this work. The review discusses a variety of subjects, such as the data sources utilized, the deep learning models used, and the assessment measures adopted to judge their efficacy. It assesses current approaches critically and points out their advantages and disadvantages. The article also examines challenges with data accessibility, the interpretability of deep learning models, and ethical considerations in flood prediction. The report also describes potential directions for deep-learning research to enhance flood predictions and control. Incorporating uncertainty estimates into forecasts, integrating many data sources, developing hybrid models that mix deep learning with other methodologies, and enhancing the interpretability of deep learning models are a few of these. These research goals can help deep learning models become more precise and effective, which will result in better flood control plans and forecasts. Overall, this review is a useful resource for academics and professionals working on the topic of flood forecasting and management. By reviewing the current state of the art, emphasizing difficulties, and outlining potential areas for future study, it lays a solid basis. Communities may better prepare for and lessen the destructive effects of floods by implementing cutting-edge deep learning algorithms, thereby protecting people and infrastructure

    The Globalization of Artificial Intelligence: African Imaginaries of Technoscientific Futures

    Get PDF
    Imaginaries of artificial intelligence (AI) have transcended geographies of the Global North and become increasingly entangled with narratives of economic growth, progress, and modernity in Africa. This raises several issues such as the entanglement of AI with global technoscientific capitalism and its impact on the dissemination of AI in Africa. The lack of African perspectives on the development of AI exacerbates concerns of raciality and inclusion in the scientific research, circulation, and adoption of AI. My argument in this dissertation is that innovation in AI, in both its sociotechnical imaginaries and political economies, excludes marginalized countries, nations and communities in ways that not only bar their participation in the reception of AI, but also as being part and parcel of its creation. Underpinned by decolonial thinking, and perspectives from science and technology studies and African studies, this dissertation looks at how AI is reconfiguring the debate about development and modernization in Africa and the implications for local sociotechnical practices of AI innovation and governance. I examined AI in international development and industry across Kenya, Ghana, and Nigeria, by tracing Canada’s AI4D Africa program and following AI start-ups at AfriLabs. I used multi-sited case studies and discourse analysis to examine the data collected from interviews, participant observations, and documents. In the empirical chapters, I first examine how local actors understand the notion of decolonizing AI and show that it has become a sociotechnical imaginary. I then investigate the political economy of AI in Africa and argue that despite Western efforts to integrate the African AI ecosystem globally, the AI epistemic communities in the continent continue to be excluded from dominant AI innovation spaces. Finally, I examine the emergence of a Pan-African AI imaginary and argue that AI governance can be understood as a state-building experiment in post-colonial Africa. The main issue at stake is that the lack of African perspectives in AI leads to negative impacts on innovation and limits the fair distribution of the benefits of AI across nations, countries, and communities, while at the same time excludes globally marginalized epistemic communities from the imagination and creation of AI

    Study of the impact of social learning and gamification methodologies on learning results in higher education

    Get PDF
    In this work, as the last step of a longitudinal study of the impact of so- cial learning and gamification methodologies on learning results in higher education, we have recorded the activity in a software platform based on Moodle, especially built for encouraging online participation of the stu- dents to design, carry out and evaluate a set of learning tasks and games, during two consecutive editions of an undergraduate course. Our aim is to confirm the relationships of the patterns of accomplishment of the gam- ified activities and the network structure of the social graphs associated to the online forums with knowledge adquisition and final outcomes. For this purpose we have offered two learning paths, traditional and novel, to our students. We have identified course variables that quantitatively explain the improvements reported when using the innovative methodolo- gies integrated in the course design, and we have applied techniques from the social network analysis (SNA) and the machine learning/deep learn- ing (ML/DL) domains to conduct success/failure classification methods finding that, generally, very good results are obtained when an ensemble approach is used, that is, when we blend the predictions made by different classifiers. The proposed methodology can be used over reduced datasets and variable time windows for having early estimates that allow pedagog- ical interventions. Finally, we have applied other statistical tests to our datasets, that confirm the influence of learning path on learning results

    FORMING ADVERSARIAL EXAMPLE ATTACKS AGAINST DEEP NEURAL NETWORKS WITH REINFORCEMENT LEARNING

    Get PDF
    Deep neural networks (DNN) are producing groundbreaking results in virtually all academic and commercial domains and will serve as the workhorse of future human-machine teams that will modernize the Department of Defense (DOD). As such, leaders will need to trust and rely on these networks, which makes their security a paramount concern. Considerable research has demonstrated that DNNs remain vulnerable to adversarial examples. While many defense schemes have been proposed to counter the equally many attack vectors, none have been successful at securing a DNN from this vulnerability. Novel attacks expose blind spots unique to a network’s defense, indicating the need for a robust and adaptable attack, used to expose these vulnerabilities early in the development phase. We propose a novel reinforcement learning–based attack, Adversarial Reinforcement Learning Agent (ARLA), designed to learn the vulnerabilities of a DNN and generate adversarial examples to exploit them. ARLA was able to significantly degrade the accuracy of five CIFAR-10 DNNs, four of which used a state-of-the-art defense. We compared our method to other state-of-the-art attacks and found evidence that ARLA is an adaptive attack, making it a useful tool for testing the reliability of DNNs before they are deployed within the DOD.Lieutenant Commander, United States NavyApproved for public release. Distribution is unlimited

    Facilitating prosociality through technology: Design to promote digital volunteerism

    Get PDF
    Volunteerism covers many activities involving no financial rewards for volunteers but which contribute to the common good. There is existing work in designing technology for volunteerism in HumanComputer Interaction (HCI) and related disciplines that focuses on motivation to improve performance, but it does not account for volunteer wellbeing. Here, I investigate digital volunteerism in three case studies with a focus on volunteer motivation, engagement, and wellbeing. My research involved volunteers and others in the volunteering context to generate recommendations for a volunteer-centric design for digital volunteerism. The thesis has three aims: 1. To investigate motivational aspects critical for enhancing digital volunteers’ experiences 2. To identify digital platform attributes linked to volunteer wellbeing 3. To create guidelines for effectively supporting volunteer engagement in digital volunteering platforms In the first case study I investigate the design of a chat widget for volunteers working in an organisation with a view to develop a design that improves their workflow and wellbeing. The second case study investigates the needs, motivations, and wellbeing of volunteers who help medical students improve their medical communication skills. An initial mixed-methods study was followed by an experiment comparing two design strategies to improve volunteer relatedness; an important indicator of wellbeing. The third case study looks into volunteer needs, experiences, motivations, and wellbeing with a focus on volunteer identity and meaning-making on a science-based research platform. I then analyse my findings from these case studies using the lens of care ethics to derive critical insights for design. The key contributions of this thesis are design strategies and critical insights, and a volunteer-centric design framework to enhance the motivation, wellbeing and engagement of digital volunteers
    • …
    corecore