19,344 research outputs found
Multimodal Grounding for Language Processing
This survey discusses how recent developments in multimodal processing
facilitate conceptual grounding of language. We categorize the information flow
in multimodal processing with respect to cognitive models of human information
processing and analyze different methods for combining multimodal
representations. Based on this methodological inventory, we discuss the benefit
of multimodal grounding for a variety of language processing tasks and the
challenges that arise. We particularly focus on multimodal grounding of verbs
which play a crucial role for the compositional power of language.Comment: The paper has been published in the Proceedings of the 27 Conference
of Computational Linguistics. Please refer to this version for citations:
https://www.aclweb.org/anthology/papers/C/C18/C18-1197
Multi-Sensor Context-Awareness in Mobile Devices and Smart Artefacts
The use of context in mobile devices is receiving increasing attention in mobile and ubiquitous computing research. In this article we consider how to augment mobile devices with awareness of their environment and situation as context. Most work to date has been based on integration of generic context sensors, in particular for location and visual context. We propose a different approach based on integration of multiple diverse sensors for awareness of situational context that can not be inferred from location, and targeted at mobile device platforms that typically do not permit processing of visual context. We have investigated multi-sensor context-awareness in a series of projects, and report experience from development of a number of device prototypes. These include development of an awareness module for augmentation of a mobile phone, of the Mediacup exemplifying context-enabled everyday artifacts, and of the Smart-Its platform for aware mobile devices. The prototypes have been explored in various applications to validate the multi-sensor approach to awareness, and to develop new perspectives of how embedded context-awareness can be applied in mobile and ubiquitous computing
Sonification of Network Traffic Flow for Monitoring and Situational Awareness
Maintaining situational awareness of what is happening within a network is
challenging, not least because the behaviour happens within computers and
communications networks, but also because data traffic speeds and volumes are
beyond human ability to process. Visualisation is widely used to present
information about the dynamics of network traffic dynamics. Although it
provides operators with an overall view and specific information about
particular traffic or attacks on the network, it often fails to represent the
events in an understandable way. Visualisations require visual attention and so
are not well suited to continuous monitoring scenarios in which network
administrators must carry out other tasks. Situational awareness is critical
and essential for decision-making in the domain of computer network monitoring
where it is vital to be able to identify and recognize network environment
behaviours.Here we present SoNSTAR (Sonification of Networks for SiTuational
AwaReness), a real-time sonification system to be used in the monitoring of
computer networks to support the situational awareness of network
administrators. SoNSTAR provides an auditory representation of all the TCP/IP
protocol traffic within a network based on the different traffic flows between
between network hosts. SoNSTAR raises situational awareness levels for computer
network defence by allowing operators to achieve better understanding and
performance while imposing less workload compared to visual techniques. SoNSTAR
identifies the features of network traffic flows by inspecting the status flags
of TCP/IP packet headers and mapping traffic events to recorded sounds to
generate a soundscape representing the real-time status of the network traffic
environment. Listening to the soundscape allows the administrator to recognise
anomalous behaviour quickly and without having to continuously watch a computer
screen.Comment: 17 pages, 7 figures plus supplemental material in Github repositor
A multi-INT semantic reasoning framework for intelligence analysis support
Lockheed Martin Corp. has funded research to generate a framework
and methodology for developing semantic reasoning applications to support the
discipline oflntelligence Analysis. This chapter outlines that framework, discusses
how it may be used to advance the information sharing and integrated analytic
needs of the Intelligence Community, and suggests a system I software
architecture for such applications
Mixed Initiative Systems for Human-Swarm Interaction: Opportunities and Challenges
Human-swarm interaction (HSI) involves a number of human factors impacting
human behaviour throughout the interaction. As the technologies used within HSI
advance, it is more tempting to increase the level of swarm autonomy within the
interaction to reduce the workload on humans. Yet, the prospective negative
effects of high levels of autonomy on human situational awareness can hinder
this process. Flexible autonomy aims at trading-off these effects by changing
the level of autonomy within the interaction when required; with
mixed-initiatives combining human preferences and automation's recommendations
to select an appropriate level of autonomy at a certain point of time. However,
the effective implementation of mixed-initiative systems raises fundamental
questions on how to combine human preferences and automation recommendations,
how to realise the selected level of autonomy, and what the future impacts on
the cognitive states of a human are. We explore open challenges that hamper the
process of developing effective flexible autonomy. We then highlight the
potential benefits of using system modelling techniques in HSI by illustrating
how they provide HSI designers with an opportunity to evaluate different
strategies for assessing the state of the mission and for adapting the level of
autonomy within the interaction to maximise mission success metrics.Comment: Author version, accepted at the 2018 IEEE Annual Systems Modelling
Conference, Canberra, Australi
Using Semantic Web Technologies to Support Enhanced Situation Awareness
The AKTiveSA project is using Semantic Web technologies to support information fusion and enhanced situational awareness in a simulated humanitarian relief scenario. We have developed an application that shows how situational awareness can be supported during humanitarian relief situations; often occurring alongside military conflict. Semantic Web technologies provide new opportunities for harvesting information from numerous, disparate and often heterogeneous information sources and can be used to better support complex knowledge fusion
Assessing the Human Factor in Truck Driving
Human factors assessment techniques are commonly applied to a variety of workplaces
to examine the nature of operations and how key functions are controlled operationally;
however, these tools appear to overlook key aspects of truck driving, particularly
the driver’s relationship to the driving experience. The fundamental issue is with
the ability to completely decompose truck driving and accurately document the truck
drivers working environment will be problematic. Therefore, to demonstrate how a truck
driver moves between each series of sub-tasks will require a purpose-built assessment
tool that that is both practical and relevant to truck driving
The Space Object Ontology
Achieving space domain awareness requires the
identification, characterization, and tracking of space objects.
Storing and leveraging associated space object data for purposes
such as hostile threat assessment, object identification, and
collision prediction and avoidance present further challenges.
Space objects are characterized according to a variety of
parameters including their identifiers, design specifications,
components, subsystems, capabilities, vulnerabilities, origins,
missions, orbital elements, patterns of life, processes, operational
statuses, and associated persons, organizations, or nations. The
Space Object Ontology provides a consensus-based realist
framework for formulating such characterizations in a
computable fashion. Space object data are aligned with classes
and relations in the Space Object Ontology and stored in a
dynamically updated Resource Description Framework triple
store, which can be queried to support space domain awareness
and the needs of spacecraft operators. This paper presents the
core of the Space Object Ontology, discusses its advantages over
other approaches to space object classification, and demonstrates
its ability to combine diverse sets of data from multiple sources
within an expandable framework. Finally, we show how the
ontology provides benefits for enhancing and maintaining longterm
space domain awareness
First impressions: A survey on vision-based apparent personality trait analysis
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Personality analysis has been widely studied in psychology, neuropsychology, and signal processing fields, among others. From the past few years, it also became an attractive research area in visual computing. From the computational point of view, by far speech and text have been the most considered cues of information for analyzing personality. However, recently there has been an increasing interest from the computer vision community in analyzing personality from visual data. Recent computer vision approaches are able to accurately analyze human faces, body postures and behaviors, and use these information to infer apparent personality traits. Because of the overwhelming research interest in this topic, and of the potential impact that this sort of methods could have in society, we present in this paper an up-to-date review of existing vision-based approaches for apparent personality trait recognition. We describe seminal and cutting edge works on the subject, discussing and comparing their distinctive features and limitations. Future venues of research in the field are identified and discussed. Furthermore, aspects on the subjectivity in data labeling/evaluation, as well as current datasets and challenges organized to push the research on the field are reviewed.Peer ReviewedPostprint (author's final draft
- …