Visualizing threat and impact assessment to improve situation awareness

Situation awareness comes from combined knowledge of the environment, friendly actions and adversaries\u27 actions. Impact assessment applies that knowledge to determine the consequences of those actions on specific missions and assets. In domains such as asymmetric warfare and cyber security, impact assessment is critical to provide timely and comprehensive situation awareness. An analyst needs to be able to quickly and accurately assess a situation, see the factors affecting important assets, and come to a conclusion on what the best course of actions are to take. Many attempts have been made to visualize a situation from observed raw data for better awareness. However none have attempted to visualize the impact and threat of observed actions on assets and missions. This thesis investigates critical visual elements that will enhance situation awareness. Our approach leverages results of threat and impact assessment of ongoing situations. These include changes in effects on assets and missions by activities, and the projection of current situations into the future. This set of information is strategically placed and displayed to facilitate analysts to perform forensic and real-time analysis. While other visualization tools have focused on achieving situational awareness through representing raw data in a meaningful way, this visualization attempts to enhance situational awareness though situational assessment

Localization Services for Online Common Operational Picture and Situation Awareness

Many operations, be they military, police, rescue, or other field operations, require localization services and online situation awareness to make them effective. Questions such as how many people are inside a building and their locations are essential. In this paper, an online localization and situation awareness system is presented, called Mobile Urban Situation Awareness System (MUSAS), for gathering and maintaining localization information, to form a common operational picture. The MUSAS provides multiple localization services, as well as visualization of other sensor data, in a common frame of reference. The information and common operational picture of the system is conveyed to all parties involved in the operation, the field team, and people in the command post. In this paper, a general system architecture for enabling localization based situation awareness is designed and the MUSAS system solution is presented. The developed subsystem components and forming of the common operational picture are summarized, and the future potential of the system for various scenarios is discussed. In the demonstration, the MUSAS is deployed to an unknown building, in an ad hoc fashion, to provide situation awareness in an urban indoor military operation.Peer reviewe

Using visual analytics to develop situation awareness in astrophysics

We present a novel collaborative visual analytics application for cognitively overloaded users in the astrophysics domain. The system was developed for scientists who need to analyze heterogeneous, complex data under time pressure, and make predictions and time-critical decisions rapidly and correctly under a constant influx of changing data. The Sunfall Data Taking system utilizes several novel visualization and analysis techniques to enable a team of geographically distributed domain specialists to effectively and remotely maneuver a custom-built instrument under challenging operational conditions. Sunfall Data Taking has been in production use for 2 years by a major international astrophysics collaboration (the largest data volume supernova search currently in operation), and has substantially improved the operational efficiency of its users. We describe the system design process by an interdisciplinary team, the system architecture and the results of an informal usability evaluation of the production system by domain experts in the context of Endsley's three levels of situation awareness

Interactive Information Visualization for Sensemaking in Power Grid Supervisory Systems

Operators of power grid supervisory control systems have to gather information from a wide variety of views to build situation awareness. Findings from a conducted field study show that this task is challenging and cogni-tively demanding. Visualization research for power grid supervisory control systems has focused on developing new visualization techniques for representing one aspect of the power system data. Little work has been done to demon-strate how information visualization techniques can sup-port the operator in the sensemaking process to achieve situation awareness. To fill this gap, and with support from a field study, we propose solutions based on multiple and coordinated views, visual interactive filtering and parallel coordinates

Human-centered visualization technologies for patient monitoring are the future: a narrative review

Medical technology innovation has improved patient monitoring in perioperative and intensive care medicine and continuous improvement in the technology is now a central focus in this field. Because data density increases with the number of parameters captured by patient-monitoring devices, its interpretation has become more challenging. Therefore, it is necessary to support clinicians in managing information overload while improving their awareness and understanding about the patient’s health status. Patient monitoring has almost exclusively operated on the single-sensor–single-indicator principle—a technology-centered way of presenting data in which specific parameters are measured and displayed individually as separate numbers and waves. An alternative is user-centered medical visualization technology, which integrates multiple pieces of information (e.g., vital signs), derived from multiple sensors into a single indicator—an avatar-based visualization—that is a meaningful representation of the real-world situation. Data are presented as changing shapes, colors, and animation frequencies, which can be perceived, integrated, and interpreted much more efficiently than other formats (e.g., numbers). The beneficial effects of these technologies have been confirmed in computer-based simulation studies; visualization technologies improved clinicians’ situation awareness by helping them effectively perceive and verbalize the underlying medical issue, while improving diagnostic confidence and reducing workload. This review presents an overview of the scientific results and the evidence for the validity of these technologies

Enhancing travel experience with the combination of information visualization, situation awareness, and distributed cognition

With the new forms of travel introduced by new technologies of transportation and communication, a satisfied travel experience could be affected by various factors before and during a trip. Especially for road trips, traveling by car provides freedom on time control while leading to more possibilities of rescheduling initial plans made under time constraints. When overwhelmed with the need for changed travel context to avoid unexpected events that will require a serious change of initial plans, travelers need to find and access helpful contextual information quickly. This is a context-related decision making process that requires amplifying human situation awareness and supporting distributed cognition, since travel information offers multiple choices. To solve this problem, I applied information visualization as the main design solution. When comparing it with a traditional representation of lists, information visualization displays the advantages of visual representation of abstract data to clarify and depict the information and amplify cognition while improving travel experience intuitively in the domain of user experience design. Therefore in this thesis I will address the approach of implementing recontextualized situation awareness, distributed cognition, and information visualization in a travel-aid system. By using both theoretical and practical design perspectives, I will discuss how to enhance travel experience with represented contextual information that users desire or expect before and during a road trip. I will also explore the new values of this design with strategic business support. Additionally, after conducting research and analysis on existing interaction design parts, I selected a smartphone app to serve as a proper platform with connected multifunctions. Briefly, I begin the thesis with a review of previous theories and aspects of travel planning, information visualization as it relates to travel, situation awareness, and distributed cognition in the design context and related smartphone apps. Then I discuss the process of identifying the specific issues to be solved or improved with a preliminary research of empirical study, followed by an interview, online survey, insights synthesis, and business model design. After a visual-system design was developed, heuristic evaluation was employed to assess the outcome. Lastly, a new round of refined design results is introduced based on outcomes of the evaluation

Mission Impact Analysis Visualization for Enhanced Situational Awareness

This research effort examines the creation of mission impact analysis visualizations to enhance situational awareness. It focuses on using prefuse to create a visualization that allows the user to quickly understand the impact of the failure of any element needed directly or indirectly for a mission. The visualization correctly identifies the direct or indirect impact on physical requirements such as network links and servers as well as non-physical elements such as the generation of a report, or ability to perform a task. The visualization provides an overview of the situation, as well as including enhancements to allow for greater detail on any element to be viewed. The result of this research is the foundation for a tool to allow commanders and others, at a glance, to understand the scope of mission impact when an outage occurs

SoK: Contemporary Issues and Challenges to Enable Cyber Situational Awareness for Network Security

Cyber situational awareness is an essential part of cyber defense that allows the cybersecurity operators to cope with the complexity of today's networks and threat landscape. Perceiving and comprehending the situation allow the operator to project upcoming events and make strategic decisions. In this paper, we recapitulate the fundamentals of cyber situational awareness and highlight its unique characteristics in comparison to generic situational awareness known from other fields. Subsequently, we provide an overview of existing research and trends in publishing on the topic, introduce front research groups, and highlight the impact of cyber situational awareness research. Further, we propose an updated taxonomy and enumeration of the components used for achieving cyber situational awareness. The updated taxonomy conforms to the widely-accepted three-level definition of cyber situational awareness and newly includes the projection level. Finally, we identify and discuss contemporary research and operational challenges, such as the need to cope with rising volume, velocity, and variety of cybersecurity data and the need to provide cybersecurity operators with the right data at the right time and increase their value through visualization

Giving meaning to tweets in emergency situations: a semantic approach for filtering and visualizing social data

In this paper, we propose a semantic approach for monitoring information publishedon social networks about a specific event. In the era of Big Data, when an emergencyoccurs information posted on social networks becomes more and more helpful foremergency operators. As direct witnesses of the situation, people share photos, videosor text messages about events that call their attention. In the emergency operationcenter, these data can be collected and integrated within the management processto improve the overall understanding of the situation and in particular of the citizenreactions. To support the tracking and analyzing of social network activities, there arealready monitoring tools that combine visualization techniques with geographicalmaps. However, tweets are written from the perspective of citizens and the informationthey provide might be inaccurate, irrelevant or false. Our approach tries to dealwith data relevance proposing an innovative ontology-based method for filteringtweets and extracting meaningful topics depending on their semantic content. In thisway data become relevant for the operators to make decisions. Two real cases used totest its applicability showed that different visualization techniques might be neededto support situation awareness. This ontology-based approach can be generalizedfor analyzing the information flow about other domains of application changing theunderlying knowledge base.This work is supported by the project emerCien grant funded by the Spanish Ministry of Economy and Competitivity (TIN2012-09687)