Directly depicting granular ontologies

Published in extended form as "Endurants and Perdurants in Directly Depicting Ontologies", We propose an ontological theory that is powerful enough to describe both complex spatio-temporal processes and the enduring entities that participate in such processes. For this purpose we distinguish between ontologies and metaontology. Ontologies are based on very simple directly depicting languages and fall into two major categories: ontologies of type SPAN and ontologies of type SNAP. These represent two complementary perspectives on reality and result in distinct though compatible systems of categories. In a SNAP (snapshot) ontology we have the enduring entities in a given domain as they exist to be inventoried at some given moment of time. In a SPAN ontology we have perduring entities such as processes and their parts and aggregates. We argue that both kinds of ontology are required, together with the meta-ontology which joins them together. On the level of meta-ontology we are able to impose constraints on ontologies of a sort which can support efficient processing of large amounts of data

Video Question Answering: Datasets, Algorithms and Challenges

Video Question Answering (VideoQA) aims to answer natural language questions according to the given videos. It has earned increasing attention with recent research trends in joint vision and language understanding. Yet, compared with ImageQA, VideoQA is largely underexplored and progresses slowly. Although different algorithms have continually been proposed and shown success on different VideoQA datasets, we find that there lacks a meaningful survey to categorize them, which seriously impedes its advancements. This paper thus provides a clear taxonomy and comprehensive analyses to VideoQA, focusing on the datasets, algorithms, and unique challenges. We then point out the research trend of studying beyond factoid QA to inference QA towards the cognition of video contents, Finally, we conclude some promising directions for future exploration.Comment: Accepted by EMNLP 202

Endurants and Perdurants in Directly Depicting Ontologies

We propose an ontological theory that is powerful enough to describe both complex spatio-temporal processes and the enduring entities that participate therein. For this purpose we introduce the notion a directly depicting ontology. Directly depicting ontologies are based on relatively simple languages and fall into two major categories: ontologies of type SPAN and ontologies of type SNAP. These represent two complementary perspectives on reality and employ distinct though compatible systems of categories. A SNAP (snapshot) ontology comprehends enduring entities such as organisms, geographic features, or qualities as they exist at some given moment of time. A SPAN ontology comprehends perduring entities such as processes and their parts and aggregates as they unfold themselves through some temporal interval. We give an axiomatic account of the theory of directly depicting ontologies and of the core parts of the metaontological fragment within which they are embedded

A unified framework for building ontological theories with application and testing in the field of clinical trials

The objective of this research programme is to contribute to the establishment of the emerging science of Formal Ontology in Information Systems via a collaborative project involving researchers from a range of disciplines including philosophy, logic, computer science, linguistics, and the medical sciences. The re­searchers will work together on the construction of a unified formal ontology, which means: a general framework for the construction of ontological theories in specific domains. The framework will be constructed using the axiomatic-deductive method of modern formal ontology. It will be tested via a series of applications relating to on-going work in Leipzig on medical taxonomies and data dictionaries in the context of clinical trials. This will lead to the production of a domain-specific ontology which is designed to serve as a basis for applications in the medical field

Application of Advanced Early Warning Systems with Adaptive Protection

This project developed and field-tested two methods of Adaptive Protection systems utilizing synchrophasor data. One method detects conditions of system stress that can lead to unintended relay operation, and initiates a supervisory signal to modify relay response in real time to avoid false trips. The second method detects the possibility of false trips of impedance relays as stable system swings “encroach” on the relays’ impedance zones, and produces an early warning so that relay engineers can re-evaluate relay settings. In addition, real-time synchrophasor data produced by this project was used to develop advanced visualization techniques for display of synchrophasor data to utility operators and engineers

Linking Moving Object Databases with Ontologies

This work investigates the supporting role of ontologies for supplementing the information contained in moving object databases. Details of the spatial representation as well as the sensed location of moving objects are frequently stored within a database schema. However, this knowledge lacks the semantic detail necessary for reasoning about characteristics that are specific to each object. Ontologies contribute semantic descriptions for moving objects and provide the foundation for discovering similarities between object types. These similarities can be drawn upon to extract additional details about the objects around us. The primary focus of the research is a framework for linking ontologies with databases. A major benefit gained from this kind of linking is the augmentation of database knowledge and multi-granular perspectives that are provided by ontologies through the process of generalization. Methods are presented for linking based on a military transportation scenario where data on vehicle position is collected from a sensor network and stored in a geosensor database. An ontology linking tool, implemented as a stand alone application, is introduced. This application associates individual values from the geosensor database with classes from a military transportation device ontology and returns linked value-class pairs to the user as a set of equivalence relations (i.e., matches). This research also formalizes a set of motion relations between two moving objects on a road network. It is demonstrated that the positional data collected from a geosensor network and stored in a spatio-temporal database, can provide a foundation for computing relations between moving objects. Configurations of moving objects, based on their spatial position, are described by motion relations that include isBehind and inFrontOf. These relations supply a user context about binary vehicle positions relative to a reference object. For example, the driver of a military supply truck may be interested in knowing what types of vehicles are in front of the truck. The types of objects that participate in these motion relations correspond to particular classes within the military transportation device ontology. This research reveals that linking a geosensor database to the military transportation device ontology will facilitate more abstract or higher-level perspectives of these moving objects, supporting inferences about moving objects over multiple levels of granularity. The details supplied by the generalization of geosensor data via linking, helps to interpret semantics and respond to user questions by extending the preliminary knowledge about the moving objects within these relations

Histogram of Fuzzy Local Spatio-Temporal Descriptors for Video Action Recognition

Feature extraction plays a vital role in visual action recognition. Many existing gradient-based feature extractors, including histogram of oriented gradients (HOG), histogram of optical flow (HOF), motion boundary histograms (MBH), and histogram of motion gradients (HMG), build histograms for representing different actions over the spatio-temporal domain in a video. However, these methods require to set the number of bins for information aggregation in advance. Varying numbers of bins usually lead to inherent uncertainty within the process of pixel voting with regard to the bins in the histogram. This paper proposes a novel method to handle such uncertainty by fuzzifying these feature extractors. The proposed approach has two advantages: i) it better represents the ambiguous boundarie between the bins and thus the fuzziness of th spatio-temporal visual information entailed in videos, and ii) the contribution of each pixel is flexibly controlled by a fuzziness parameter for various scenarios. The proposed family of fuzzy descriptors and a combination of them were evaluate on two publicly available datasets, demonstrating that the proposed approach outperforms the original counterparts and other state-of-the-art methods