Large-Scale Mapping of Human Activity using Geo-Tagged Videos

This paper is the first work to perform spatio-temporal mapping of human activity using the visual content of geo-tagged videos. We utilize a recent deep-learning based video analysis framework, termed hidden two-stream networks, to recognize a range of activities in YouTube videos. This framework is efficient and can run in real time or faster which is important for recognizing events as they occur in streaming video or for reducing latency in analyzing already captured video. This is, in turn, important for using video in smart-city applications. We perform a series of experiments to show our approach is able to accurately map activities both spatially and temporally. We also demonstrate the advantages of using the visual content over the tags/titles.Comment: Accepted at ACM SIGSPATIAL 201

Video spatio-temporal filtering based on cameras and target objects trajectories - Videosurveillance forensic framework

International audienceThis paper presents our work about assisting video-surveillance agents in the search for particular video scenes of interest in transit network. This work has been developed based on requirements defined within different projects with the French National Police in a forensic goal. The video-surveillance agent inputs a query in the form of a hybrid trajectory (date, time, locations expressed with regards to different reference systems) and potentially some visual descriptions of the scene. The query processing starts with the interpretation of the hybrid trajectory and continues with a selection of a set of cameras likely to have filmed the spatial trajectory. The main contributions of this paper are: (1) a definition of the hybrid trajectory query concept, trajectory that is constituted of geometrical and symbolic segments represented with regards to different reference systems (e.g., Geodesic system, road network), (2) a spatio-temporal filtering framework based on a spatio-temporal modeling of the transit network and associated cameras

Mobile objects and sensors within a video surveillance system: Spatio-temporal model and queries

International audienceThe videos recorded by video surveillance systems represent a key element in a police inquiry. Based on a spatio-temporal query specified by a victim, (e.g., the trajectory of the victim before and after the aggression) the human operators select the cameras that could contain relevant information and analyse the corresponding video contents. This task becomes cumbersome because of the huge volume of video contents and the cameras' mobility. This paper presents an approach, which assists the operator in his task and reduces the research space. We propose to model the cameras' network (fixed and mobile cameras) on top of the city's transportation network. We consider the video surveillance system as a multilayer geographic information system, where the cameras are situated into a distinct layer, which is added on top of the other layers (e.g., roads, transport) and is related to them by the location. The model is implemented in a spatio-temporal database. Our final goal is that based on a spatio-temporal query to automatically extract the list of cameras (fixed and mobile) concerned by the query. We propose to include this automatically computed relative position of the cameras as an extension of the standard ISO 22311

Digital Government: Knowledge Management Over Time-Varying Geospatial Datasets

Spatially-related data is collected by many government agencies in various formats and for various uses. This project seeks to facilitate the integration of these data, thus providing new uses. This will require the development of a knowledge management framework to provide syntax, context, and semantics, as well as exploring the introduction of time-varying data into the framework. Education and outreach will be part of the project through the development of an on-line short courses related to data integration in the area of geographical information systems. The grantees will be working with government partners (National Imagery and Mapping Agency, the National Agricultural Statistics Service, and the US Army Topographic Engineering Center), as well as an industrial organization, Base Systems, and the non-profit OpenGIS Consortium, which works closely with vendors of GIS products

A study on Analysis and Utilization of Crowd-sourced Spatio-temporal Contexts from Social Media

兵庫県立大学大学院201