Using Sensor Metadata Streams to Identify Topics of Local Events in the City

In this paper, we study the emerging Information Retrieval (IR) task of local event retrieval using sensor metadata streams. Sensor metadata streams include information such as the crowd density from video processing, audio classifications, and social media activity. We propose to use these metadata streams to identify the topics of local events within a city, where each event topic corresponds to a set of terms representing a type of events such as a concert or a protest. We develop a supervised approach that is capable of mapping sensor metadata observations to an event topic. In addition to using a variety of sensor metadata observations about the current status of the environment as learning features, our approach incorporates additional background features to model cyclic event patterns. Through experimentation with data collected from two locations in a major Spanish city, we show that our approach markedly outperforms an alternative baseline. We also show that modelling background information improves event topic identification

Temporal Localization of Fine-Grained Actions in Videos by Domain Transfer from Web Images

We address the problem of fine-grained action localization from temporally untrimmed web videos. We assume that only weak video-level annotations are available for training. The goal is to use these weak labels to identify temporal segments corresponding to the actions, and learn models that generalize to unconstrained web videos. We find that web images queried by action names serve as well-localized highlights for many actions, but are noisily labeled. To solve this problem, we propose a simple yet effective method that takes weak video labels and noisy image labels as input, and generates localized action frames as output. This is achieved by cross-domain transfer between video frames and web images, using pre-trained deep convolutional neural networks. We then use the localized action frames to train action recognition models with long short-term memory networks. We collect a fine-grained sports action data set FGA-240 of more than 130,000 YouTube videos. It has 240 fine-grained actions under 85 sports activities. Convincing results are shown on the FGA-240 data set, as well as the THUMOS 2014 localization data set with untrimmed training videos.Comment: Camera ready version for ACM Multimedia 201

The Adsorption of Atomic Nitrogen on Ru(0001): Geometry and Energetics

The local adsorption geometries of the (2x2)-N and the (sqrt(3)x sqrt(3))R30^o -N phases on the Ru(0001) surface are determined by analyzing low-energy electron diffraction (LEED) intensity data. For both phases, nitrogen occupies the threefold hcp site. The nitrogen sinks deeply into the top Ru layer resulting in a N-Ru interlayer distance of 1.05 AA and 1.10 AA in the (2x2) and the (sqrt(3)x sqrt(3))R30^o unit cell, respectively. This result is attributed to a strong N binding to the Ru surface (Ru--N bond length = 1.93 AA) in both phases as also evidenced by ab-initio calculations which revealed binding energies of 5.82 eV and 5.59 eV, respectively.Comment: 17 pages, 5 figures. Submitted to Chem. Phys. Lett. (October 10, 1996

Automatic summarization of rushes video using bipartite graphs

In this paper we present a new approach for automatic summarization of rushes, or unstructured video. Our approach is composed of three major steps. First, based on shot and sub-shot segmentations, we filter sub-shots with low information content not likely to be useful in a summary. Second, a method using maximal matching in a bipartite graph is adapted to measure similarity between the remaining shots and to minimize inter-shot redundancy by removing repetitive retake shots common in rushes video. Finally, the presence of faces and motion intensity are characterised in each sub-shot. A measure of how representative the sub-shot is in the context of the overall video is then proposed. Video summaries composed of keyframe slideshows are then generated. In order to evaluate the effectiveness of this approach we re-run the evaluation carried out by TRECVid, using the same dataset and evaluation metrics used in the TRECVid video summarization task in 2007 but with our own assessors. Results show that our approach leads to a significant improvement on our own work in terms of the fraction of the TRECVid summary ground truth included and is competitive with the best of other approaches in TRECVid 2007

High-level feature detection from video in TRECVid: a 5-year retrospective of achievements

Successful and effective content-based access to digital video requires fast, accurate and scalable methods to determine the video content automatically. A variety of contemporary approaches to this rely on text taken from speech within the video, or on matching one video frame against others using low-level characteristics like colour, texture, or shapes, or on determining and matching objects appearing within the video. Possibly the most important technique, however, is one which determines the presence or absence of a high-level or semantic feature, within a video clip or shot. By utilizing dozens, hundreds or even thousands of such semantic features we can support many kinds of content-based video navigation. Critically however, this depends on being able to determine whether each feature is or is not present in a video clip. The last 5 years have seen much progress in the development of techniques to determine the presence of semantic features within video. This progress can be tracked in the annual TRECVid benchmarking activity where dozens of research groups measure the effectiveness of their techniques on common data and using an open, metrics-based approach. In this chapter we summarise the work done on the TRECVid high-level feature task, showing the progress made year-on-year. This provides a fairly comprehensive statement on where the state-of-the-art is regarding this important task, not just for one research group or for one approach, but across the spectrum. We then use this past and on-going work as a basis for highlighting the trends that are emerging in this area, and the questions which remain to be addressed before we can achieve large-scale, fast and reliable high-level feature detection on video

Oxygen adsorption on the Ru (10 bar 1 0) surface: Anomalous coverage dependence

Oxygen adsorption onto Ru (10 bar 1 0) results in the formation of two ordered overlayers, i.e. a c(2 times 4)-2O and a (2 times 1)pg-2O phase, which were analyzed by low-energy electron diffraction (LEED) and density functional theory (DFT) calculation. In addition, the vibrational properties of these overlayers were studied by high-resolution electron loss spectroscopy. In both phases, oxygen occupies the threefold coordinated hcp site along the densely packed rows on an otherwise unreconstructed surface, i.e. the O atoms are attached to two atoms in the first Ru layer Ru(1) and to one Ru atom in the second layer Ru(2), forming zigzag chains along the troughs. While in the low-coverage c(2 times 4)-O phase, the bond lengths of O to Ru(1) and Ru(2) are 2.08 A and 2.03 A, respectively, corresponding bond lengths in the high-coverage (2 times 1)-2O phase are 2.01 A and 2.04 A (LEED). Although the adsorption energy decreases by 220 meV with O coverage (DFT calculations), we observe experimentally a shortening of the Ru(1)-O bond length with O coverage. This effect could not be reconciled with the present DFT-GGA calculations. The nu(Ru-O) stretch mode is found at 67 meV [c(2 times 4)-2O] and 64 meV [(2 times 1)pg-2O].Comment: 10 pages, figures are available as hardcopies on request by mailing [email protected], submitted to Phys. Rev. B (8. Aug. 97), other related publications can be found at http://www.rz-berlin.mpg.de/th/paper.htm

Structural investigation of the Rh(110)-c(2x2)-CN phase

The Rh(110)-c(2x2)-CN phase has been examined by means of scanning tunneling microscopy (STM) and full dynamical low-energy electron diffraction (LEED). From STM large c(2x2) domains are observed. The detailed LEED-IV structural analysis indicates that CN is located in the grooves of the (110) surface, approximately atop second layer rhodium atoms. The CN molecules lie almost flat with their bond axes oriented perpendicular to the rhodium troughs. An outward relaxation of the first substrate interlayer distance and a strong buckling of the second Rh layer are induced by CN adsorption. Calculated and experimental intensity curves are in good agreement. An exhaustive set of other possible adsorption sites and configurations was tested and excluded on the basis of reliability-factor analysis

Metastable precursors during the oxidation of the Ru(0001) surface

Using density-functional theory, we predict that the oxidation of the Ru(0001) surface proceeds via the accumulation of sub-surface oxygen in two-dimensional islands between the first and second substrate layer. This leads locally to a decoupling of an O-Ru-O trilayer from the underlying metal. Continued oxidation results in the formation and stacking of more of these trilayers, which unfold into the RuO_2(110) rutile structure once a critical film thickness is exceeded. Along this oxidation pathway, we identify various metastable configurations. These are found to be rather close in energy, indicating a likely lively dynamics between them at elevated temperatures, which will affect the surface chemical and mechanical properties of the material.Comment: 11 pages including 9 figures. Submitted to Phys. Rev. B. Related publications can be found at http://www.fhi-berlin.mpg.de/th/paper.htm

Composition, structure and stability of RuO_2(110) as a function of oxygen pressure

Using density-functional theory (DFT) we calculate the Gibbs free energy to determine the lowest-energy structure of a RuO_2(110) surface in thermodynamic equilibrium with an oxygen-rich environment. The traditionally assumed stoichiometric termination is only found to be favorable at low oxygen chemical potentials, i.e. low pressures and/or high temperatures. At realistic O pressure, the surface is predicted to contain additional terminal O atoms. Although this O excess defines a so-called polar surface, we show that the prevalent ionic model, that dismisses such terminations on electrostatic grounds, is of little validity for RuO_2(110). Together with analogous results obtained previously at the (0001) surface of corundum-structured oxides, these findings on (110) rutile indicate that the stability of non-stoichiometric terminations is a more general phenomenon on transition metal oxide surfaces.Comment: 12 pages including 5 figures. Submitted to Phys. Rev. B. Related publications can be found at http://www.fhi-berlin.mpg.de/th/paper.htm

Theoretical study of O adlayers on Ru(0001)

Recent experiments performed at high pressures indicate that ruthenium can support unusually high concentrations of oxygen at the surface. To investigate the structure and stability of high coverage oxygen structures, we performed density functional theory calculations, within the generalized gradient approximation, for O adlayers on Ru(0001) from low coverage up to a full monolayer. We achieve quantitative agreement with previous low energy electron diffraction intensity analyses for the (2x2) and (2x1) phases and predict that an O adlayer with a (1x1) periodicity and coverage of 1 monolayer can form on Ru(0001), where the O adatoms occupy hcp-hollow sites.Comment: RevTeX, 6 pages, 4 figure