194 research outputs found

    Temporal Sentence Grounding in Streaming Videos

    Full text link
    This paper aims to tackle a novel task - Temporal Sentence Grounding in Streaming Videos (TSGSV). The goal of TSGSV is to evaluate the relevance between a video stream and a given sentence query. Unlike regular videos, streaming videos are acquired continuously from a particular source, and are always desired to be processed on-the-fly in many applications such as surveillance and live-stream analysis. Thus, TSGSV is challenging since it requires the model to infer without future frames and process long historical frames effectively, which is untouched in the early methods. To specifically address the above challenges, we propose two novel methods: (1) a TwinNet structure that enables the model to learn about upcoming events; and (2) a language-guided feature compressor that eliminates redundant visual frames and reinforces the frames that are relevant to the query. We conduct extensive experiments using ActivityNet Captions, TACoS, and MAD datasets. The results demonstrate the superiority of our proposed methods. A systematic ablation study also confirms their effectiveness.Comment: Accepted by ACM MM 202

    Photoinduced coupled twisted intramolecular charge transfer and excited-state proton transfer via intermolecular hydrogen bonding: a DFT/TD-DFT study

    Get PDF
    We discuss theoretically the geometric and electronic structure properties of the thiazolidinedione derivative A and its hydrogen-bonded complex in dimethylformamide (DMF) solution in the S0 and S1 states. To gain insight into the photoinduced coupled excited-state proton transfer (ESPT) and twisted intramolecular charge transfer (TICT) associated with intermolecular hydrogen bonding, the potential energy profiles are provided along the Osingle bondH bond and the twisted angle. It is predicted that TICT in S1 can facilitate ESPT initiated by intermolecular hydrogen-bond strengthening in the S1 state. The coupling of ESPT and TICT is energetically preferable
    • …
    corecore