194 research outputs found
Temporal Sentence Grounding in Streaming Videos
This paper aims to tackle a novel task - Temporal Sentence Grounding in
Streaming Videos (TSGSV). The goal of TSGSV is to evaluate the relevance
between a video stream and a given sentence query. Unlike regular videos,
streaming videos are acquired continuously from a particular source, and are
always desired to be processed on-the-fly in many applications such as
surveillance and live-stream analysis. Thus, TSGSV is challenging since it
requires the model to infer without future frames and process long historical
frames effectively, which is untouched in the early methods. To specifically
address the above challenges, we propose two novel methods: (1) a TwinNet
structure that enables the model to learn about upcoming events; and (2) a
language-guided feature compressor that eliminates redundant visual frames and
reinforces the frames that are relevant to the query. We conduct extensive
experiments using ActivityNet Captions, TACoS, and MAD datasets. The results
demonstrate the superiority of our proposed methods. A systematic ablation
study also confirms their effectiveness.Comment: Accepted by ACM MM 202
Recommended from our members
High sensitivity micro-fiber Mach-Zehnder interferometric temperature sensors with a high index ring layer
The influence of the high index ring layer (HIRL) in a tapered fiber Mach-Zehnder interferometer (MZI) on the interference observed, and thus on its potential applications in temperature sensing, has been investigated. The MZI was comprised of a tapered Ring Core Fiber (RCF), spliced between two single mode fibers (SMF). Since part of core mode from the SMF was converted into cladding modes in the RCF, due to the mismatch in the cores between the RCF and SMF, the residual power enters and then propagates along the center of the RCF (silica). The difference in phase between the radiation travelling along these different paths is separated by the HIRL to generate an interference effect. Compared with fiber interferometers based on core and cladding mode interference, the thin fiber HIRL is capable of separating the high order cladding modes and the silica core mode, under grazing incident conditions. Therefore, the optical path difference (OPD) and the sensitivity are both substantially improved over what is seen in conventional devices, showing their potential for interferometric temperature sensor applications. The optimum temperature sensitivity obtained was 186.6 pm/°C, which is ∼ 11.7 times higher than has been reported previously
Photoinduced coupled twisted intramolecular charge transfer and excited-state proton transfer via intermolecular hydrogen bonding: a DFT/TD-DFT study
We discuss theoretically the geometric and electronic structure properties of the thiazolidinedione derivative A and its hydrogen-bonded complex in dimethylformamide (DMF) solution in the S0 and S1 states. To gain insight into the photoinduced coupled excited-state proton transfer (ESPT) and twisted intramolecular charge transfer (TICT) associated with intermolecular hydrogen bonding, the potential energy profiles are provided along the Osingle bondH bond and the twisted angle. It is predicted that TICT in S1 can facilitate ESPT initiated by intermolecular hydrogen-bond strengthening in the S1 state. The coupling of ESPT and TICT is energetically preferable
Recommended from our members
Helium/oxygen atmospheric pressure plasma jet treatment for hydrophilicity improvement of grey cotton knitted fabric
The influence of atmospheric pressure plasma jet (APPJ) treatment on the hydrophilicity of grey cotton knitted fabric (GCKF) was investigated. For comparison, specimens which had undergone different treatments were tested by contact angle measurement, scanning electron microscopy (SEM), X-ray photoelectron spectroscopy (XPS), fourier-transform infrared attenuated total reflectance spectroscopy (FTIR-ATR) and X-ray diffraction (XRD). The results imply that helium/oxygen APPJ could improve the hydrophilicity of GCKF by modifying the surface properties. In addition, combining dewaxing processes with He/O2 APPJ treatment was found to tremendously improve the hydrophilicity of GCKF. The mechanism of this was also confirmed by Ruthenium Red staining which showed most of pectic substances inside the cotton fiber existed beneath the waxy layer and on top of the cellulose microfibril
- …