189 research outputs found
Study of Influence on Cohesive Deposits Incipient Motion and Erosion by Dry Bulk Density
Source: ICHE Conference Archive - https://mdi-de.baw.de/icheArchiv
The Uncertainty of Roughness and Its Influence on Dynamic Response and Performance of Canal System
Source: ICHE Conference Archive - https://mdi-de.baw.de/icheArchiv
DST-Adapter: Disentangled-and-Deformable Spatio-Temporal Adapter for Few-shot Action Recognition
Adapting large pre-trained image models to few-shot action recognition has
proven to be an effective and efficient strategy for learning robust feature
extractors, which is essential for few-shot learning. Typical fine-tuning based
adaptation paradigm is prone to overfitting in the few-shot learning scenarios
and offers little modeling flexibility for learning temporal features in video
data. In this work we present the Disentangled-and-Deformable Spatio-Temporal
Adapter (DST-Adapter), which is a novel adapter tuning framework
well-suited for few-shot action recognition due to lightweight design and low
parameter-learning overhead. It is designed in a dual-pathway architecture to
encode spatial and temporal features in a disentangled manner. In particular,
we devise the anisotropic Deformable Spatio-Temporal Attention module as the
core component of DST-Adapter, which can be tailored with anisotropic
sampling densities along spatial and temporal domains to learn spatial and
temporal features specifically in corresponding pathways, allowing our
DST-Adapter to encode features in a global view in 3D spatio-temporal space
while maintaining a lightweight design. Extensive experiments with
instantiations of our method on both pre-trained ResNet and ViT demonstrate the
superiority of our method over state-of-the-art methods for few-shot action
recognition. Our method is particularly well-suited to challenging scenarios
where temporal dynamics are critical for action recognition
- …