93 research outputs found
Frozen CLIP Model is An Efficient Point Cloud Backbone
The pretraining-finetuning paradigm has demonstrated great success in NLP and
2D image fields because of the high-quality representation ability and
transferability of their pretrained models. However, pretraining such a strong
model is difficult in the 3D point cloud field since the training data is
limited and point cloud collection is expensive. This paper introduces
Efficient Point Cloud Learning (EPCL), an effective and efficient point cloud
learner for directly training high-quality point cloud models with a frozen
CLIP model. Our EPCL connects the 2D and 3D modalities by semantically aligning
the 2D features and point cloud features without paired 2D-3D data.
Specifically, the input point cloud is divided into a sequence of tokens and
directly fed into the frozen CLIP model to learn point cloud representation.
Furthermore, we design a task token to narrow the gap between 2D images and 3D
point clouds. Comprehensive experiments on 3D detection, semantic segmentation,
classification and few-shot learning demonstrate that the 2D CLIP model can be
an efficient point cloud backbone and our method achieves state-of-the-art
accuracy on both real-world and synthetic downstream tasks. Code will be
available.Comment: Technical repor
3D Interacting Hand Pose Estimation by Hand De-occlusion and Removal
Estimating 3D interacting hand pose from a single RGB image is essential for
understanding human actions. Unlike most previous works that directly predict
the 3D poses of two interacting hands simultaneously, we propose to decompose
the challenging interacting hand pose estimation task and estimate the pose of
each hand separately. In this way, it is straightforward to take advantage of
the latest research progress on the single-hand pose estimation system.
However, hand pose estimation in interacting scenarios is very challenging, due
to (1) severe hand-hand occlusion and (2) ambiguity caused by the homogeneous
appearance of hands. To tackle these two challenges, we propose a novel Hand
De-occlusion and Removal (HDR) framework to perform hand de-occlusion and
distractor removal. We also propose the first large-scale synthetic amodal hand
dataset, termed Amodal InterHand Dataset (AIH), to facilitate model training
and promote the development of the related research. Experiments show that the
proposed method significantly outperforms previous state-of-the-art interacting
hand pose estimation approaches. Codes and data are available at
https://github.com/MengHao666/HDR.Comment: ECCV202
The garden asparagus (Asparagus officinalis L.) mitochondrial genome revealed rich sequence variation throughout whole sequencing data
Garden asparagus (Asparagus officinalis L.) is a horticultural crop with high nutritional and medical value, considered an ideal plant for sex determination research among many dioecious plants, whose genomic information can support genetic analysis and breeding programs. In this research, the entire mitochondrial genome of A. officinalis was sequenced, annotated and assembled using a mixed Illumina and PacBio data. The garden asparagus circular mitochondrial genome measures 492,062 bp with a GC value of 45.9%. Thirty-six protein-coding genes, 17 tRNA and 6 rRNA genes were annotated, among which 8 protein-coding genes contained 16 introns. In addition, 254 SSRs with 10 complete tandem repeats and 293 non-tandem repeats were identified. It was found that the codons of edited sites located in the amino acids showed a leucine-formation trend, and RNA editing sites mainly caused the mutual transformation of amino acids with the same properties. Furthermore, 72 sequence fragments accounting for 20,240 bp, presentating 4.11% of the whole mitochondrial genome, were observed to migrate from chloroplast to mitochondrial genome of A. officinalis. The phylogenetic analysis showed that the closest genetic relationship between A. officinalis with onion (Allium cepa) inside the Liliaceae family. Our results demonstrated that high percentage of protein-coding genes had evolutionary conservative properties, with Ka/Ks values less than 1. Therefore, this study provides a high-quality garden asparagus mitochondrial genome, useful to promote better understanding of gene exchange between organelle genomes
Flexible generation of structured terahertz fields via programmable exchange-biased spintronic emitters
Structured light, particularly in the terahertz frequency range, holds
considerable potential for a diverse range of applications. However, the
generation and control of structured terahertz radiation pose major challenges.
In this work, we demonstrate a novel programmable spintronic emitter that can
flexibly generate a variety of structured terahertz waves. This is achieved
through the precise and high-resolution programming of the magnetization
pattern on the emitter surface, utilizing laser-assisted local field cooling of
an exchange-biased ferromagnetic heterostructure. Moreover, we outline a
generic design strategy for realizing specific complex structured terahertz
fields in the far field. Our device successfully demonstrates the generation of
terahertz waves with diverse structured polarization states, including
spatially separated circular polarizations, azimuthal or radial polarization
states, and a full Poincare beam. This innovation opens a new avenue for
designing and generating structured terahertz radiations, with potential
applications in terahertz microscopy, communication, quantum information, and
light-matter interactions
- …