93 research outputs found

    Frozen CLIP Model is An Efficient Point Cloud Backbone

    Full text link
    The pretraining-finetuning paradigm has demonstrated great success in NLP and 2D image fields because of the high-quality representation ability and transferability of their pretrained models. However, pretraining such a strong model is difficult in the 3D point cloud field since the training data is limited and point cloud collection is expensive. This paper introduces Efficient Point Cloud Learning (EPCL), an effective and efficient point cloud learner for directly training high-quality point cloud models with a frozen CLIP model. Our EPCL connects the 2D and 3D modalities by semantically aligning the 2D features and point cloud features without paired 2D-3D data. Specifically, the input point cloud is divided into a sequence of tokens and directly fed into the frozen CLIP model to learn point cloud representation. Furthermore, we design a task token to narrow the gap between 2D images and 3D point clouds. Comprehensive experiments on 3D detection, semantic segmentation, classification and few-shot learning demonstrate that the 2D CLIP model can be an efficient point cloud backbone and our method achieves state-of-the-art accuracy on both real-world and synthetic downstream tasks. Code will be available.Comment: Technical repor

    3D Interacting Hand Pose Estimation by Hand De-occlusion and Removal

    Full text link
    Estimating 3D interacting hand pose from a single RGB image is essential for understanding human actions. Unlike most previous works that directly predict the 3D poses of two interacting hands simultaneously, we propose to decompose the challenging interacting hand pose estimation task and estimate the pose of each hand separately. In this way, it is straightforward to take advantage of the latest research progress on the single-hand pose estimation system. However, hand pose estimation in interacting scenarios is very challenging, due to (1) severe hand-hand occlusion and (2) ambiguity caused by the homogeneous appearance of hands. To tackle these two challenges, we propose a novel Hand De-occlusion and Removal (HDR) framework to perform hand de-occlusion and distractor removal. We also propose the first large-scale synthetic amodal hand dataset, termed Amodal InterHand Dataset (AIH), to facilitate model training and promote the development of the related research. Experiments show that the proposed method significantly outperforms previous state-of-the-art interacting hand pose estimation approaches. Codes and data are available at https://github.com/MengHao666/HDR.Comment: ECCV202

    The garden asparagus (Asparagus officinalis L.) mitochondrial genome revealed rich sequence variation throughout whole sequencing data

    Get PDF
    Garden asparagus (Asparagus officinalis L.) is a horticultural crop with high nutritional and medical value, considered an ideal plant for sex determination research among many dioecious plants, whose genomic information can support genetic analysis and breeding programs. In this research, the entire mitochondrial genome of A. officinalis was sequenced, annotated and assembled using a mixed Illumina and PacBio data. The garden asparagus circular mitochondrial genome measures 492,062 bp with a GC value of 45.9%. Thirty-six protein-coding genes, 17 tRNA and 6 rRNA genes were annotated, among which 8 protein-coding genes contained 16 introns. In addition, 254 SSRs with 10 complete tandem repeats and 293 non-tandem repeats were identified. It was found that the codons of edited sites located in the amino acids showed a leucine-formation trend, and RNA editing sites mainly caused the mutual transformation of amino acids with the same properties. Furthermore, 72 sequence fragments accounting for 20,240 bp, presentating 4.11% of the whole mitochondrial genome, were observed to migrate from chloroplast to mitochondrial genome of A. officinalis. The phylogenetic analysis showed that the closest genetic relationship between A. officinalis with onion (Allium cepa) inside the Liliaceae family. Our results demonstrated that high percentage of protein-coding genes had evolutionary conservative properties, with Ka/Ks values less than 1. Therefore, this study provides a high-quality garden asparagus mitochondrial genome, useful to promote better understanding of gene exchange between organelle genomes

    Flexible generation of structured terahertz fields via programmable exchange-biased spintronic emitters

    Full text link
    Structured light, particularly in the terahertz frequency range, holds considerable potential for a diverse range of applications. However, the generation and control of structured terahertz radiation pose major challenges. In this work, we demonstrate a novel programmable spintronic emitter that can flexibly generate a variety of structured terahertz waves. This is achieved through the precise and high-resolution programming of the magnetization pattern on the emitter surface, utilizing laser-assisted local field cooling of an exchange-biased ferromagnetic heterostructure. Moreover, we outline a generic design strategy for realizing specific complex structured terahertz fields in the far field. Our device successfully demonstrates the generation of terahertz waves with diverse structured polarization states, including spatially separated circular polarizations, azimuthal or radial polarization states, and a full Poincare beam. This innovation opens a new avenue for designing and generating structured terahertz radiations, with potential applications in terahertz microscopy, communication, quantum information, and light-matter interactions
    • …
    corecore