Revisiting DETR Pre-training for Object Detection

Motivated by that DETR-based approaches have established new records on COCO detection and segmentation benchmarks, many recent endeavors show increasing interest in how to further improve DETR-based approaches by pre-training the Transformer in a self-supervised manner while keeping the backbone frozen. Some studies already claimed significant improvements in accuracy. In this paper, we take a closer look at their experimental methodology and check if their approaches are still effective on the very recent state-of-the-art such as $\mathcal{H}$-Deformable-DETR. We conduct thorough experiments on COCO object detection tasks to study the influence of the choice of pre-training datasets, localization, and classification target generation schemes. Unfortunately, we find the previous representative self-supervised approach such as DETReg, fails to boost the performance of the strong DETR-based approaches on full data regimes. We further analyze the reasons and find that simply combining a more accurate box predictor and Objects$365$ benchmark can significantly improve the results in follow-up experiments. We demonstrate the effectiveness of our approach by achieving strong object detection results of AP=$59.3\%$ on COCO val set, which surpasses $\mathcal{H}$-Deformable-DETR + Swin-L by +$1.4\%$. Last, we generate a series of synthetic pre-training datasets by combining the very recent image-to-text captioning models (LLaVA) and text-to-image generative models (SDXL). Notably, pre-training on these synthetic datasets leads to notable improvements in object detection performance. Looking ahead, we anticipate substantial advantages through the future expansion of the synthetic pre-training dataset

Rank-DETR for High Quality Object Detection

Modern detection transformers (DETRs) use a set of object queries to predict a list of bounding boxes, sort them by their classification confidence scores, and select the top-ranked predictions as the final detection results for the given input image. A highly performant object detector requires accurate ranking for the bounding box predictions. For DETR-based detectors, the top-ranked bounding boxes suffer from less accurate localization quality due to the misalignment between classification scores and localization accuracy, thus impeding the construction of high-quality detectors. In this work, we introduce a simple and highly performant DETR-based object detector by proposing a series of rank-oriented designs, combinedly called Rank-DETR. Our key contributions include: (i) a rank-oriented architecture design that can prompt positive predictions and suppress the negative ones to ensure lower false positive rates, as well as (ii) a rank-oriented loss function and matching cost design that prioritizes predictions of more accurate localization accuracy during ranking to boost the AP under high IoU thresholds. We apply our method to improve the recent SOTA methods (e.g., H-DETR and DINO-DETR) and report strong COCO object detection results when using different backbones such as ResNet-$50$, Swin-T, and Swin-L, demonstrating the effectiveness of our approach. Code is available at \url{https://github.com/LeapLabTHU/Rank-DETR}.Comment: NeurIPS 202

The timescale of plume-driven cratonization: A complete record from Tarim

ABSTRACT: Cratonization of the Tarim block in central Asia is finalized by the Permian Tarim plume that welded two cratonic nuclei together. Hence, the over-10-km-thick Tarim basin preserves a complete record of deformation and growth strata before, during, and after the plume-driven cratonization. Here we use seismic reflection data from the central Tarim basin to quantify the timing and style of the Paleozoic–Mesozoic deformation. The thrust and strike-slip faults there all underwent an early, intense deformation stage in the earliest Ordovician–Middle Devonian, a hiatus stage from Late Devonian to Late Permian, and a newly-discovered stage of weak activity throughout the Mesozoic. The intracontinental deformation is controlled by the subduction and accretion surrounding the Tarim block. The minor, but non-zero, Mesozoic strains reflect the ongoing adjustment to far-field compressions during the cooling and strengthening of the plume-stitched continental lithosphere. The cessation of interior deformation marks that the Tarim cratonization is finally attained ~200 Myr after the plume waned

SUPPLEMENTARY DATA FIGURES from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Figure S1. In vivo CRISPR screens to identify critical drivers of immune evasion; Supplementary Figure S2. Effects of Ripk2 depletion on tumor growth; Supplementary Figure S3. RIPK2 is overexpressed in human and mouse PDAC tissues; Supplementary Figure S4. Ablation of RIPK2 disrupts the desmoplastic TME; Supplementary Figure S5. RIPK2 modulates the immune profile and impairs anti-tumor T cell response; Supplementary Figure S6. RIPK2 restricts the activation and effector states of CD8+ T cells by impairing antigen presentation; Supplementary Figure S7. RIPK2 promotes MHC-I trafficking to lysosomes via NBR1; Supplementary Figure S8. RIPK2 ubiquitination promotes NBR1-mediated MHC-I degradation; Supplementary Figure S9. RIPK2 ablation potentiates the efficacy of PD-1 blockade; Supplementary Figure S10. Diagram illustrating RIPK2-mediated degradation of MHC I through autophagy–lysosome system.</p

Supplementary Table S4 from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Table S4. Primers used for qPCR or generating knockout/knockdown constructs.</p

Supplementary Table S1 from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Table S1. MAGeCK analysis of CRISPR screen results to identify regulator of immune evasion in orthotopic PDAC mouse models.</p

Supplementary Table S2 from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Table S2. Detailed information of human pancreatic tissue array.</p

Supplementary Table S3 from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Table S3. Detailed information of reagents and resources used in this study.</p

Supplementary Table S2 from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Table S2. Detailed information of human pancreatic tissue array.</p

SUPPLEMENTARY DATA FIGURES from Receptor-interacting Protein Kinase 2 Is an Immunotherapy Target in Pancreatic Cancer

Supplementary Figure S1. In vivo CRISPR screens to identify critical drivers of immune evasion; Supplementary Figure S2. Effects of Ripk2 depletion on tumor growth; Supplementary Figure S3. RIPK2 is overexpressed in human and mouse PDAC tissues; Supplementary Figure S4. Ablation of RIPK2 disrupts the desmoplastic TME; Supplementary Figure S5. RIPK2 modulates the immune profile and impairs anti-tumor T cell response; Supplementary Figure S6. RIPK2 restricts the activation and effector states of CD8+ T cells by impairing antigen presentation; Supplementary Figure S7. RIPK2 promotes MHC-I trafficking to lysosomes via NBR1; Supplementary Figure S8. RIPK2 ubiquitination promotes NBR1-mediated MHC-I degradation; Supplementary Figure S9. RIPK2 ablation potentiates the efficacy of PD-1 blockade; Supplementary Figure S10. Diagram illustrating RIPK2-mediated degradation of MHC I through autophagy–lysosome system.</p