Open-Set Image Tagging with Multi-Grained Text Supervision

In this paper, we introduce the Recognize Anything Plus Model (RAM++), an open-set image tagging model effectively leveraging multi-grained text supervision. Previous approaches (e.g., CLIP) primarily utilize global text supervision paired with images, leading to sub-optimal performance in recognizing multiple individual semantic tags. In contrast, RAM++ seamlessly integrates individual tag supervision with global text supervision, all within a unified alignment framework. This integration not only ensures efficient recognition of predefined tag categories, but also enhances generalization capabilities for diverse open-set categories. Furthermore, RAM++ employs large language models (LLMs) to convert semantically constrained tag supervision into more expansive tag description supervision, thereby enriching the scope of open-set visual description concepts. Comprehensive evaluations on various image recognition benchmarks demonstrate RAM++ exceeds existing state-of-the-art (SOTA) open-set image tagging models on most aspects. Specifically, for predefined commonly used tag categories, RAM++ showcases 10.2 mAP and 15.4 mAP enhancements over CLIP on OpenImages and ImageNet. For open-set categories beyond predefined, RAM++ records improvements of 5.0 mAP and 6.4 mAP over CLIP and RAM respectively on OpenImages. For diverse human-object interaction phrases, RAM++ achieves 7.8 mAP and 4.7 mAP improvements on the HICO benchmark. Code, datasets and pre-trained models are available at \url{https://github.com/xinyu1205/recognize-anything}.Comment: Homepage: https://github.com/xinyu1205/recognize-anythin

Correlation between intercalated magnetic layers and superconductivity in pressurized EuFe2(As0.81P0.19)2

We report comprehensive high pressure studies on correlation between intercalated magnetic layers and superconductivity in EuFe2(As0.81P0.19)2 single crystal through in-situ high pressure resistance, specific heat, X-ray diffraction and X-ray absorption measurements. We find that an unconfirmed magnetic order of the intercalated layers coexists with superconductivity in a narrow pressure range 0-0.5GPa, and then it converts to a ferromagnetic (FM) order at pressure above 0.5 GPa, where its superconductivity is absent. The obtained temperature-pressure phase diagram clearly demonstrates that the unconfirmed magnetic order can emerge from the superconducting state. In stark contrast, the superconductivity cannot develop from the FM state that is evolved from the unconfirmed magnetic state. High pressure X-ray absorption (XAS) measurements reveal that the pressure-induced enhancement of Eu's mean valence plays an important role in suppressing the superconductivity and tuning the transition from the unconfirmed magnetic state to a FM state. The unusual interplay among valence state of Eu ions, magnetism and superconductivity under pressure may shed new light on understanding the role of the intercalated magnetic layers in Fe-based superconductors