Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Grounding

AI-synthesized text and images have gained significant attention, particularly due to the widespread dissemination of multi-modal manipulations on the internet, which has resulted in numerous negative impacts on society. Existing methods for multi-modal manipulation detection and grounding primarily focus on fusing vision-language features to make predictions, while overlooking the importance of modality-specific features, leading to sub-optimal results. In this paper, we construct a simple and novel transformer-based framework for multi-modal manipulation detection and grounding tasks. Our framework simultaneously explores modality-specific features while preserving the capability for multi-modal alignment. To achieve this, we introduce visual/language pre-trained encoders and dual-branch cross-attention (DCA) to extract and fuse modality-unique features. Furthermore, we design decoupled fine-grained classifiers (DFC) to enhance modality-specific feature mining and mitigate modality competition. Moreover, we propose an implicit manipulation query (IMQ) that adaptively aggregates global contextual cues within each modality using learnable queries, thereby improving the discovery of forged details. Extensive experiments on the $\rm DGM^4$ dataset demonstrate the superior performance of our proposed model compared to state-of-the-art approaches.Comment: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessibl

Global Infectious Diseases in August of 2022: Monthly Analysis

Infectious diseases have greatly affected the development of human history, owing to their unpredictable zoonotic characteristics. The recording of infectious diseases epidemic data provides information on disease transmission trends, and enables research on the risk of penitential epidemics and the mechanisms of transmission of infectious diseases. Recent years have seen a significant increase in the number of confirmed and fatal cases of COVID-19 since it became a pandemic in late 2019. Monkeypox also has potential for global transmission, because the World Health Organization (WHO) [ 1 ] reported cases of MPXV in at least 12 Countries that are not endemic for monkeypox virus. Africa and Southeast Asia appear to be the main regions where mosquito-borne diseases are epidemic, possibly because of the rainy weather in these regions in the past month. Tracking disease incidence and epidemic tendency remains imperative in these areas, although most infectious diseases appear to be dispersed and transmitted in only several areas at the moment

Global Infectious Diseases in September 2022: Monthly Analysis

The threat of infectious diseases caused by pathogenic microorganisms to both human health and the economy is enormous. Coronavirus Disease 2019 (COVID-19) remains a global pandemic. In contrast to many other infectious diseases, monkeypox spreads rapidly and cannot be ignored. Collection of data on contagious diseases can provide quantitative evidence to support effective pandemic control strategies. Global data on predominant infectious diseases collected in the past several weeks and a summary of their epidemiology are presented herein

Global Infectious Diseases in December 2022: Monthly Analysis

The emergence and reoccurrence of infectious diseases constitute a significant threat to human health. Data for this paper were mainly obtained from official websites, such as the WHO and national CDC websites. The report summarizes and analyzes information on infectious diseases for early outbreak monitoring from 24 November to 23 December 2022. Monkeypox cases declined in December 2022 with few deaths, while cholera infections have increased in African regions and war-torn countries. Most sub-Saharan countries are affected by insect-borne diseases, such as dengue, Lassa, and chikungunya fever

Global Infectious Diseases in October 2022: Monthly Analysis

Infectious diseases continue to pose a major threat to worldwide public health. Infections by Coronavirus Disease 2019 have eased but continue to negatively affect international economic development. The situation of other infectious diseases, such as monkeypox and mosquito-borne diseases, became stable in October. Monitoring epidemic situation of infectious diseases can provide rapid insight into global transmission trends and assist in predicting epidemic situations. Visualizations and analyses summarizing the past few weeks of global data on major infectious diseases are provided

Global Infectious Diseases in February 2023: Monthly Analysis

Public health security in human societies is placed under enormous strain by infectious disease epidemics. According to the WHO, COVID-19 and Mpox remain on the list of PHEICs, whereas cholera, dengue, and other contagious diseases remain endemic in several countries and regions. Data on prevalent infectious diseases have been collected worldwide in recent weeks, and may provide new ideas for international collaboration in public health

Global Infectious Diseases in August 2023: A Monthly Analysis

Infectious diseases frequently affect children and adults worldwide. Owing to their specific biology and mode of transmission, the presence of infected individuals or carriers in a region often leads to outbreaks of the disease in that region, and in severe cases, to the death of the infected individual. Infectious diseases have been one of the main causes of mass disability or death in humans for centuries. Surveillance of infectious diseases on a continental scale is therefore important for assessing, recognizing, and preventing the risks that these diseases may pose to animal and human health on a global scale. This report focuses on global infectious disease outbreaks and systematically summarises the timing and location of outbreaks in infected populations between 24 July and 23 August 2023 based on the Global Outbreak Information Surveillance System (GOSIS) of Shusi Technologies

Global Infectious Diseases in June 2023: Monthly Analysis

Infectious diseases are a class of diseases caused by various pathogens that can be transmitted between humans and animals or between humans and animals, thus seriously affecting the development of human society. To control the spread of infectious diseases worldwide and ensure the safety of people’s lives, it is essential to regularly analyze global infectious disease cases. This review is based on data from the World Health Organization, the Centers for Disease Control in countries around the world, Outbreak News Today and many other epidemiological websites to predict the global infectious disease outbreak trend. In addition, using the Shuci Technology global epidemic information monitoring system, we analyzed the distribution of infectious diseases that occurred around the world from 24 May 2023 to 23 June 2023