ADBench: Anomaly Detection Benchmark

Given a long list of anomaly detection algorithms developed in the last few decades, how do they perform with regard to (i) varying levels of supervision, (ii) different types of anomalies, and (iii) noisy and corrupted data? In this work, we answer these key questions by conducting (to our best knowledge) the most comprehensive anomaly detection benchmark with 30 algorithms on 57 benchmark datasets, named ADBench. Our extensive experiments (98,436 in total) identify meaningful insights into the role of supervision and anomaly types, and unlock future directions for researchers in algorithm selection and design. With ADBench, researchers can easily conduct comprehensive and fair evaluations for newly proposed methods on the datasets (including our contributed ones from natural language and computer vision domains) against the existing baselines. To foster accessibility and reproducibility, we fully open-source ADBench and the corresponding results.Comment: NeurIPS 2022. All authors contribute equally and are listed alphabetically. Code available at https://github.com/Minqi824/ADBenc

ADGym: Design Choices for Deep Anomaly Detection

Deep learning (DL) techniques have recently found success in anomaly detection (AD) across various fields such as finance, medical services, and cloud computing. However, most of the current research tends to view deep AD algorithms as a whole, without dissecting the contributions of individual design choices like loss functions and network architectures. This view tends to diminish the value of preliminary steps like data preprocessing, as more attention is given to newly designed loss functions, network architectures, and learning paradigms. In this paper, we aim to bridge this gap by asking two key questions: (i) Which design choices in deep AD methods are crucial for detecting anomalies? (ii) How can we automatically select the optimal design choices for a given AD dataset, instead of relying on generic, pre-existing solutions? To address these questions, we introduce ADGym, a platform specifically crafted for comprehensive evaluation and automatic selection of AD design elements in deep methods. Our extensive experiments reveal that relying solely on existing leading methods is not sufficient. In contrast, models developed using ADGym significantly surpass current state-of-the-art techniques.Comment: NeurIPS 2023. The first three authors contribute equally. Code available at https://github.com/Minqi824/ADGy

Dynamic evolution of COVID-19 on chest computed tomography: experience from Jiangsu Province of China

Objectives To determine the patterns of chest computed tomography (CT) evolution according to disease severity in a large coronavirus disease 2019 (COVID-19) cohort in Jiangsu Province, China. Methods This retrospective cohort study was conducted from January 10, 2020, to February 18, 2020. All patients diagnosed with COVID-19 in Jiangsu Province were included, retrospectively. Quantitative CT measurements of pulmonary opacities including volume, density, and location were extracted by deep learning algorithm. Dynamic evolution of these measurements was investigated from symptom onset (day 1) to beyond day 15. Comparison was made between severity groups. Results A total of 484 patients (median age of 47 years, interquartile range 33–57) with 954 CT examinations were included, and each was assigned to one of the three groups: asymptomatic/mild (n = 63), moderate (n = 378), severe/critically ill (n = 43). Time series showed different evolution patterns of CT measurements in the groups. Following disease onset, posteroinferior subpleural area of the lung was the most common location for pulmonary opacities. Opacity volume continued to increase beyond 15 days in the severe/critically ill group, compared with peaking on days 13–15 in the moderate group. Asymptomatic/mild group had the lowest opacity volume which almost resolved after 15 days. The opacity density began to drop from day 10 to day 12 for moderately ill patients. Conclusions Volume, density, and location of the pulmonary opacity and their evolution on CT varied with disease severity in COVID-19. These findings are valuable in understanding the nature of the disease and monitoring the patient’s condition during the course of illness