NeuroBench: Advancing Neuromorphic Computing through Collaborative, Fair and Representative Benchmarking

The field of neuromorphic computing holds great promise in terms of advancing computing efficiency and capabilities by following brain-inspired principles. However, the rich diversity of techniques employed in neuromorphic research has resulted in a lack of clear standards for benchmarking, hindering effective evaluation of the advantages and strengths of neuromorphic methods compared to traditional deep-learning-based methods. This paper presents a collaborative effort, bringing together members from academia and the industry, to define benchmarks for neuromorphic computing: NeuroBench. The goals of NeuroBench are to be a collaborative, fair, and representative benchmark suite developed by the community, for the community. In this paper, we discuss the challenges associated with benchmarking neuromorphic solutions, and outline the key features of NeuroBench. We believe that NeuroBench will be a significant step towards defining standards that can unify the goals of neuromorphic computing and drive its technological progress. Please visit neurobench.ai for the latest updates on the benchmark tasks and metrics

NeuroBench:Advancing Neuromorphic Computing through Collaborative, Fair and Representative Benchmarking

The field of neuromorphic computing holds great promise in terms of advancing computing efficiency and capabilities by following brain-inspired principles. However, the rich diversity of techniques employed in neuromorphic research has resulted in a lack of clear standards for benchmarking, hindering effective evaluation of the advantages and strengths of neuromorphic methods compared to traditional deep-learning-based methods. This paper presents a collaborative effort, bringing together members from academia and the industry, to define benchmarks for neuromorphic computing: NeuroBench. The goals of NeuroBench are to be a collaborative, fair, and representative benchmark suite developed by the community, for the community. In this paper, we discuss the challenges associated with benchmarking neuromorphic solutions, and outline the key features of NeuroBench. We believe that NeuroBench will be a significant step towards defining standards that can unify the goals of neuromorphic computing and drive its technological progress. Please visit neurobench.ai for the latest updates on the benchmark tasks and metrics

NeuroBench:A Framework for Benchmarking Neuromorphic Computing Algorithms and Systems

Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. Prior neuromorphic computing benchmark efforts have not seen widespread adoption due to a lack of inclusive, actionable, and iterative benchmark design and guidelines. To address these shortcomings, we present NeuroBench: a benchmark framework for neuromorphic computing algorithms and systems. NeuroBench is a collaboratively-designed effort from an open community of nearly 100 co-authors across over 50 institutions in industry and academia, aiming to provide a representative structure for standardizing the evaluation of neuromorphic approaches. The NeuroBench framework introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent (algorithm track) and hardware-dependent (system track) settings. In this article, we present initial performance baselines across various model architectures on the algorithm track and outline the system track benchmark tasks and guidelines. NeuroBench is intended to continually expand its benchmarks and features to foster and track the progress made by the research community

Risk factors for Coronavirus disease 2019 (Covid-19) death in a population cohort study from the Western Cape province, South Africa

Risk factors for coronavirus disease 2019 (COVID-19) death in sub-Saharan Africa and the effects of human immunodeficiency virus (HIV) and tuberculosis on COVID-19 outcomes are unknown. We conducted a population cohort study using linked data from adults attending public-sector health facilities in the Western Cape, South Africa. We used Cox proportional hazards models, adjusted for age, sex, location, and comorbidities, to examine the associations between HIV, tuberculosis, and COVID-19 death from 1 March to 9 June 2020 among (1) public-sector “active patients” (≥1 visit in the 3 years before March 2020); (2) laboratory-diagnosed COVID-19 cases; and (3) hospitalized COVID-19 cases. We calculated the standardized mortality ratio (SMR) for COVID-19, comparing adults living with and without HIV using modeled population estimates.Among 3 460 932 patients (16% living with HIV), 22 308 were diagnosed with COVID-19, of whom 625 died. COVID19 death was associated with male sex, increasing age, diabetes, hypertension, and chronic kidney disease. HIV was associated with COVID-19 mortality (adjusted hazard ratio [aHR], 2.14; 95% confidence interval [CI], 1.70–2.70), with similar risks across strata of viral loads and immunosuppression. Current and previous diagnoses of tuberculosis were associated with COVID-19 death (aHR, 2.70 [95% CI, 1.81–4.04] and 1.51 [95% CI, 1.18–1.93], respectively). The SMR for COVID-19 death associated with HIV was 2.39 (95% CI, 1.96–2.86); population attributable fraction 8.5% (95% CI, 6.1–11.1)