When LLMs step into the 3D world: a survey and meta-analysis of 3D tasks via multi-modal Large Language Models

As large language models (LLMs) evolve, their integration with 3D spatial data (3D-LLMs) has seen rapid progress, offering unprecedented capabilities for understanding and interacting with physical spaces. This survey provides a comprehensive overview of the methodologies enabling LLMs to process, understand, and generate 3D data. Highlighting the unique advantages of LLMs, such as in-context learning, step-by-step reasoning, open-vocabulary capabilities, and extensive world knowledge, we underscore their potential to significantly advance spatial comprehension and interaction within embodied Artificial Intelligence (AI) systems. Our investigation spans various 3D data representations, from point clouds to Neural Radiance Fields (NeRFs). It examines their integration with LLMs for tasks such as 3D scene understanding, captioning, question-answering, and dialogue, as well as LLM-based agents for spatial reasoning, planning, and navigation. The paper also includes a brief review of other methods that integrate 3D and language. The meta-analysis presented in this paper reveals significant progress yet underscores the necessity for novel approaches to harness the full potential of 3D-LLMs. Hence, with this paper, we aim to chart a course for future research that explores and expands the capabilities of 3D-LLMs in understanding and interacting with the complex 3D world. To support this survey, we have established a project page where papers related to our topic are organized and listed: https://github.com/ActiveVisionLab/Awesome-LLM-3D

Search for dark matter produced in association with bottom or top quarks in √s = 13 TeV pp collisions with the ATLAS detector

A search for weakly interacting massive particle dark matter produced in association with bottom or top quarks is presented. Final states containing third-generation quarks and miss- ing transverse momentum are considered. The analysis uses 36.1 fb−1 of proton–proton collision data recorded by the ATLAS experiment at √s = 13 TeV in 2015 and 2016. No significant excess of events above the estimated backgrounds is observed. The results are in- terpreted in the framework of simplified models of spin-0 dark-matter mediators. For colour- neutral spin-0 mediators produced in association with top quarks and decaying into a pair of dark-matter particles, mediator masses below 50 GeV are excluded assuming a dark-matter candidate mass of 1 GeV and unitary couplings. For scalar and pseudoscalar mediators produced in association with bottom quarks, the search sets limits on the production cross- section of 300 times the predicted rate for mediators with masses between 10 and 50 GeV and assuming a dark-matter mass of 1 GeV and unitary coupling. Constraints on colour- charged scalar simplified models are also presented. Assuming a dark-matter particle mass of 35 GeV, mediator particles with mass below 1.1 TeV are excluded for couplings yielding a dark-matter relic density consistent with measurements

Clinical characteristics and complications of rotavirus gastroenteritis in children in east London: A retrospective case-control study.

BACKGROUND: Rotavirus is the leading cause of acute gastroenteritis in children and is associated with neurological complications such as seizures and encephalopathy. The aim of this study was to investigate the presentation and complications of rotavirus compared to non-rotavirus gastroenteritis in UK children. METHODS: This was a retrospective, case-control, hospital-based study conducted at three sites in east London, UK. Cases were children aged 1 month to 16 years diagnosed with acute gastroenteritis between 1 June 2011 and 31 December 2013, in whom stool virology investigations confirmed presence of rotavirus by PCR. They were matched by age, gender and month of presentation to controls with rotavirus-negative gastroenteritis. RESULTS: Data were collected from 116 children (50 cases and 66 controls). Children with rotavirus gastroenteritis tended to present more frequently with metabolic acidosis (pH 7.30 vs 7.37, P = 0.011) and fever (74% versus 46%; P = 0.005) and were more likely to require hospitalisation compared to children with non-rotavirus gastroenteritis (93% versus 73%; P = 0.019). Neurological complications were the most common extra-intestinal manifestations, but did not differ significantly between children with rotavirus-positive gastroenteritis (RPG) and rotavirus-negative gastroenteritis (RNG) (24% versus 15%, respectively; P = 0.24). Encephalopathy occurred only in children with rotavirus infection (n = 3, 6%). CONCLUSION: Rotavirus causes longer and more severe disease compared to other viral pathogens. Seizures and milder neurological signs were surprisingly common and associated with multiple pathogens, but encephalopathy occurred only in children with rotavirus gastroenteritis. Rotavirus vaccination may reduce seizures and presentation to hospital, but vaccines against other pathogens causing gastroenteritis are required.AJP receives funding from the Wellcome Trust (grant 108065/Z/15/Z)