When LLMs step into the 3D world: a survey and meta-analysis of 3D tasks via multi-modal Large Language Models

As large language models (LLMs) evolve, their integration with 3D spatial data (3D-LLMs) has seen rapid progress, offering unprecedented capabilities for understanding and interacting with physical spaces. This survey provides a comprehensive overview of the methodologies enabling LLMs to process, understand, and generate 3D data. Highlighting the unique advantages of LLMs, such as in-context learning, step-by-step reasoning, open-vocabulary capabilities, and extensive world knowledge, we underscore their potential to significantly advance spatial comprehension and interaction within embodied Artificial Intelligence (AI) systems. Our investigation spans various 3D data representations, from point clouds to Neural Radiance Fields (NeRFs). It examines their integration with LLMs for tasks such as 3D scene understanding, captioning, question-answering, and dialogue, as well as LLM-based agents for spatial reasoning, planning, and navigation. The paper also includes a brief review of other methods that integrate 3D and language. The meta-analysis presented in this paper reveals significant progress yet underscores the necessity for novel approaches to harness the full potential of 3D-LLMs. Hence, with this paper, we aim to chart a course for future research that explores and expands the capabilities of 3D-LLMs in understanding and interacting with the complex 3D world. To support this survey, we have established a project page where papers related to our topic are organized and listed: https://github.com/ActiveVisionLab/Awesome-LLM-3D

Preconditioning of mesenchymal stromal cells with low-intensity ultrasound: influence on chondrogenesis and directed SOX9 signaling pathways

Background: Continuous low-intensity ultrasound (cLIUS) facilitates the chondrogenic differentiation of human mesenchymal stromal cells (MSCs) in the absence of exogenously added transforming growth factor-beta (TGFβ) by upregulating the expression of transcription factor SOX9, a master regulator of chondrogenesis. The present study evaluated the molecular events associated with the signaling pathways impacting SOX9 gene and protein expression under cLIUS. Methods: Human bone marrow-derived MSCs were exposed to cLIUS stimulation at 14 kPa (5 MHz, 2.5 Vpp) for 5 min. The gene and protein expression of SOX9 was evaluated. The specificity of SOX9 upregulation under cLIUS was determined by treating the MSCs with small molecule inhibitors of select signaling molecules, followed by cLIUS treatment. Signaling events regulating SOX9 expression under cLIUS were analyzed by gene expression, immunofluorescence staining, and western blotting. Results: cLIUS upregulated the gene expression of SOX9 and enhanced the nuclear localization of SOX9 protein when compared to non-cLIUS-stimulated control. cLIUS was noted to enhance the phosphorylation of the signaling molecule ERK1/2. Inhibition of MEK/ERK1/2 by PD98059 resulted in the effective abrogation of cLIUS-induced SOX9 expression, indicating that cLIUS-induced SOX9 upregulation was dependent on the phosphorylation of ERK1/2. Inhibition of integrin and TRPV4, the upstream cell-surface effectors of ERK1/2, did not inhibit the phosphorylation of ERK1/2 and therefore did not abrogate cLIUS-induced SOX9 expression, thereby suggesting the involvement of other mechanoreceptors. Consequently, the effect of cLIUS on the actin cytoskeleton, a mechanosensitive receptor regulating SOX9, was evaluated. Diffused and disrupted actin fibers observed in MSCs under cLIUS closely resembled actin disruption by treatment with cytoskeletal drug Y27632, which is known to increase the gene expression of SOX9. The upregulation of SOX9 under cLIUS was, therefore, related to cLIUS-induced actin reorganization. SOX9 upregulation induced by actin reorganization was also found to be dependent on the phosphorylation of ERK1/2. Conclusions: Collectively, preconditioning of MSCs by cLIUS resulted in the nuclear localization of SOX9, phosphorylation of ERK1/2 and disruption of actin filaments, and the expression of SOX9 was dependent on the phosphorylation of ERK1/2 under cLIUS

Linguistic measures of chemical diversity and the "keywords" of molecular collections

Computerized linguistic analyses have proven of immense value in comparing and searching through large text collections ("corpora"), including those deposited on the Internet-indeed, it would nowadays be hard to imagine browsing the Web without, for instance, search algorithms extracting most appropriate keywords from documents. This paper describes how such corpus-linguistic concepts can be extended to chemistry based on characteristic "chemical words" that span more than traditional functional groups and, instead, look at common structural fragments molecules share. Using these words, it is possible to quantify the diversity of chemical collections/databases in new ways and to define molecular "keywords" by which such collections are best characterized and annotated

Observation of a ppb mass threshoud enhancement in \psi^\prime\to\pi^+\pi^-J/\psi(J/\psi\to\gamma p\bar{p}) decay

The decay channel $\psi^\prime\to\pi^+\pi^-J/\psi(J/\psi\to\gamma p\bar{p})$ is studied using a sample of $1.06\times 10^8$ $\psi^\prime$ events collected by the BESIII experiment at BEPCII. A strong enhancement at threshold is observed in the $p\bar{p}$ invariant mass spectrum. The enhancement can be fit with an $S$-wave Breit-Wigner resonance function with a resulting peak mass of $M=1861^{+6}_{-13} {\rm (stat)}^{+7}_{-26} {\rm (syst)} {\rm MeV/}c^2$ and a narrow width that is $\Gamma<38 {\rm MeV/}c^2$ at the 90% confidence level. These results are consistent with published BESII results. These mass and width values do not match with those of any known meson resonance.Comment: 5 pages, 3 figures, submitted to Chinese Physics

X-ray Absorption and Reflection in Active Galactic Nuclei

X-ray spectroscopy offers an opportunity to study the complex mixture of emitting and absorbing components in the circumnuclear regions of active galactic nuclei, and to learn about the accretion process that fuels AGN and the feedback of material to their host galaxies. We describe the spectral signatures that may be studied and review the X-ray spectra and spectral variability of active galaxies, concentrating on progress from recent Chandra, XMM-Newton and Suzaku data for local type 1 AGN. We describe the evidence for absorption covering a wide range of column densities, ionization and dynamics, and discuss the growing evidence for partial-covering absorption from data at energies > 10 keV. Such absorption can also explain the observed X-ray spectral curvature and variability in AGN at lower energies and is likely an important factor in shaping the observed properties of this class of source. Consideration of self-consistent models for local AGN indicates that X-ray spectra likely comprise a combination of absorption and reflection effects from material originating within a few light days of the black hole as well as on larger scales. It is likely that AGN X-ray spectra may be strongly affected by the presence of disk-wind outflows that are expected in systems with high accretion rates, and we describe models that attempt to predict the effects of radiative transfer through such winds, and discuss the prospects for new data to test and address these ideas.Comment: Accepted for publication in the Astronomy and Astrophysics Review. 58 pages, 9 figures. V2 has fixed an error in footnote

Computer-assisted and fractal-based morphometric assessment of microvascularity in histological specimens of gliomas

Fractal analysis is widely applied to investigate the vascular system in physiological as well as pathological states. We propose and examine a computer-aided and fractal-based image analysis technique to quantify the microvascularity in histological specimens of WHO grade II and III gliomas. A computer-aided and fractal-based analysis was used to describe the microvessels and to quantify their geometrical complexity in histological specimens collected from 17 patients. The statistical analysis showed that the fractal-based indexes are the most discriminant parameters to describe the microvessels. The computer-aided quantitative analysis also showed that grade III gliomas are generally more vascularized than grade II gliomas. The fractal parameters are reliable quantitative indicators of the neoplastic microvasculature, making them potential surrogate biomarkers. The qualitative evaluation currently performed by the neuropathologist can be combined with the computer-assisted quantitative analysis of the microvascularity to improve the diagnosis and optimize the treatment of patients with brain cancer

Performance of CMS muon reconstruction in pp collision events at sqrt(s) = 7 TeV

The performance of muon reconstruction, identification, and triggering in CMS has been studied using 40 inverse picobarns of data collected in pp collisions at sqrt(s) = 7 TeV at the LHC in 2010. A few benchmark sets of selection criteria covering a wide range of physics analysis needs have been examined. For all considered selections, the efficiency to reconstruct and identify a muon with a transverse momentum pT larger than a few GeV is above 95% over the whole region of pseudorapidity covered by the CMS muon system, abs(eta) < 2.4, while the probability to misidentify a hadron as a muon is well below 1%. The efficiency to trigger on single muons with pT above a few GeV is higher than 90% over the full eta range, and typically substantially better. The overall momentum scale is measured to a precision of 0.2% with muons from Z decays. The transverse momentum resolution varies from 1% to 6% depending on pseudorapidity for muons with pT below 100 GeV and, using cosmic rays, it is shown to be better than 10% in the central region up to pT = 1 TeV. Observed distributions of all quantities are well reproduced by the Monte Carlo simulation.Comment: Replaced with published version. Added journal reference and DO

Performance of CMS muon reconstruction in pp collision events at sqrt(s) = 7 TeV

The performance of muon reconstruction, identification, and triggering in CMS has been studied using 40 inverse picobarns of data collected in pp collisions at sqrt(s) = 7 TeV at the LHC in 2010. A few benchmark sets of selection criteria covering a wide range of physics analysis needs have been examined. For all considered selections, the efficiency to reconstruct and identify a muon with a transverse momentum pT larger than a few GeV is above 95% over the whole region of pseudorapidity covered by the CMS muon system, abs(eta) < 2.4, while the probability to misidentify a hadron as a muon is well below 1%. The efficiency to trigger on single muons with pT above a few GeV is higher than 90% over the full eta range, and typically substantially better. The overall momentum scale is measured to a precision of 0.2% with muons from Z decays. The transverse momentum resolution varies from 1% to 6% depending on pseudorapidity for muons with pT below 100 GeV and, using cosmic rays, it is shown to be better than 10% in the central region up to pT = 1 TeV. Observed distributions of all quantities are well reproduced by the Monte Carlo simulation.Comment: Replaced with published version. Added journal reference and DO

X-ray emission from the Sombrero galaxy: discrete sources

We present a study of discrete X-ray sources in and around the bulge-dominated, massive Sa galaxy, Sombrero (M104), based on new and archival Chandra observations with a total exposure of ~200 ks. With a detection limit of L_X = 1E37 erg/s and a field of view covering a galactocentric radius of ~30 kpc (11.5 arcminute), 383 sources are detected. Cross-correlation with Spitler et al.'s catalogue of Sombrero globular clusters (GCs) identified from HST/ACS observations reveals 41 X-rays sources in GCs, presumably low-mass X-ray binaries (LMXBs). We quantify the differential luminosity functions (LFs) for both the detected GC and field LMXBs, whose power-low indices (~1.1 for the GC-LF and ~1.6 for field-LF) are consistent with previous studies for elliptical galaxies. With precise sky positions of the GCs without a detected X-ray source, we further quantify, through a fluctuation analysis, the GC LF at fainter luminosities down to 1E35 erg/s. The derived index rules out a faint-end slope flatter than 1.1 at a 2 sigma significance, contrary to recent findings in several elliptical galaxies and the bulge of M31. On the other hand, the 2-6 keV unresolved emission places a tight constraint on the field LF, implying a flattened index of ~1.0 below 1E37 erg/s. We also detect 101 sources in the halo of Sombrero. The presence of these sources cannot be interpreted as galactic LMXBs whose spatial distribution empirically follows the starlight. Their number is also higher than the expected number of cosmic AGNs (52+/-11 [1 sigma]) whose surface density is constrained by deep X-ray surveys. We suggest that either the cosmic X-ray background is unusually high in the direction of Sombrero, or a distinct population of X-ray sources is present in the halo of Sombrero.Comment: 11 figures, 5 tables, ApJ in pres

Azimuthal anisotropy of charged particles at high transverse momenta in PbPb collisions at sqrt(s[NN]) = 2.76 TeV

The azimuthal anisotropy of charged particles in PbPb collisions at nucleon-nucleon center-of-mass energy of 2.76 TeV is measured with the CMS detector at the LHC over an extended transverse momentum (pt) range up to approximately 60 GeV. The data cover both the low-pt region associated with hydrodynamic flow phenomena and the high-pt region where the anisotropies may reflect the path-length dependence of parton energy loss in the created medium. The anisotropy parameter (v2) of the particles is extracted by correlating charged tracks with respect to the event-plane reconstructed by using the energy deposited in forward-angle calorimeters. For the six bins of collision centrality studied, spanning the range of 0-60% most-central events, the observed v2 values are found to first increase with pt, reaching a maximum around pt = 3 GeV, and then to gradually decrease to almost zero, with the decline persisting up to at least pt = 40 GeV over the full centrality range measured.Comment: Replaced with published version. Added journal reference and DO