318 research outputs found
Brain Diffusion for Visual Exploration: Cortical Discovery using Large Scale Generative Models
A long standing goal in neuroscience has been to elucidate the functional
organization of the brain. Within higher visual cortex, functional accounts
have remained relatively coarse, focusing on regions of interest (ROIs) and
taking the form of selectivity for broad categories such as faces, places,
bodies, food, or words. Because the identification of such ROIs has typically
relied on manually assembled stimulus sets consisting of isolated objects in
non-ecological contexts, exploring functional organization without robust a
priori hypotheses has been challenging. To overcome these limitations, we
introduce a data-driven approach in which we synthesize images predicted to
activate a given brain region using paired natural images and fMRI recordings,
bypassing the need for category-specific stimuli. Our approach -- Brain
Diffusion for Visual Exploration ("BrainDiVE") -- builds on recent generative
methods by combining large-scale diffusion models with brain-guided image
synthesis. Validating our method, we demonstrate the ability to synthesize
preferred images with appropriate semantic specificity for well-characterized
category-selective ROIs. We then show that BrainDiVE can characterize
differences between ROIs selective for the same high-level category. Finally we
identify novel functional subdivisions within these ROIs, validated with
behavioral data. These results advance our understanding of the fine-grained
functional organization of human visual cortex, and provide well-specified
constraints for further examination of cortical organization using
hypothesis-driven methods.Comment: NeurIPS 2023 (Oral). Project page:
https://www.cs.cmu.edu/~afluo/BrainDiVE
Divergences between Language Models and Human Brains
Do machines and humans process language in similar ways? Recent research has
hinted in the affirmative, finding that brain signals can be effectively
predicted using the internal representations of language models (LMs). Although
such results are thought to reflect shared computational principles between LMs
and human brains, there are also clear differences in how LMs and humans
represent and use language. In this work, we systematically explore the
divergences between human and machine language processing by examining the
differences between LM representations and human brain responses to language as
measured by Magnetoencephalography (MEG) across two datasets in which subjects
read and listened to narrative stories. Using a data-driven approach, we
identify two domains that are not captured well by LMs: social/emotional
intelligence and physical commonsense. We then validate these domains with
human behavioral experiments and show that fine-tuning LMs on these domains can
improve their alignment with human brain responses
BrainSCUBA: Fine-Grained Natural Language Captions of Visual Cortex Selectivity
Understanding the functional organization of higher visual cortex is a
central focus in neuroscience. Past studies have primarily mapped the visual
and semantic selectivity of neural populations using hand-selected stimuli,
which may potentially bias results towards pre-existing hypotheses of visual
cortex functionality. Moving beyond conventional approaches, we introduce a
data-driven method that generates natural language descriptions for images
predicted to maximally activate individual voxels of interest. Our method --
Semantic Captioning Using Brain Alignments ("BrainSCUBA") -- builds upon the
rich embedding space learned by a contrastive vision-language model and
utilizes a pre-trained large language model to generate interpretable captions.
We validate our method through fine-grained voxel-level captioning across
higher-order visual regions. We further perform text-conditioned image
synthesis with the captions, and show that our images are semantically coherent
and yield high predicted activations. Finally, to demonstrate how our method
enables scientific discovery, we perform exploratory investigations on the
distribution of "person" representations in the brain, and discover
fine-grained semantic selectivity in body-selective areas. Unlike earlier
studies that decode text, our method derives voxel-wise captions of semantic
selectivity. Our results show that BrainSCUBA is a promising means for
understanding functional preferences in the brain, and provides motivation for
further hypothesis-driven investigation of visual cortex
Increased optical pathlength through aqueous media for the infrared microanalysis of live cells
The study of live cells using Fourier transform infrared spectroscopy (FTIR) and FTIR microspectroscopy (FT-IRMS) intrinsically yields more information about cell metabolism than comparable experiments using dried or chemically fixed samples. There are, however, a number of barriers to obtaining high-quality vibrational spectra of live cells, including correction for the significant contributions of water bands to the spectra, and the physical stresses placed upon cells by compression in short pathlength sample holders. In this study, we present a water correction method that is able to result in good-quality cell spectra from water layers of 10 and 12 μm and demonstrate that sufficient biological detail is retained to separate spectra of live cells based upon their exposure to different novel anti-cancer agents. The IR brilliance of a synchrotron radiation (SR) source overcomes the problem of the strong water absorption and provides cell spectra with good signal-to-noise ratio for further analysis. Supervised multivariate analysis (MVA) and investigation of average spectra have shown significant separation between control cells and cells treated with the DNA cross-linker PL63 on the basis of phosphate and DNA-related signatures. Meanwhile, the same control cells can be significantly distinguished from cells treated with the protein kinase inhibitor YA1 based on changes in the amide II region. Each of these separations can be linked directly to the known biochemical mode of
action of each agent.
Keywords: Synchrotron radiation (SR), Fourier transform infrared spectroscopy (FTIR), Infrared microspectroscopy (IRMS), Cancer, Single cell, Drug-cell interaction
Intense emission of cluster anions from gold targets under impact of keV/u gold clusters
CAS, BIASPas de résum
Post-fragmentation vesiculation timescales in hydrous rhyolitic bombs from Chaitén volcano
Bubble nucleation and growth dynamics exert a primary control on the explosivity of volcanic eruptions. Numerous theoretical and experimental studies aim to capture the complex process of melt vesiculation, whereas textural studies use vesicle populations to reconstruct magma behaviour. However, post-fragmentation vesiculation in rhyolitic bombs can create final quenched bubble (vesicle) textures that are not representative of the nature of fragmenting magma within the conduit. To examine bubble growth in hydrous rhyolitic bombs, we have used heated stage microscopy to directly observe vesiculation of a Chaitén rhyolite melt (with an initial dissolved water content of ~0.95 wt %) at atmospheric pressure and magmatic temperatures upon reheating. Thin wafers of obsidian were held from 5 min up to two days in the heated stage at temperatures between 575 °C and 875 °C. We found that bubble growth rates, measured through changes in bubble diameter, increased with both temperature and bubble size. The average growth rate at the highest temperature of 875 °C is ~1.27 μm s−1, which is substantially faster than the lowest detected growth rate of ~0.02 μm s−1 at 725 °C; below this temperature no growth was observed. Average growth rate Vr follows an exponential relationship with temperature, T and inferred melt viscosity η, where Vr = 5.57×10−7e0.016T and Vr = 3270e−1.117η. Several stages of evolving bubble morphology were directly observed, including initial relaxation of deformed bubbles into spheres, extensive growth of spheres, and, at higher temperatures, close packing and foam formation. Bubble deformation due to bubble-bubble interaction and coalescence was observed in most experiments. We use our simple, experimentally-determined relationship between melt viscosity and bubble growth rates to model post-fragmentation vesicle growth in a cooling 1 m-diameter rhyolitic bomb. The results, which indicate negligible vesicle growth within 2–3 cm of the bomb surface, correspond well with the observed dense margin thickness of a Chaitén bomb of comparable dimensions. The experiments described can be used to effectively reconstruct the post-fragmentation vesiculation history of bombs through simple analytical expressions which provide a useful tool for aiding in the interpretation of pumiceous endmember textures in hydrous rhyolitic bombs
Chemotherapeutic response to cisplatin-like drugs in human breast cancer cells probed by vibrational microspectroscopy
Studies of drug-cell interactions in cancer model systems are essential in the preclinical stage of rational drug design, which relies on a thorough understanding of the mechanisms underlying cytotoxic activity and biological effects, at a molecular level. This study aimed at applying complementary vibrational spectroscopy methods to evaluate the cellular impact of two Pt(ii) and Pd(ii) dinuclear chelates with spermine (Pt2Spm and Pd2Spm), using cisplatin (cis-Pt(NH3)2Cl2) as a reference compound. Their effects on cellular metabolism were monitored in a human triple-negative metastatic breast cancer cell line (MDA-MB-231) by Raman and synchrotron-radiation infrared microspectroscopies, for different drug concentrations (2-8 μM) at 48 h exposure. Multivariate data analysis was applied (unsupervised PCA), unveiling drug- and concentration-dependent effects: apart from discrimination between control and drug-treated cells, a clear separation was obtained for the different agents studied - mononuclear vs. polynuclear, and Pt(ii) vs. Pd(ii). Spectral biomarkers of drug action were identified, as well as the cellular response to the chemotherapeutic insult. The main effect of the tested compounds was found to be on DNA, lipids and proteins, the Pd(ii) agent having a more significant impact on proteins while its Pt(ii) homologue affected the cellular lipid content at lower concentrations, which suggests the occurrence of distinct and unconventional pathways of cytotoxicity for these dinuclear polyamine complexes. Raman and FTIR microspectroscopies were confirmed as powerful non-invasive techniques to obtain unique spectral signatures of the biochemical impact and physiological reaction of cells to anticancer agents
Effects of nilotinib on leukaemia cells using vibrational microspectroscopy and cell cloning
Over the last few years, both synchrotron-based FTIR (S-FTIR) and Raman microspectroscopies have helped to better understand the effects of drugs on cancer cells. However, cancer is a mixture of cells with different sensitivity/resistance to drugs. Furthermore, the effects of drugs on cells produce both chemical and morphological changes, the latter could affect the spectra of cells incubated with drugs. Here, we successfully cloned sensitive and resistant leukaemia cells to nilotinib, a drug used in the management of leukaemia. This allowed both the study of a more uniform population and the study of sensitive and resistant cells prior to the addition of the drug with both S-FTIR and Raman microspectroscopies. The incubation with nilotinib produced changes in the S-FTIR and Raman spectra of both sensitive and resistant clones to nilotinib. Principal component analysis was able to distinguish between cells incubated in the absence or presence of the drug, even in the case of resistant clones. The latter would confirm that the spectral differences between the so-called resistant clonal cells prior to and after adding a drug might reside on those more or less sensitive cells that have been able to remain alive when they were collected to be studied with S-FTIR or Raman microspectroscopies. The data presented here indicate that the methodology of cell cloning can be applied to different types of malignant cells. This should facilitate the identification of spectral biomarkers of sensitivity/resistance to drugs. The next step would be a better assessment of sensitivity/resistance of leukaemia cells from patients which could guide clinicians to better tailor treatments to each individual patient
- …