From Big Data to Big Displays: High-Performance Visualization at Blue Brain

Blue Brain has pushed high-performance visualization (HPV) to complement its HPC strategy since its inception in 2007. In 2011, this strategy has been accelerated to develop innovative visualization solutions through increased funding and strategic partnerships with other research institutions. We present the key elements of this HPV ecosystem, which integrates C++ visualization applications with novel collaborative display systems. We motivate how our strategy of transforming visualization engines into services enables a variety of use cases, not only for the integration with high-fidelity displays, but also to build service oriented architectures, to link into web applications and to provide remote services to Python applications.Comment: ISC 2017 Visualization at Scale worksho

Physically-based in silico light sheet microscopy for visualizing fluorescent brain models

We present a physically-based computational model of the light sheet fluorescence microscope (LSFM). Based on Monte Carlo ray tracing and geometric optics, our method simulates the operational aspects and image formation process of the LSFM. This simulated, in silico LSFM creates synthetic images of digital fluorescent specimens that can resemble those generated by a real LSFM, as opposed to established visualization methods producing visually-plausible images. We also propose an accurate fluorescence rendering model which takes into account the intrinsic characteristics of fluorescent dyes to simulate the light interaction with fluorescent biological specimen

A calcium-based plasticity model for predicting long-term potentiation and depression in the neocortex

Pyramidal cells (PCs) form the backbone of the layered structure of the neocortex, and plasticity of their synapses is thought to underlie learning in the brain. However, such long-term synaptic changes have been experimentally characterized between only a few types of PCs, posing a significant barrier for studying neocortical learning mechanisms. Here we introduce a model of synaptic plasticity based on data-constrained postsynaptic calcium dynamics, and show in a neocortical microcircuit model that a single parameter set is sufficient to unify the available experimental findings on long-term potentiation (LTP) and long-term depression (LTD) of PC connections. In particular, we find that the diverse plasticity outcomes across the different PC types can be explained by cell-type-specific synaptic physiology, cell morphology and innervation patterns, without requiring type-specific plasticity. Generalizing the model to in vivo extracellular calcium concentrations, we predict qualitatively different plasticity dynamics from those observed in vitro. This work provides a first comprehensive null model for LTP/LTD between neocortical PC types in vivo, and an open framework for further developing models of cortical synaptic plasticity.We thank Michael Hines for helping with synapse model implementation in NEURON; Mariana Vargas-Caballero for sharing NMDAR data; Veronica Egger for sharing in vitro data and for clarifications on the analysis methods; Jesper Sjöström for sharing in vitro data, helpful discussions, and feedback on the manuscript; Ralf Schneggenburger for helpful discussions and clarifications on the NMDAR calcium current model; Fabien Delalondre for helpful discussions; Francesco Casalegno and Taylor Newton for helpful discussion on model fitting; Daniel Keller for helpful discussions on the biophysics of synaptic plasticity; Natali Barros-Zulaica for helpful discussions on MVR modeling and generalization; Srikanth Ramaswamy, Michael Reimann and Max Nolte for feedback on the manuscript; Wulfram Gerstner and Guillaume Bellec for helpful discussions on synaptic plasticity modeling. This study was supported by funding to the Blue Brain Project, a research center of the École polytechnique fédérale de Lausanne, from the Swiss government’s ETH Board of the Swiss Federal Institutes of Technology. E.B.M. received additional support from the CHU Sainte-Justine Research Center (CHUSJRC), the Institute for Data Valorization (IVADO), Fonds de Recherche du Québec–Santé (FRQS), the Canada CIFAR AI Chairs Program, the Quebec Institute for Artificial Intelligence (Mila), and Google. R.B.P. and J.DF. received support from the Spanish “Ministerio de Ciencia e Innovación” (grant PGC2018-094307-B-I00). M.D. and I.S. were supported by a grant from the ETH domain for the Blue Brain Project, the Gatsby Charitable Foundation, and the Drahi Family Foundation

A Process for Digitizing and Simulating Biologically Realistic Oligocellular Networks Demonstrated for the Neuro-Glio-Vascular Ensemble

One will not understand the brain without an integrated exploration of structure and function, these attributes being two sides of the same coin: together they form the currency of biological computation. Accordingly, biologically realistic models require the re-creation of the architecture of the cellular components in which biochemical reactions are contained. We describe here a process of reconstructing a functional oligocellular assembly that is responsible for energy supply management in the brain and creating a computational model of the associated biochemical and biophysical processes. The reactions that underwrite thought are both constrained by and take advantage of brain morphologies pertaining to neurons, astrocytes and the blood vessels that deliver oxygen, glucose and other nutrients. Each component of this neuro-glio-vasculature ensemble (NGV) carries-out delegated tasks, as the dynamics of this system provide for each cell-type its own energy requirements while including mechanisms that allow cooperative energy transfers. Our process for recreating the ultrastructure of cellular components and modeling the reactions that describe energy flow uses an amalgam of state-of the-art techniques, including digital reconstructions of electron micrographs, advanced data analysis tools, computational simulations and in silico visualization software. While we demonstrate this process with the NGV, it is equally well adapted to any cellular system for integrating multimodal cellular data in a coherent framework

Reconstruction and simulation of neocortical microcircuitry

We present a first-draft digital reconstruction of the microcircuitry of somatosensory cortex of juvenile rat. The reconstruction uses cellular and synaptic organizing principles to algorithmically reconstruct detailed anatomy and physiology from sparse experimental data. An objective anatomical method defines a neocortical volume of 0.29 ± 0.01 mm3 containing ∼31,000 neurons, and patch-clamp studies identify 55 layer-specific morphological and 207 morpho-electrical neuron subtypes. When digitally reconstructed neurons are positioned in the volume and synapse formation is restricted to biological bouton densities and numbers of synapses per connection, their overlapping arbors form ∼8 million connections with ∼37 million synapses. Simulations reproduce an array of in vitro and in vivo experiments without parameter tuning. Additionally, we find a spectrum of network states with a sharp transition from synchronous to asynchronous activity, modulated by physiological mechanisms. The spectrum of network states, dynamically reconfigured around this transition, supports diverse information processing strategies

In Silico Brain Imaging Physically-plausible Methods for Visualizing Neocortical Microcircuitry

The recent years have witnessed growing interest in the power of scientific visualization for simulation-based neuroscience. The research presented in this thesis develops methods to generate physically-realistic visualizations of neocortical models reconstructed by the Blue Brain Project, a pioneering endeavor that uses a simulation-based approach to build large-scale, biologically-detailed digital reconstructions of neocortical microcircuitry. The project has established a domain-specific framework to visualize hybrid representations of these neocortical models, which it uses to evaluate their structure, composition and dynamics. The current framework offers naive, optical emission-only models that oversimplify light-tissue interaction and ignore other computationally expensive phenomena such as absorption, scattering and fluorescence. The methods presented in this dissertation overcome these limitations, making it possible to visualize neocortical models on a physically-plausible basis, taking into account the intrinsic optical properties of cortical tissue and the spectroscopic characteristics of its fluorescent structures. This requires rigorous optical models that accurately simulate light interaction with cortical tissue, and accurate volumetric models of the tissue itself which reflect its optical properties during simulation. We present an efficient framework for creating high fidelity large-scale volumetric models of neocortical microcircuitry that govern the way in which light is distributed in cortical tissue. These models are reconstructed in two steps: first, we build piecewise watertight mesh models of neocortical neurons from their morphological skeletons. Then, we apply solid voxelization to the meshes to build volumetric models. We also present two novel optical models for simulating light interaction with fluorescent structures in low- and highly-scattering volumes. These optical models are integrated into a high level framework that simulates the imaging pipelines of transmitted light brightfield, widefield epi-fluorescence and light-sheet fluorescence microscopes. It is based on the principles of geometric optics and Monte Carlo ray tracing. Afterwards, we exploit this framework to render in silico realistic microscopic images resembling those created by the actual instruments. In conclusion, we generalize the concept of physically-based simulation of brain imaging modalities and review the computational models required to simulate fMRI

High Performance GPU-Based Fourier Volume Rendering

Fourier volume rendering (FVR) is a significant visualization technique that has been used widely in digital radiography. As a result of its O(N2log⁡N) time complexity, it provides a faster alternative to spatial domain volume rendering algorithms that are O(N3) computationally complex. Relying on the Fourier projection-slice theorem, this technique operates on the spectral representation of a 3D volume instead of processing its spatial representation to generate attenuation-only projections that look like X-ray radiographs. Due to the rapid evolution of its underlying architecture, the graphics processing unit (GPU) became an attractive competent platform that can deliver giant computational raw power compared to the central processing unit (CPU) on a per-dollar-basis. The introduction of the compute unified device architecture (CUDA) technology enables embarrassingly-parallel algorithms to run efficiently on CUDA-capable GPU architectures. In this work, a high performance GPU-accelerated implementation of the FVR pipeline on CUDA-enabled GPUs is presented. This proposed implementation can achieve a speed-up of 117x compared to a single-threaded hybrid implementation that uses the CPU and GPU together by taking advantage of executing the rendering pipeline entirely on recent GPU architectures

High Fidelity Visualization of Large Scale Digitally Reconstructed Brain Circuitry with Signed Distance Functions

We explore a first proof-of-concept application for visualizing large scale digitally reconstructed brain circuitry using signed distance functions. The significance of our method is demonstrated in comparison with using implicit geometry that is limited to provide the natural look of neurons or explicit geometry that requires huge amounts of memory and has limited scalability with larger circuits

Bio-physically plausible visualization of highly scattering fluorescent neocortical models for in silico experimentation

Background: We present a visualization pipeline capable of accurate rendering of highly scattering fluorescent neocortical neuronal models. The pipeline is mainly developed to serve the computational neurobiology community. It allows the scientists to visualize the results of their virtual experiments that are performed in computer simulations, or in silico. The impact of the presented pipeline opens novel avenues for assisting the neuroscientists to build biologically accurate models of the brain. These models result from computer simulations of physical experiments that use fluorescence imaging to understand the structural and functional aspects of the brain. Due to the limited capabilities of the current visualization workflows to handle fluorescent volumetric datasets, we propose a physically-based optical model that can accurately simulate light interaction with fluorescent-tagged scattering media based on the basic principles of geometric optics and Monte Carlo path tracing. We also develop an automated and efficient framework for generating dense fluorescent tissue blocks from a neocortical column model that is composed of approximately 31000 neurons. Results: Our pipeline is used to visualize a virtual fluorescent tissue block of 50 mu m(3) that is reconstructed from the somatosensory cortex of juvenile rat. The fluorescence optical model is qualitatively analyzed and validated against experimental emission spectra of different fluorescent dyes from the Alexa Fluor family. Conclusion: We discussed a scientific visualization pipeline for creating images of synthetic neocortical neuronal models that are tagged virtually with fluorescent labels on a physically-plausible basis. The pipeline is applied to analyze and validate simulation data generated from neuroscientific in silico experiments