Three-dimensional scanless holographic optogenetics with temporal focusing (3D-SHOT).

Optical methods capable of manipulating neural activity with cellular resolution and millisecond precision in three dimensions will accelerate the pace of neuroscience research. Existing approaches for targeting individual neurons, however, fall short of these requirements. Here we present a new multiphoton photo-excitation method, termed three-dimensional scanless holographic optogenetics with temporal focusing (3D-SHOT), which allows precise, simultaneous photo-activation of arbitrary sets of neurons anywhere within the addressable volume of a microscope. This technique uses point-cloud holography to place multiple copies of a temporally focused disc matching the dimensions of a neurons cell body. Experiments in cultured cells, brain slices, and in living mice demonstrate single-neuron spatial resolution even when optically targeting randomly distributed groups of neurons in 3D. This approach opens new avenues for mapping and manipulating neural circuits, allowing a real-time, cellular resolution interface to the brain

Video summarization by group scoring

In this paper a new model for user-centered video summarization is presented. Involvement of more than one expert in generating the final video summary should be regarded as the main use case for this algorithm. This approach consists of three major steps. First, the video frames are scored by a group of operators. Next, these assigned scores are averaged to produce a singular value for each frame and lastly, the highest scored video frames alongside the corresponding audio and textual contents are extracted to be inserted into the summary. The effectiveness of this approach has been evaluated by comparing the video summaries generated by this system against the results from a number of automatic summarization tools that use different modalities for abstraction

Precise multimodal optical control of neural ensemble activity.

Understanding brain function requires technologies that can control the activity of large populations of neurons with high fidelity in space and time. We developed a multiphoton holographic approach to activate or suppress the activity of ensembles of cortical neurons with cellular resolution and sub-millisecond precision. Since existing opsins were inadequate, we engineered new soma-targeted (ST) optogenetic tools, ST-ChroME and IRES-ST-eGtACR1, optimized for multiphoton activation and suppression. Employing a three-dimensional all-optical read-write interface, we demonstrate the ability to simultaneously photostimulate up to 50 neurons distributed in three dimensions in a 550 × 550 × 100-µm3 volume of brain tissue. This approach allows the synthesis and editing of complex neural activity patterns needed to gain insight into the principles of neural codes

The logic of recurrent circuits in the primary visual cortex

Recurrent cortical activity sculpts visual perception by refining, amplifying or suppressing visual input. However, the rules that govern the influence of recurrent activity remain enigmatic. We used ensemble-specific two-photon optogenetics in the mouse visual cortex to isolate the impact of recurrent activity from external visual input. We found that the spatial arrangement and the visual feature preference of the stimulated ensemble and the neighboring neurons jointly determine the net effect of recurrent activity. Photoactivation of these ensembles drives suppression in all cells beyond 30 µm but uniformly drives activation in closer similarly tuned cells. In nonsimilarly tuned cells, compact, cotuned ensembles drive net suppression, while diffuse, cotuned ensembles drive activation. Computational modeling suggests that highly local recurrent excitatory connectivity and selective convergence onto inhibitory neurons explain these effects. Our findings reveal a straightforward logic in which space and feature preference of cortical ensembles determine their impact on local recurrent activity

Three-dimensional multi-site random access photostimulation (3D-MAP)

Optical control of neural ensemble activity is crucial for understanding brain function and disease, yet no technology can achieve optogenetic control of very large numbers of neurons at an extremely fast rate over a large volume. State-of-the-art multiphoton holographic optogenetics requires high-power illumination that only addresses relatively small populations of neurons in parallel. Conversely, one-photon holographic techniques can stimulate more neurons with two to three orders lower power, but with limited resolution or addressable volume. Perhaps most problematically, two-photon holographic optogenetic systems are extremely expensive and sophisticated which has precluded their broader adoption in the neuroscience community. To address this technical gap, we introduce a new one-photon light sculpting technique, three-dimensional multi-site random access photostimulation (3D-MAP), that overcomes these limitations by modulating light dynamically, both in the spatial and in the angular domain at multi-kHz rates. We use 3D-MAP to interrogate neural circuits in 3D and demonstrate simultaneous photostimulation and imaging of dozens of user-selected neurons in the intact mouse brain in vivo with high spatio-temporal resolution. 3D-MAP can be broadly adopted for high-throughput all-optical interrogation of brain circuits owing to its powerful combination of scale, speed, simplicity, and cost

A Comprehensive Optogenetic Pharmacology Toolkit for In Vivo Control of GABAA Receptors and Synaptic Inhibition

SummaryExogenously expressed opsins are valuable tools for optogenetic control of neurons in circuits. A deeper understanding of neural function can be gained by bringing control to endogenous neurotransmitter receptors that mediate synaptic transmission. Here we introduce a comprehensive optogenetic toolkit for controlling GABAA receptor-mediated inhibition in the brain. We developed a series of photoswitch ligands and the complementary genetically modified GABAA receptor subunits. By conjugating the two components, we generated light-sensitive versions of the entire GABAA receptor family. We validated these light-sensitive receptors for applications across a broad range of spatial scales, from subcellular receptor mapping to in vivo photo-control of visual responses in the cerebral cortex. Finally, we generated a knockin mouse in which the “photoswitch-ready” version of a GABAA receptor subunit genomically replaces its wild-type counterpart, ensuring normal receptor expression. This optogenetic pharmacology toolkit allows scalable interrogation of endogenous GABAA receptor function with high spatial, temporal, and biochemical precision

Small footprint optoelectrodes using ring resonators for passive light localization

The combination of electrophysiology and optogenetics enables the exploration of how the brain operates down to a single neuron and its network activity. Neural probes are in vivo invasive devices that integrate sensors and stimulation sites to record and manipulate neuronal activity with high spatiotemporal resolution. State-of-the-art probes are limited by tradeoffs involving their lateral dimension, number of sensors, and ability to access independent stimulation sites. Here, we realize a highly scalable probe that features three-dimensional integration of small-footprint arrays of sensors and nanophotonic circuits to scale the density of sensors per cross-section by one order of magnitude with respect to state-of-the-art devices. For the first time, we overcome the spatial limit of the nanophotonic circuit by coupling only one waveguide to numerous optical ring resonators as passive nanophotonic switches. With this strategy, we achieve accurate on-demand light localization while avoiding spatially demanding bundles of waveguides and demonstrate the feasibility with a proof-of-concept device and its scalability towards high-resolution and low-damage neural optoelectrodes