Social Scene Understanding: End-to-End Multi-Person Action Localization and Collective Activity Recognition

We present a unified framework for understanding human social behaviors in raw image sequences. Our model jointly detects multiple individuals, infers their social actions, and estimates the collective actions with a single feed-forward pass through a neural network. We propose a single architecture that does not rely on external detection algorithms but rather is trained end-to-end to generate dense proposal maps that are refined via a novel inference scheme. The temporal consistency is handled via a person-level matching Recurrent Neural Network. The complete model takes as input a sequence of frames and outputs detections along with the estimates of individual actions and collective activities. We demonstrate state-of-the-art performance of our algorithm on multiple publicly available benchmarks

A Novel Long-term, Multi-Channel and Non-invasive Electrophysiology Platform for Zebrafish.

Zebrafish are a popular vertebrate model for human neurological disorders and drug discovery. Although fecundity, breeding convenience, genetic homology and optical transparency have been key advantages, laborious and invasive procedures are required for electrophysiological studies. Using an electrode-integrated microfluidic system, here we demonstrate a novel multichannel electrophysiology unit to record multiple zebrafish. This platform allows spontaneous alignment of zebrafish and maintains, over days, close contact between head and multiple surface electrodes, enabling non-invasive long-term electroencephalographic recording. First, we demonstrate that electrographic seizure events, induced by pentylenetetrazole, can be reliably distinguished from eye or tail movement artifacts, and quantifiably identified with our unique algorithm. Second, we show long-term monitoring during epileptogenic progression in a scn1lab mutant recapitulating human Dravet syndrome. Third, we provide an example of cross-over pharmacology antiepileptic drug testing. Such promising features of this integrated microfluidic platform will greatly facilitate high-throughput drug screening and electrophysiological characterization of epileptic zebrafish