Deep Video Generation, Prediction and Completion of Human Action Sequences

Current deep learning results on video generation are limited while there are only a few first results on video prediction and no relevant significant results on video completion. This is due to the severe ill-posedness inherent in these three problems. In this paper, we focus on human action videos, and propose a general, two-stage deep framework to generate human action videos with no constraints or arbitrary number of constraints, which uniformly address the three problems: video generation given no input frames, video prediction given the first few frames, and video completion given the first and last frames. To make the problem tractable, in the first stage we train a deep generative model that generates a human pose sequence from random noise. In the second stage, a skeleton-to-image network is trained, which is used to generate a human action video given the complete human pose sequence generated in the first stage. By introducing the two-stage strategy, we sidestep the original ill-posed problems while producing for the first time high-quality video generation/prediction/completion results of much longer duration. We present quantitative and qualitative evaluation to show that our two-stage approach outperforms state-of-the-art methods in video generation, prediction and video completion. Our video result demonstration can be viewed at https://iamacewhite.github.io/supp/index.htmlComment: Under review for CVPR 2018. Haoye and Chunyan have equal contributio

Winner-take-all selection in a neural system with delayed feedback

We consider the effects of temporal delay in a neural feedback system with excitation and inhibition. The topology of our model system reflects the anatomy of the avian isthmic circuitry, a feedback structure found in all classes of vertebrates. We show that the system is capable of performing a `winner-take-all' selection rule for certain combinations of excitatory and inhibitory feedback. In particular, we show that when the time delays are sufficiently large a system with local inhibition and global excitation can function as a `winner-take-all' network and exhibit oscillatory dynamics. We demonstrate how the origin of the oscillations can be attributed to the finite delays through a linear stability analysis.Comment: 8 pages, 6 figure

Recovery from Mercury Contamination in the Second Songhua River, China

Mercury pollution in the Second Songhua River (SSR) was serious in the last century due to effluent from a chemical corporation. Effects of riverine self-purification on mercury removal were studied by comparing monitoring data of mercury concentrations varieties in water, sediment, and fish in the past, about 30 years. The present work suggested that a river of such a size like the SSR possessed the potential ability to recover from mercury pollution under the condition that mercury sources were cut off, though it needs a very long time, which might be several decades or even a century of years. During the 30 years with no effluent containing mercury input, total mercury (T-Hg) of water and sediment in some typical segments, mostly near the past effluent outlet, had decreased radically but still higher than the background values, though the decrease amplitudes were over 90% compared with that in 1975. T-Hg had decreased by more than 90% in most fishes, but some were still not suitable for consumption. Methylmercury concentrations (MeHg) of water, sediment, and fish were higher or close to the background levels in 2004. In the coming decades, the purification processes in the SSR would be steady and slow for a long period

Phytoplankton carbon fixation gene (RuBisCO) transcripts and air-sea CO2 flux in the Mississippi River plume

River plumes deliver large quantities of nutrients to oligotrophic oceans, often resulting in significant CO2 drawdown. To determine the relationship between expression of the major gene in carbon fixation (large subunit of ribulose-1,5-bisphosphate carboxylase/oxygenase, RuBisCO) and CO2 dynamics, we evaluated rbcL mRNA abundance using novel quantitative PCR assays, phytoplankton cell analyses, photophysiological parameters, and pCO2 in and around the Mississippi River plume (MRP) in the Gulf of Mexico. Lower salinity (30-32) stations were dominated by rbcL mRNA concentrations from heterokonts, such as diatoms and pelagophytes, which were at least an order of magnitude greater than haptophytes, a-Synechococcus or high-light Prochlorococcus. However, rbcL transcript abundances were similar among these groups at oligotrophic stations (salinity 34-36). Diatom cell counts and heterokont rbcL RNA showed a strong negative correlation to seawater pCO2. While Prochlorococcus cells did not exhibit a large difference between low and high pCO2 water, Prochlorococcus rbcL RNA concentrations had a strong positive correlation to pCO(2), suggesting a very low level of RuBisCO RNA transcription among Prochlorococcus in the plume waters, possibly due to their relatively poor carbon concentrating mechanisms (CCMs). These results provide molecular evidence that diatom/pelagophyte productivity is largely responsible for the large CO2 drawdown occurring in the MRP, based on the cooccurrence of elevated RuBisCO gene transcript concentrations from this group and reduced seawater pCO(2) levels. This may partly be due to efficient CCMs that enable heterokont eukaryotes such as diatoms to continue fixing CO2 in the face of strong CO2 drawdown. Our work represents the first attempt to relate in situ microbial gene expression to contemporaneous CO2 flux measurements in the ocean

Vagus nerve stimulation for epilepsy: A narrative review of factors predictive of response

\ua9 2024 The Author(s). Epilepsia published by Wiley Periodicals LLC on behalf of International League Against Epilepsy.Vagus nerve stimulation (VNS) is an established therapy for drug-resistant epilepsy. However, there is a lack of reliable predictors of VNS response in clinical use. The identification of factors predictive of VNS response is important for patient selection and stratification as well as tailored stimulation programming. We conducted a narrative review of the existing literature on prognostic markers for VNS response using clinical, demographic, biochemical, and modality-specific information such as from electroencephalography (EEG), magnetoencephalography, and magnetic resonance imaging (MRI). No individual marker demonstrated sufficient predictive power for individual patients, although several have been suggested, with some promising initial findings. Combining markers from underresearched modalities such as T1-weighted MRI morphometrics and EEG may provide better strategies for treatment optimization

Classical and Quantum Equations of Motion for a BTZ Black String in AdS Space

We investigate gravitational collapse of a $(3+1)$-dimensional BTZ black string in AdS space in the context of both classical and quantum mechanics. This is done by first deriving the conserved mass per unit length of the cylindrically symmetric domain wall, which is taken as the classical Hamiltonian of the black string. In the quantum mechanical context, we take primary interest in the behavior of the collapse near the horizon and near the origin (classical singularity) from the point of view of an infalling observer. In the absence of radiation, quantum effects near the horizon do not change the classical conclusions for an infalling observer, meaning that the horizon is not an obstacle for him/her. The most interesting quantum mechanical effect comes in when investigating near the origin. First, quantum effects are able to remove the classical singularity at the origin, since the wave function is non-singular at the origin. Second, the Schr\"odinger equation describing the behavior near the origin displays non-local effects, which depend on the energy density of the domain wall. This is manifest in that derivatives of the wavefunction at one point are related to the value of the wavefunction at some other distant point.Comment: 9 pages, 1 figure. Minor Clarification and corrections. Accepted for Publication in JHE