Move Forward and Tell: A Progressive Generator of Video Descriptions

We present an efficient framework that can generate a coherent paragraph to describe a given video. Previous works on video captioning usually focus on video clips. They typically treat an entire video as a whole and generate the caption conditioned on a single embedding. On the contrary, we consider videos with rich temporal structures and aim to generate paragraph descriptions that can preserve the story flow while being coherent and concise. Towards this goal, we propose a new approach, which produces a descriptive paragraph by assembling temporally localized descriptions. Given a video, it selects a sequence of distinctive clips and generates sentences thereon in a coherent manner. Particularly, the selection of clips and the production of sentences are done jointly and progressively driven by a recurrent network -- what to describe next depends on what have been said before. Here, the recurrent network is learned via self-critical sequence training with both sentence-level and paragraph-level rewards. On the ActivityNet Captions dataset, our method demonstrated the capability of generating high-quality paragraph descriptions for videos. Compared to those by other methods, the descriptions produced by our method are often more relevant, more coherent, and more concise.Comment: Accepted by ECCV 201

Effective Monte Carlo simulation on System-V massively parallel associative string processing architecture

We show that the latest version of massively parallel processing associative string processing architecture (System-V) is applicable for fast Monte Carlo simulation if an effective on-processor random number generator is implemented. Our lagged Fibonacci generator can produce $10^8$ random numbers on a processor string of 12K PE-s. The time dependent Monte Carlo algorithm of the one-dimensional non-equilibrium kinetic Ising model performs 80 faster than the corresponding serial algorithm on a 300 MHz UltraSparc.Comment: 8 pages, 9 color ps figures embedde

A model for Intelligent Random Access Memory architecture (IRAM): cellular automata algorithms on the Associative String Processing machine (ASTRA)

In the near future, the computer performance will be completely determined by how long it takes to access memory. There are bottle-necks in memory latency and memory-to processor interface bandwidth. The IRAM initiative could be the answer by putting Processor-In-Memory (PIM). Starting from the massively parallel processing concept, one reached a similar conclusion. The MPPC (Massively Parallel Processing Collaboration) project and the 8K processor ASTRA machine (Associative String Test bench for Research \& Applications) developed at CERN \cite{kuala} can be regarded as a forerunner of the IRAM concept. The computing power of the ASTRA machine, regarded as an IRAM with 64 one-bit processors on a 64$\times$64 bit-matrix memory chip machine, has been demonstrated by running statistical physics algorithms: one-dimensional stochastic cellular automata, as a simple model for dynamical phase transitions. As a relevant result for physics, the damage spreading of this model has been investigated

Segmental Spatiotemporal CNNs for Fine-grained Action Segmentation

Joint segmentation and classification of fine-grained actions is important for applications of human-robot interaction, video surveillance, and human skill evaluation. However, despite substantial recent progress in large-scale action classification, the performance of state-of-the-art fine-grained action recognition approaches remains low. We propose a model for action segmentation which combines low-level spatiotemporal features with a high-level segmental classifier. Our spatiotemporal CNN is comprised of a spatial component that uses convolutional filters to capture information about objects and their relationships, and a temporal component that uses large 1D convolutional filters to capture information about how object relationships change across time. These features are used in tandem with a semi-Markov model that models transitions from one action to another. We introduce an efficient constrained segmental inference algorithm for this model that is orders of magnitude faster than the current approach. We highlight the effectiveness of our Segmental Spatiotemporal CNN on cooking and surgical action datasets for which we observe substantially improved performance relative to recent baseline methods.Comment: Updated from the ECCV 2016 version. We fixed an important mathematical error and made the section on segmental inference cleare

Control of relative radiation pressure in optical traps : application to phagocytic membrane binding studies

We show how to control the relative radiation pressure and thereby the stable trap position of an optically trapped bead by variation of the mean incident axial photon momentum. The thermal position fluctuations of a trapped bead are recorded by a three-dimensional back focal plane interferometry. The interferometric detection signals are in agreement with predictions based on an extended Mie theory. Depending on the application, the unique and the linear range of such a detection system can be optimized by controlling the trap position of the bead. We use this method to investigate in three dimensions the binding of beads to membranes of living cells during phagocytosis. We found that independent of the bead coating (IgG, complement, LPS, avidin) the most frequent initial mechanical response of the cell was a downward pulling of the bead into the cell. The time delay between binding and response was on average 2 seconds

Recent Decisions

CHOICE OF LAW--WRONGFUL DEATH--GOVERNMENTAL-INTEREST ANALYSIS DETERMINES LAW APPLICABLE TO MEASURE OF DAMAGES IN CLAIMS ARISING FROM FOREIGN Air CRASH John Edison Drake =============== EUROPEAN COMMUNITIES--FREE MOVEMENT OF WORKERS--COURT OF JUSTICE SETS GUIDELINES FOR USE BY MEMBER STATES OF THE PUBLIC POLICY EXCEPTION IN ARTICLE 48 Heidi A. Rohrbach ================ TAX TREATIES--UNITED STATES MAY USE THE INTERNAL REVENUE CODE SUMMONING AUTHORITY TO OBTAIN DOMESTIC INFORMATION SOLELY TO AID A FOREIGN DOMESTIC TAX INVESTIGATION PURSUANT TO A TAX TREATY John R. Hellinger ============== TREATY INTERPRETATION--WARSAW CONVENTION-- PASSENGERS UNDERGOING SEARCH PREREQUISITE TO BOARDING ARE ENGAGED IN OPERATIONS OF EMBARKING Elizabeth Graeme Brownin

Stray Light Modeling of the James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM)

This paper describes an integrated stray light model of each Science Instrument (SI) in the Integrated Science Instrument Module (ISIM) of the James Webb Space Telescope (JWST) and the Optical Telescope Element Simulator (OSIM), the light source used to characterize the performance of ISIM in cryogenic-vacuum tests at the Goddard Space Flight Center (GSFC). We present three cases where this stray light model was integral to solving questions that arose during the testing campaign - 1) ghosting and coherent diffraction from hardware surfaces in the Near Infrared Imager and Slitless Spectrograph (NIRISS) GR700XD grism mode, 2) ghost spots in the Near Infrared Camera (NIRCam) GRISM modes, and 3) scattering from knife edges of the NIRCam focal plane array masks

Estrogen dependent expression of the receptor tyrosine kinase axl in normal and malignant human breast

Summary Background: Axl, a member of a family of receptor tyrosine kinases characterized by an extracellular domain resembling cell adhesion molecules and an intracellular conserved tyrosine kinase domain has been reported to induce cell proliferation and transformation. In mice, axl is expressed in the normal mammary gland and over-expressed in aggressive mammary tumors. Patients and methods: We have investigated the expression of axl immunohistochemically in 23 normal human breast samples and in 111 consecutive breast carcinomas. Expression of axl was correlated with tumour characteristics (lymph node involvement, stage, grade) and immunohistochemical expression of ER, PR, Ki-67 and c-erbB-2. Results: In normal tissue, axl localizes to the membrane of breast epithelial cells. Axl protein shows membrane associated staining in high correlation (P = 0.004) with the expression of the estrogen receptor (ER). Axl expression was found in a subset of breast carcinomas and was also correlated with high significance (P < 0.0001) with the presence of ER. Conclusion: Our results suggest that axl may serve as a mediator of estrogen stimulation preventing the completion of the breast epithelial life cycle and that estrogen induced axl expression may give a survival signal to cancerous cells, preventing them from dying through apoptosi

An optically actuated surface scanning probe

We demonstrate the use of an extended, optically trapped probe that is capable of imaging surface topography with nanometre precision, whilst applying ultra-low, femto-Newton sized forces. This degree of precision and sensitivity is acquired through three distinct strategies. First, the probe itself is shaped in such a way as to soften the trap along the sensing axis and stiffen it in transverse directions. Next, these characteristics are enhanced by selectively position clamping independent motions of the probe. Finally, force clamping is used to refine the surface contact response. Detailed analyses are presented for each of these mechanisms. To test our sensor, we scan it laterally over a calibration sample consisting of a series of graduated steps, and demonstrate a height resolution of ∼ 11 nm. Using equipartition theory, we estimate that an average force of only ∼ 140 fN is exerted on the sample during the scan, making this technique ideal for the investigation of delicate biological samples