Self-critical Sequence Training for Image Captioning

Recently it has been shown that policy-gradient methods for reinforcement learning can be utilized to train deep end-to-end systems directly on non-differentiable metrics for the task at hand. In this paper we consider the problem of optimizing image captioning systems using reinforcement learning, and show that by carefully optimizing our systems using the test metrics of the MSCOCO task, significant gains in performance can be realized. Our systems are built using a new optimization approach that we call self-critical sequence training (SCST). SCST is a form of the popular REINFORCE algorithm that, rather than estimating a "baseline" to normalize the rewards and reduce variance, utilizes the output of its own test-time inference algorithm to normalize the rewards it experiences. Using this approach, estimating the reward signal (as actor-critic methods must do) and estimating normalization (as REINFORCE algorithms typically do) is avoided, while at the same time harmonizing the model with respect to its test-time inference procedure. Empirically we find that directly optimizing the CIDEr metric with SCST and greedy decoding at test-time is highly effective. Our results on the MSCOCO evaluation sever establish a new state-of-the-art on the task, improving the best result in terms of CIDEr from 104.9 to 114.7.Comment: CVPR 2017 + additional analysis + fixed baseline results, 16 page

The influence of wind forcing on the Chesapeake Bay buoyant coastal current

Author Posting. © American Meteorological Society, 2006. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 36 (2006): 1305-1316, doi:10.1175/JPO2909.1.Observations of the buoyant coastal current that flows southward from Chesapeake Bay are used to describe how the thickness, width, and propagation speed vary in response to changes in the along-shelf wind stress. Three basic regimes were observed depending on the strength of the wind. For weak wind stresses (from −0.02 to 0.02 Pa), the buoyant coastal current was relatively thin, the front slope was not steep, and the width was variable (1–20 km). For moderate downwelling (southward) wind stresses (0.02–0.07 Pa), wind-driven cross-shelf advection steepened the front, causing the plume to narrow and thicken. For stronger downwelling wind stresses (greater than 0.07 Pa), vertical mixing dominated, bulk Richardson numbers were approximately 0.25, isopycnals were nearly vertical, and the plume front widened but the plume width did not change. Plume thickness and width were normalized by the theoretical plume scales in the absence of wind forcing. Normalized plume thickness increased linearly from 1 to 2 as downwelling wind stresses increased from 0 to 0.2 Pa. Normalized plume widths were approximately 1 for downwelling wind stresses from 0.02 to 0.2 Pa. The observed along-shelf propagation speed of the plume was roughly equal to the sum of the theoretical propagation speed and the wind-driven along-shelf flow.This work was funded by the National Science Foundation under Grants OCE-0095059, OCE-0220773, OCE-92-21614, and OCE-96-33013

Seasonal variations in the circulation over the Middle Atlantic Bight continental shelf

Author Posting. © American Meteorological Society, 2008. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 38 (2008): 1486–1500, doi:10.1175/2007JPO3767.1.Fits of an annual harmonic to depth-average along-shelf current time series longer than 200 days from 27 sites over the Middle Atlantic Bight (MAB) continental shelf have amplitudes of a few centimeters per second. These seasonal variations are forced by seasonal variations in the wind stress and the cross-shelf density gradient. The component of wind stress that drives the along-shelf flow over most of the MAB mid- and outer shelf is oriented northeast–southwest, perpendicular to the major axis of the seasonal variation in the wind stress. Consequently, there is not a significant seasonal variation in the wind-driven along-shelf flow, except over the southern MAB shelf and the inner shelf of New England where the wind stress components forcing the along-shelf flow are north–south and east–west, respectively. The seasonal variation in the residual along-shelf flow, after removing the wind-driven component, has an amplitude of a few centimeters per second with maximum southwestward flow in spring onshore of the 60-m isobath and autumn offshore of the 60-m isobath. The spring maximum onshore of the 60-m isobath is consistent with the maximum river discharges in spring enhancing cross-shelf salinity gradients. The autumn maximum offshore of the 60-m isobath and a steady phase increase with water depth offshore of Cape Cod are both consistent with the seasonal variation in the cross-shelf temperature gradient associated with the development and destruction of a near-bottom pool of cold water over the mid and outer shelf (“cold pool”) due to seasonal variations in surface heat flux and wind stress.This research was funded by the Ocean Sciences Division of the National Science Foundation under Grants OCE-820773, OCE-841292, and OCE- 848961

The mean along-isobath heat and salt balances over the Middle Atlantic Bight continental shelf

Author Posting. © American Meteorological Society, 2010. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 40 (2010): 934-948, doi:10.1175/2009JPO4214.1.The mean heat and salt balances over the Middle Atlantic Bight continental shelf are investigated by testing the hypothesis that surface fluxes of heat or freshwater are balanced by along-isobath fluxes resulting from the mean, depth-averaged, along-isobath flow acting on the mean, depth-averaged, along-isobath temperature or salinity gradient. This hypothesized balance is equivalent in a Lagrangian frame to a column of water, for example, warming because of surface heating as it is advected southward along isobath by the mean flow. Mean depth-averaged temperatures increase from north to south along isobath at a rate of 2°C (1000 km)−1 at midshelf, which is consistent with the hypothesized balance and mean surface heat flux estimates from the 50-yr NCEP Reanalysis. However, mean surface heat flux estimates from the higher-resolution 20-yr Objectively Analyzed Air–Sea Fluxes (OAFlux) reanalysis are too small to balance the along-isobath heat flux divergence implying a cross-shelf heat flux convergence. It is unclear which surface heat flux estimate, NCEP or OAFlux, is more accurate. The cross-shelf heat flux convergence resulting from the mean cross-shelf circulation is too small to balance the along-isobath heat flux divergence. Mean depth-averaged salinities increase from north to south along isobath at a rate of 1 (psu) (1000 km)−1 at midshelf. Mean precipitation and evaporation rates nearly balance so that the net freshwater flux is too small by more than an order of magnitude to account for the observed along-isobath increase in salinity. The cross-shelf salt flux divergence resulting from the mean cross-shelf circulation has the wrong sign to balance the divergence in the along-isobath salt flux. These results imply there must be an onshore “eddy” salt flux resulting from the time-dependent current and salinity variability. The along-isobath temperature and salinity gradients compensate for each other so that the mean, depth-averaged, along-isobath density gradient is approximately zero. This suggests that there may be a feedback between the along-isobath density gradient and the onshore salt and heat fluxes that maintains the density gradient near zero.This work was funded by the National Science Foundation under Grants OCE-0220773, OCE-0241292, andOCE-0548961

Observations and a model of the mean circulation over the Middle Atlantic Bight continental shelf

Author Posting. © American Meteorological Society, 2008. This article is posted here by permission of American Meteorological Society for personal use, not for redistribution. The definitive version was published in Journal of Physical Oceanography 38 (2008): 1203–1221, doi:10.1175/2007JPO3768.1.Analyses of current time series longer than 200 days from 33 sites over the Middle Atlantic Bight continental shelf reveal a consistent mean circulation pattern. The mean depth-averaged flow is equatorward, alongshelf, and increases with increasing water depth from 3 cm s−1 at the 15-m isobath to 10 cm s−1 at the 100-m isobath. The mean cross-shelf circulation exhibits a consistent cross-shelf and vertical structure. The near-surface flow is typically offshore (positive, range −3 to 6 cm s−1). The interior flow is onshore and remarkably constant (−0.2 to −1.4 cm s−1). The near-bottom flow increases linearly with increasing water depth from −1 cm s−1 (onshore) in shallow water to 4 cm s−1 (offshore) at the 250-m isobath over the slope, with the direction reversal near the 50-m isobath. A steady, two-dimensional model (no along-isobath variations in the flow) reproduces the main features of the observed circulation pattern. The depth-averaged alongshelf flow is primarily driven by an alongshelf pressure gradient (sea surface slope of 3.7 × 10−8 increasing to the north) and an opposing mean wind stress that also drives the near-surface offshore flow. The alongshelf pressure gradient accounts for both the increase in the alongshelf flow with water depth and the geostrophic balance onshore flow in the interior. The increase in the near-bottom offshore flow with water depth is due to the change in the relative magnitude of the contributions from the geostrophic onshore flow that dominates in shallow water and the offshore flow driven by the bottom stress that dominates in deeper water.This research was funded by Ocean Sciences Division of the National Science Foundation under Grants OCE-820773, OCE-841292, and OCE-848961

The development of a network for community-based obesity prevention: the CO-OPS Collaboration

Background: Community-based interventions are a promising approach and an important component of a comprehensive response to obesity. In this paper we describe the Collaboration of COmmunity-based Obesity Prevention Sites (CO-OPS Collaboration) in Australia as an example of a collaborative network to enhance the quality and quantity of obesity prevention action at the community level. The core aims of the CO-OPS Collaboration are to: identify and analyse the lessons learned from a range of community-based initiatives aimed at tackling obesity, and; to identify the elements that make community-based obesity prevention initiatives successful and share the knowledge gained with other communities.Methods: Key activities of the collaboration to date have included the development of a set of Best Practice Principles and knowledge translation and exchange activities to promote the application (or use) of evidence, evaluation and analysis in practice.Results: The establishment of the CO-OPS Collaboration is a significant step toward strengthening action in this area, by bringing together research, practice and policy expertise to promote best practice, high quality evaluation and knowledge translation and exchange. Future development of the network should include facilitation of furtherevidence generation and translation drawing from process, impact and outcome evaluation of existing communitybased interventions.Conclusions: The lessons presented in this paper may help other networks like CO-OPS as they emerge around the globe. It is important that networks integrate with each other and share the experience of creating these networks.<br /

Low-Load High Volume Resistance Exercise Stimulates Muscle Protein Synthesis More Than High-Load Low Volume Resistance Exercise in Young Men

BACKGROUND: We aimed to determine the effect of resistance exercise intensity (%1 repetition maximum-1RM) and volume on muscle protein synthesis, anabolic signaling, and myogenic gene expression. METHODOLOGY/PRINCIPAL FINDINGS: Fifteen men (21+/-1 years; BMI=24.1+/-0.8 kg/m2) performed 4 sets of unilateral leg extension exercise at different exercise loads and/or volumes: 90% of repetition maximum (1RM) until volitional failure (90FAIL), 30% 1RM work-matched to 90%FAIL (30WM), or 30% 1RM performed until volitional failure (30FAIL). Infusion of [ring-13C6] phenylalanine with biopsies was used to measure rates of mixed (MIX), myofibrillar (MYO), and sarcoplasmic (SARC) protein synthesis at rest, and 4 h and 24 h after exercise. Exercise at 30WM induced a significant increase above rest in MIX (121%) and MYO (87%) protein synthesis at 4 h post-exercise and but at 24 h in the MIX only. The increase in the rate of protein synthesis in MIX and MYO at 4 h post-exercise with 90FAIL and 30FAIL was greater than 30WM, with no difference between these conditions; however, MYO remained elevated (199%) above rest at 24 h only in 30FAIL. There was a significant increase in AktSer473 at 24h in all conditions (P=0.023) and mTORSer2448 phosphorylation at 4 h post-exercise (P=0.025). Phosporylation of Erk1/2Tyr202/204, p70S6KThr389, and 4E-BP1Thr37/46 increased significantly (P<0.05) only in the 30FAIL condition at 4 h post-exercise, whereas, 4E-BP1Thr37/46 phosphorylation was greater 24 h after exercise than at rest in both 90FAIL (237%) and 30FAIL (312%) conditions. Pax7 mRNA expression increased at 24 h post-exercise (P=0.02) regardless of condition. The mRNA expression of MyoD and myogenin were consistently elevated in the 30FAIL condition. CONCLUSIONS/SIGNIFICANCE: These results suggest that low-load high volume resistance exercise is more effective in inducing acute muscle anabolism than high-load low volume or work matched resistance exercise modes

Graphical Models for Robust Speech Recognition in Adverse Environments

Robust speech recognition in acoustic environments that contain multiple speech sources and/or complex non-stationary noise is a difficult problem, but one of great practical interest. The formalism of probabilistic graphical models constitutes a relatively new and very powerful tool for better understanding and extending existing models, learning, and inference algorithms; and a bedrock for the creative, quasi-systematic development of new ones. In this thesis a collection of new graphical models and inference algorithms for robust speech recognition are presented. The problem of speech separation using multiple microphones is first treated. A family of variational algorithms for tractably combining multiple acoustic models of speech with observed sensor likelihoods is presented. The algorithms recover high quality estimates of the speech sources even when there are more sources than microphones, and have improved upon the state-of-the-art in terms of SNR gain by over 10 dB. Next the problem of background compensation in non-stationary acoustic environments is treated. A new dynamic noise adaptation (DNA) algorithm for robust noise compensation is presented, and shown to outperform several existing state-of-the-art front-end denoising systems on the new DNA + Aurora II and Aurora II-M extensions of the Aurora II task. Finally, the problem of speech recognition in speech using a single microphone is treated. The Iroquois system for multi-talker speech separation and recognition is presented. The system won the 2006 Pascal International Speech Separation Challenge, and amazingly, achieved super-human recognition performance on a majority of test cases in the task. The result marks a significant first in automatic speech recognition, and a milestone in computing.Ph

Robust Variational Speech Separation Using Fewer Microphones Than

A variational inference algorithm for robust speech separation, capable of recovering the underlying speech sources even in the case of more sources than microphone observations, is presented. The algorithm is based upon an generative probabilistic model that fuses time-delay of arrival (TDOA) information with prior information about the speakers and application, to produce an optimal estimate of the underlying speech sources. Simulation results are presented for the case of two, three and four underlying sources and two microphones observations corrupted by noise. The resulting SNR gains (24dB with two sources, 15dB with three sources, and 9dB with four sources) are significantly higher than previous speech separation techniques