Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is critical for protecting online user experiences but very challenging due to their "partial-label" nature. Common practice is to create a simulator which simulates the online environment for the problem at hand and then run an algorithm against this simulator. However, creating simulator itself is often difficult and modeling bias is usually unavoidably introduced. In this paper, we introduce a \emph{replay} methodology for contextual bandit algorithm evaluation. Different from simulator-based approaches, our method is completely data-driven and very easy to adapt to different applications. More importantly, our method can provide provably unbiased evaluations. Our empirical results on a large-scale news article recommendation dataset collected from Yahoo! Front Page conform well with our theoretical results. Furthermore, comparisons between our offline replay and online bucket evaluation of several contextual bandit algorithms show accuracy and effectiveness of our offline evaluation method.Comment: 10 pages, 7 figures, revised from the published version at the WSDM 2011 conferenc

Conceptual definition of a high voltage power supply test facility

NASA Lewis Research Center is presently developing a 60 GHz traveling wave tube for satellite cross-link communications. The operating voltage for this new tube is - 20 kV. There is concern about the high voltage insulation system and NASA is planning a space station high voltage experiment that will demonstrate both the 60 GHz communications and high voltage electronics technology. The experiment interfaces, requirements, conceptual design, technology issues and safety issues are determined. A block diagram of the high voltage power supply test facility was generated. It includes the high voltage power supply, the 60 GHz traveling wave tube, the communications package, the antenna package, a high voltage diagnostics package and a command and data processor system. The interfaces with the space station and the attached payload accommodations equipment were determined. A brief description of the different subsystems and a discussion of the technology development needs are presented

Time-Explicit Simulation of Wave Interaction in Optical Waveguide Crossings at Large Angles

The time-explicit finite-difference time-domain method is used to simulate wave interaction in optical waveguide crossings at large angles. The wave propagation at the intersecting structure is simulated by time stepping the discretized form of the Maxwell’s time dependent curl equations. The power distribution characteristics of the intersections are obtained by extracting the guided-mode amplitudes from these simulated total field data. A physical picture of power flow in the intersection is also obtained from the total field solution; this provides insights into the switching behavior and the origin of the radiations

A Contextual-Bandit Approach to Personalized News Article Recommendation

Personalized web services strive to adapt their services (advertisements, news articles, etc) to individual users by making use of both content and user information. Despite a few recent advances, this problem remains challenging for at least two reasons. First, web service is featured with dynamically changing pools of content, rendering traditional collaborative filtering methods inapplicable. Second, the scale of most web services of practical interest calls for solutions that are both fast in learning and computation. In this work, we model personalized recommendation of news articles as a contextual bandit problem, a principled approach in which a learning algorithm sequentially selects articles to serve users based on contextual information about the users and articles, while simultaneously adapting its article-selection strategy based on user-click feedback to maximize total user clicks. The contributions of this work are three-fold. First, we propose a new, general contextual bandit algorithm that is computationally efficient and well motivated from learning theory. Second, we argue that any bandit algorithm can be reliably evaluated offline using previously recorded random traffic. Finally, using this offline evaluation method, we successfully applied our new algorithm to a Yahoo! Front Page Today Module dataset containing over 33 million events. Results showed a 12.5% click lift compared to a standard context-free bandit algorithm, and the advantage becomes even greater when data gets more scarce.Comment: 10 pages, 5 figure

Analysis and Evaluation of Victorian Reform in General Damages for Personal Injury under the Tort of Negligence

This article examines the current legislative structures in Victoria for compensating non-economic losses for personal injuries under the tort of negligence. It first provides a background on the tort of negligence in general and damages for non-economic losses in particular. It then outlines the changes that have swept through Victoria and in the rest of Australia for comparative purposes. This article offers a critique of the rationale and justification for those changes, analyses the implications of the changes at both Victorian and Commonwealth levels across the public, professional and product liability areas, and concludes with a discussion of the overall effect of the Victorian reforms

Quantum-implemented selective reconstruction of high-resolution images

This paper proposes quantum image reconstruction. Input-triggered selection of an image among many stored ones, and its reconstruction if the input is occluded or noisy, has been simulated by a computer program implementable in a real quantum-physical system. It is based on the Hopfield associative net; the quantum-wave implementation bases on holography. The main limitations of the classical Hopfield net are much reduced with the new, original -- quantum-optical -- implementation. Image resolution can be almost arbitrarily increased.Comment: 4 pages, 15 figures, essential

Near-ionization-threshold emission in atomic gases driven by intense sub-cycle pulses

We study theoretically the dipole radiation of a hydrogen atom driven by an intense sub-cycle pulse. The time-dependent Schr\"odinger equation for the system is solved by ab initio calculation to obtain the dipole response. Remarkably, a narrowband emission lasting longer than the driving pulse appears at a frequency just above the ionization threshold. An additional calculation using the strong field approximation also recovers this emission, which suggests that it corresponds to the oscillation of nearly-bound electrons that behave similarly to Rydberg electrons. The predicted phenomenon is unique to ultrashort driving pulses but not specific to any particular atomic structure.Comment: 8 pages, 2 figure

Translation inhibition by rocaglates is independent of eIF4E phosphorylation status

Rocaglates are natural products that inhibit protein synthesis in eukaryotes and exhibit antineoplastic activity. In vitro biochemical assays, affinity chromatography experiments coupled with mass spectrometry analysis, and in vivo genetic screens have identified eukaryotic initiation factor (eIF) 4A as a direct molecular target of rocaglates. eIF4A is the RNA helicase subunit of eIF4F, a complex that mediates cap-dependent ribosome recruitment to mRNA templates. The eIF4F complex has been implicated in tumor initiation and maintenance through elevated levels or increased phosphorylation status of its cap-binding subunit, eIF4E, thus furthering the interest toward developing rocaglates as antineoplastic agents. Recent experiments have indicated that rocaglates also interact with prohibitins 1 and 2, proteins implicated in c-Raf-MEK-ERK signaling. Because increased ERK signaling stimulates eIF4E phosphorylation status, rocaglates are also expected to inhibit eIF4E phosphorylation status, a point that has not been thoroughly investigated. It is currently unknown whether the effects on translation observed with rocaglates are solely through eIF4A inhibition or also a feature of blocking eIF4E phosphorylation. Here, we show that rocaglates inhibit translation through an eIF4E phosphorylation-independent mechanism.P50 GM067041 - NIGMS NIH HHS; R01 GM073855 - NIGMS NIH HHS; GM-067041 - NIGMS NIH HHS; MOP-106530 - Canadian Institutes of Health Researc

System identification and structural control on the JPL Phase B testbed

The primary objective of NASA's CSI program at JPL is to develop and demonstrate the CSI technology required to achieve high precision structural stability on large complex optical class spacecraft. The focus mission for this work is an orbiting interferometer telescope. Toward the realization of such a mission, a series of evolutionary testbed structures are being constructed. The JPL's CSI Phase B testbed is the second structure constructed in this series which is designed to study the pathlength control problem of the optical train of a stellar interferometer telescope mounted on a large flexible structure. A detailed description of this testbed can be found. This paper describes our efforts in the first phase of active structural control experiments of Phase B testbed using the active control approach where a single piezoelectric active member is used as an actuation device and the measurements include both colocated and noncolocated sensors. Our goal for this experiment is to demonstrate the feasibility of active structural control using both colocated and noncolocated measurements by means of successive control design and loop closing. More specifically, the colocated control loop was designed and closed first to provide good damping improvement over the frequency range of interest. The noncolocated controller was then designed with respect to a partially controlled structure to further improve the performance. Based on our approach, experimental closed-loop results have demonstrated significant performance improvement with excellent stability margins

GOES dynamic propagation of attitude

The spacecraft in the next series of Geostationary Operational Environmental Satellites (GOES-Next) are Earth pointing and have 5-year mission lifetimes. Because gyros can be depended on only for a few years of continuous use, they will be turned off during routine operations. This means attitude must, at times, be determined without benefit of gyros and, often, using only Earth sensor data. To minimize the interruption caused by dumping angular momentum, these spacecraft have been designed to reduce the environmental torque acting on them and incorporate an adjustable solar trim tab for fine adjustment. A new support requirement for GOES-Next is that of setting the solar trim tab. Optimizing its setting requires an estimate of the unbalanced torque on the spacecraft. These two requirements, determining attitude without gyros and estimating the external torque, are addressed by replacing or supplementing the gyro propagation with a dynamic one, that is, one that integrates the rigid body equations of motion. By processing quarter-orbit or longer batches, this approach takes advantage of roll-yaw coupling to observe attitude completely without Sun sensor data. Telemetered momentum wheel speeds are used as observations of the unbalanced external torques. GOES-Next provides a unique opportunity to study dynamic attitude propagation. The geosynchronous altitude and adjustable trim tab minimize the external torque and its uncertainty, making long-term dynamic propagation feasible. This paper presents the equations for dynamic propagation, an analysis of the environmental torques, and an estimate of the accuracies obtainable with the proposed method