Incentivizing Exploration with Heterogeneous Value of Money

Recently, Frazier et al. proposed a natural model for crowdsourced exploration of different a priori unknown options: a principal is interested in the long-term welfare of a population of agents who arrive one by one in a multi-armed bandit setting. However, each agent is myopic, so in order to incentivize him to explore options with better long-term prospects, the principal must offer the agent money. Frazier et al. showed that a simple class of policies called time-expanded are optimal in the worst case, and characterized their budget-reward tradeoff. The previous work assumed that all agents are equally and uniformly susceptible to financial incentives. In reality, agents may have different utility for money. We therefore extend the model of Frazier et al. to allow agents that have heterogeneous and non-linear utilities for money. The principal is informed of the agent's tradeoff via a signal that could be more or less informative. Our main result is to show that a convex program can be used to derive a signal-dependent time-expanded policy which achieves the best possible Lagrangian reward in the worst case. The worst-case guarantee is matched by so-called "Diamonds in the Rough" instances; the proof that the guarantees match is based on showing that two different convex programs have the same optimal solution for these specific instances. These results also extend to the budgeted case as in Frazier et al. We also show that the optimal policy is monotone with respect to information, i.e., the approximation ratio of the optimal policy improves as the signals become more informative.Comment: WINE 201

Variations in Flight Patterns of European Corn Borer (Lepidoptera: Pyralidae) in New York

Seasonal flights of Ostrinia nubilalis (Hübner) were monitored in 1981, using blacklight traps in 28 locations in central and western New York state. Calendar date of peak catch and heat unit accumulations indicated the presence of both univoltine and bivoltine biotypes, although before this study, only the latter was assumed to be present in these regions. Both biotypes were evident at 16 of the 28 trapping sites. Trap catches during the last 5 years of a 15-year study (1967-1981), at a fixed location near Geneva, N. Y., indicated the recurrence of a univoltine population that had last been noted in this region before 1964. Losses due to larval contamination of processed snap beans are reported for 1979 and 1980. Growers of susceptible crops must be aware of local flights and the potential for shifts in peak moth emergence before insecticides are applie

Maslov Indices and Monodromy

We prove that for a Hamiltonian system on a cotangent bundle that is Liouville-integrable and has monodromy the vector of Maslov indices is an eigenvector of the monodromy matrix with eigenvalue 1. As a corollary the resulting restrictions on the monodromy matrix are derived.Comment: 6 page

Impact Ionization in ZnS

The impact ionization rate and its orientation dependence in k space is calculated for ZnS. The numerical results indicate a strong correlation to the band structure. The use of a q-dependent screening function for the Coulomb interaction between conduction and valence electrons is found to be essential. A simple fit formula is presented for easy calculation of the energy dependent transition rate.Comment: 9 pages LaTeX file, 3 EPS-figures (use psfig.sty), accepted for publication in PRB as brief Report (LaTeX source replaces raw-postscript file

Finite-element analysis of contact between elastic self-affine surfaces

Finite element methods are used to study non-adhesive, frictionless contact between elastic solids with self-affine surfaces. We find that the total contact area rises linearly with load at small loads. The mean pressure in the contact regions is independent of load and proportional to the rms slope of the surface. The constant of proportionality is nearly independent of Poisson ratio and roughness exponent and lies between previous analytic predictions. The contact morphology is also analyzed. Connected contact regions have a fractal area and perimeter. The probability of finding a cluster of area $a_c$ drops as $a_c^{-\tau}$ where $\tau$ increases with decreasing roughness exponent. The distribution of pressures shows an exponential tail that is also found in many jammed systems. These results are contrasted to simpler models and experiment.Comment: 13 pages, 15 figures. Replaced after changed in response to referee comments. Final two figures change

Topology and Bistability in liquid crystal devices

We study nematic liquid crystal configurations in a prototype bistable device - the Post Aligned Bistable Nematic (PABN) cell. Working within the Oseen-Frank continuum model, we describe the liquid crystal configuration by a unit-vector field, in a model version of the PABN cell. Firstly, we identify four distinct topologies in this geometry. We explicitly construct trial configurations with these topologies which are used as initial conditions for a numerical solver, based on the finite-element method. The morphologies and energetics of the corresponding numerical solutions qualitatively agree with experimental observations and suggest a topological mechanism for bistability in the PABN cell geometry

Q-systems, Heaps, Paths and Cluster Positivity

We consider the cluster algebra associated to the $Q$-system for $A_r$ as a tool for relating $Q$-system solutions to all possible sets of initial data. We show that the conserved quantities of the $Q$-system are partition functions for hard particles on particular target graphs with weights, which are determined by the choice of initial data. This allows us to interpret the simplest solutions of the Q-system as generating functions for Viennot's heaps on these target graphs, and equivalently as generating functions of weighted paths on suitable dual target graphs. The generating functions take the form of finite continued fractions. In this setting, the cluster mutations correspond to local rearrangements of the fractions which leave their final value unchanged. Finally, the general solutions of the $Q$-system are interpreted as partition functions for strongly non-intersecting families of lattice paths on target lattices. This expresses all cluster variables as manifestly positive Laurent polynomials of any initial data, thus proving the cluster positivity conjecture for the $A_r$ $Q$-system. We also give an alternative formulation in terms of domino tilings of deformed Aztec diamonds with defects.Comment: 106 pages, 38 figure