Iterated games provide a framework to describe social interactions among
groups of individuals. Recent work stimulated by the discovery of
"zero-determinant" strategies has rapidly expanded our ability to analyze such
interactions. This body of work has primarily focused on games in which players
face a simple binary choice, to "cooperate" or "defect". Real individuals,
however, often exhibit behavioral diversity, varying their input to a social
interaction both qualitatively and quantitatively. Here we explore how access
to a greater diversity of behavioral choices impacts the evolution of social
dynamics in finite populations. We show that, in public goods games, some
two-choice strategies can nonetheless resist invasion by all possible
multi-choice invaders, even while engaging in relatively little punishment. We
also show that access to greater behavioral choice results in more "rugged "
fitness landscapes, with populations able to stabilize cooperation at multiple
levels of investment, such that choice facilitates cooperation when returns on
investments are low, but hinders cooperation when returns on investments are
high. Finally, we analyze iterated rock-paper-scissors games, whose
non-transitive payoff structure means unilateral control is difficult and
zero-determinant strategies do not exist in general. Despite this, we find that
a large portion of multi-choice strategies can invade and resist invasion by
strategies that lack behavioral diversity -- so that even well-mixed
populations will tend to evolve behavioral diversity.Comment: 26 pages, 4 figure