Developmental Curiosity and Social Interaction in Virtual Agents

Infants explore their complex physical and social environment in an organized way. To gain insight into what intrinsic motivations may help structure this exploration, we create a virtual infant agent and place it in a developmentally-inspired 3D environment with no external rewards. The environment has a virtual caregiver agent with the capability to interact contingently with the infant agent in ways that resemble play. We test intrinsic reward functions that are similar to motivations that have been proposed to drive exploration in humans: surprise, uncertainty, novelty, and learning progress. These generic reward functions lead the infant agent to explore its environment and discover the contingencies that are embedded into the caregiver agent. The reward functions that are proxies for novelty and uncertainty are the most successful in generating diverse experiences and activating the environment contingencies. We also find that learning a world model in the presence of an attentive caregiver helps the infant agent learn how to predict scenarios with challenging social and physical dynamics. Taken together, our findings provide insight into how curiosity-like intrinsic rewards and contingent social interaction lead to dynamic social behavior and the creation of a robust predictive world model.Comment: 6 pages, 5 figures, 2 tables; accepted to CogSci 2023 with full paper publication in the proceeding

Restoring Rivers and Floodplains for Habitat and Flood Risk Reduction: Experiences in Multi-Benefit Floodplain Management From California and Germany

Conventional flood control has emphasized structural measures such as levees, reservoirs, and engineered channels—measures that typically simplify river channels and cut them off from their floodplain, both with adverse environmental consequences. Structural measures tend to be rigid and not easily adapted to increased flooding regimes resulting from environmental change. Such actions also limit the natural hydrologic benefits of floodplains such as storing floodwaters, improving water quality, providing habitat for invertebrates and fish during periods of inundation, and supporting a multitude of cultural services. As these benefits are more widely recognized, policies are being adopted to encourage projects that reduce flood risks and restore floodplain ecosystems, while acknowledging the social-ecological context. The number of such projects, however, remains small. We assessed four multi-benefit floodplain projects (two in California, United States, and two in Germany) and characterized their drivers, history, and measures implemented. In both United States cases, the dominant driver behind the project was flood risk reduction, and ecosystem restoration followed, in one case inadvertently, in the other as a requirement to receive a subsidy for a flood risk reduction project. One German case was motivated by ecosystem restoration, but it was more widely accepted because it also offered flood management benefits. The fourth case was conceived in terms of balanced goals of flood risk reduction, ecosystem restoration, and recreation. We conclude that projects that both reduce flood risk and restore ecosystems are clearly possible and often cost-effective, and that they could be more widely implemented. The principal barriers are often institutional and regulatory, rather than technical

Developmental Curiosity and Social Interaction in Virtual Agents

Infants explore their complex physical and social environment in an organized way. To gain insight into what intrinsic motivations may help structure this exploration, we create a virtual infant agent and place it in a developmentally-inspired 3D environment with no external rewards. The environment has a virtual caregiver agent with the capability to interact contingently with the infant agent in ways that resemble play. We test intrinsic reward functions that are similar to motivations that have been proposed to drive exploration in humans: surprise, uncertainty, novelty, and learning progress. These generic reward functions lead the infant agent to explore its environment and discover the contingencies that are embedded into the caregiver agent. The reward functions that are proxies for novelty and uncertainty are the most successful in generating diverse experiences and activating the environment contingencies. We also find that learning a world model in the presence of an attentive caregiver helps the infant agent learn how to predict scenarios with challenging social and physical dynamics. Taken together, our findings provide insight into how curiosity-like intrinsic rewards and contingent social interaction lead to dynamic social behavior and the creation of a robust predictive world model