Social choice theory, game theory, and positive political theory

We consider the relationships between the collective preference and non-cooperative game theory approaches to positive political theory. In particular, we show that an apparently decisive difference between the two approachesthat in sufficiently complex environments (e.g. high-dimensional choice spaces) direct preference aggregation models are incapable of generating any prediction at all, whereas non-cooperative game-theoretic models almost always generate predictionis indeed only an apparent difference. More generally, we argue that when modeling collective decisions there is a fundamental tension between insuring existence of well-defined predictions, a criterion of minimal democracy, and general applicability to complex environments; while any two of the three are compatible under either approach, neither collective preference nor non-cooperative game theory can support models that simultaneously satisfy all three desiderata

Text to 3D Scene Generation with Rich Lexical Grounding

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object categories and language that identifies them. We introduce a dataset of 3D scenes annotated with natural language descriptions and learn from this data how to ground textual descriptions to physical objects. Our method successfully grounds a variety of lexical terms to concrete referents, and we show quantitatively that our method improves 3D scene generation over previous work using purely rule-based methods. We evaluate the fidelity and plausibility of 3D scenes generated with our grounding approach through human judgments. To ease evaluation on this task, we also introduce an automated metric that strongly correlates with human judgments.Comment: 10 pages, 7 figures, 3 tables. To appear in ACL-IJCNLP 201

Reasoning About Pragmatics with Neural Listeners and Speakers

We present a model for pragmatically describing scenes, in which contrastive behavior results from a combination of inference-driven pragmatics and learned semantics. Like previous learned approaches to language generation, our model uses a simple feature-driven architecture (here a pair of neural "listener" and "speaker" models) to ground language in the world. Like inference-driven approaches to pragmatics, our model actively reasons about listener behavior when selecting utterances. For training, our approach requires only ordinary captions, annotated _without_ demonstration of the pragmatic behavior the model ultimately exhibits. In human evaluations on a referring expression game, our approach succeeds 81% of the time, compared to a 69% success rate using existing techniques

Grounding semantics in robots for Visual Question Answering

In this thesis I describe an operational implementation of an object detection and description system that incorporates in an end-to-end Visual Question Answering system and evaluated it on two visual question answering datasets for compositional language and elementary visual reasoning

Multiscale Design for Solid Freeform Fabrication

One of the advantages of solid freeform fabrication is the ability to fabricate complex structures on multiple scales, from the macroscale features of an overall part to the mesoscale topology of its internal architecture and even the microstructure or composition of the constituent material. This manufacturing freedom poses the challenge of designing across these scales, especially when a part with designed mesostructure is part of a larger system with changing requirements that propagate across scales. A setbased multiscale design method is presented for coordinating design across scales and reducing iterative redesign of SFF parts and their mesostructures. The method is applied to design a miniature unmanned aerial vehicle system. The system is decomposed into disciplinary subsystems and constituent parts, including wings with honeycomb mesostructures that are topologically tailored for stiffness and strength and fabricated with selective laser sintering. The application illustrates how the design of freeform parts can be coordinated more efficiently with the design of parent systems.Mechanical Engineerin