Segmentation and Alignment of Speech and Sketching in a Design Environment

Sketches are commonly used in the early stages of design. Our previous system allows users to sketch mechanical systems that the computer interprets. However, some parts of the mechanical system might be too hard or too complicated to express in the sketch. Adding speech recognition to create a multimodal system would move us toward our goal of creating a more natural user interface. This thesis examines the relationship between the verbal and sketch input, particularly how to segment and align the two inputs. Toward this end, subjects were recorded while they sketched and talked. These recordings were transcribed, and a set of rules to perform segmentation and alignment was created. These rules represent the knowledge that the computer needs to perform segmentation and alignment. The rules successfully interpreted the 24 data sets that they were given

Multimodal Interactive DialOgue System

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student-submitted PDF version of thesis.Includes bibliographical references (p. 239-243).Interactions between people are typically conversational, multimodal, and symmetric. In conversational interactions, information flows in both directions. In multimodal interactions, people use multiple channels. In symmetric interactions, both participants communicate multimodally, with the integration of and switching between modalities basically effortless. In contrast, consider typical human-computer interaction. It is almost always unidirectional { we're telling the machine what to do; it's almost always unimodal (can you type and use the mouse simultaneously?); and it's symmetric only in the disappointing sense that when you type, it types back at you. There are a variety of things wrong with this picture. Perhaps chief among them is that if communication is unidirectional, it must be complete and unambiguous, exhaustively anticipating every detail and every misinterpretation. In brief, it's exhausting. This thesis examines the benefits of creating multimodal human-computer dialogues that employ sketching and speech, aimed initially at the task of describing early stage designs of simple mechanical devices. The goal of the system is to be a collaborative partner, facilitating design conversations. Two initial user studies provided key insights into multimodal communication: simple questions are powerful, color choices are deliberate, and modalities are closely coordinated. These observations formed the basis for our multimodal interactive dialogue system, or Midos. Midos makes possible a dynamic dialogue, i.e., one in which it asks questions to resolve uncertainties or ambiguities.(cont.) The benefits of a dialogue in reducing the cognitive overhead of communication have long been known. We show here that having the system able to ask questions is good, but for an unstructured task like describing a design, knowing what questions to ask is crucial. We describe an architecture that enables the system to accept partial information from the user, then request details it considers relevant, noticeably lowering the cognitive overhead of communicating. The multimodal questions Midos asks are in addition purposefully designed to use the same multimodal integration pattern that people exhibited in our study. Our evaluation of the system showed that Midos successfully engages the user in a dialogue and produces the same conversational features as our initial human-human conversation studies.by Aaron Daniel Adler.Ph.D

The Intriguing Effects of Substituents in the N-Phenethyl Moiety of Norhydromorphone: A Bifunctional Opioid from a Set of “Tail Wags Dog” Experiments

This work is licensed under a Creative Commons Attribution 4.0 International License.(−)-N-Phenethyl analogs of optically pure N-norhydromorphone were synthesized and pharmacologically evaluated in several in vitro assays (opioid receptor binding, stimulation of [35S]GTPγS binding, forskolin-induced cAMP accumulation assay, and MOR-mediated β-arrestin recruitment assays). “Body” and “tail” interactions with opioid receptors (a subset of Portoghese’s message-address theory) were used for molecular modeling and simulations, where the “address” can be considered the “body” of the hydromorphone molecule and the “message” delivered by the substituent (tail) on the aromatic ring of the N-phenethyl moiety. One compound, N-p-chloro-phenethynorhydromorphone ((7aR,12bS)-3-(4-chlorophenethyl)-9-hydroxy-2,3,4,4a,5,6-hexahydro-1H-4,12-methanobenzofuro[3,2-e]isoquinolin-7(7aH)-one, 2i), was found to have nanomolar binding affinity at MOR and DOR. It was a potent partial agonist at MOR and a full potent agonist at DOR with a δ/μ potency ratio of 1.2 in the ([35S]GTPγS) assay. Bifunctional opioids that interact with MOR and DOR, the latter as agonists or antagonists, have been reported to have fewer side-effects than MOR agonists. The p-chlorophenethyl compound 2i was evaluated for its effect on respiration in both mice and squirrel monkeys. Compound 2i did not depress respiration (using normal air) in mice or squirrel monkeys. However, under conditions of hypercapnia (using air mixed with 5% CO2), respiration was depressed in squirrel monkeys.NIDA grant P30 DA13429NIDA grant DA039997NIDA grant DA018151NIDA grant DA035857NIDA grant DA047574NIH Intramural Research Programs of the National Institute on Drug AbuseNational Institute of Alcohol Abuse and AlcoholismNIH Intramural Research Programs of the National Institute on Drug AbuseNIH Intramural Research Program through the Center for Information TechnologyNIH Intramural Research Programs of the National Institute on Drug Abus

Crop Pests and Predators Exhibit Inconsistent Responses to Surrounding Landscape Composition

The idea that noncrop habitat enhances pest control and represents a win–win opportunity to conserve biodiversity and bolster yields has emerged as an agroecological paradigm. However, while noncrop habitat in landscapes surrounding farms sometimes benefits pest predators, natural enemy responses remain heterogeneous across studies and effects on pests are inconclusive. The observed heterogeneity in species responses to noncrop habitat may be biological in origin or could result from variation in how habitat and biocontrol are measured. Here, we use a pest-control database encompassing 132 studies and 6,759 sites worldwide to model natural enemy and pest abundances, predation rates, and crop damage as a function of landscape composition. Our results showed that although landscape composition explained significant variation within studies, pest and enemy abundances, predation rates, crop damage, and yields each exhibited different responses across studies, sometimes increasing and sometimes decreasing in landscapes with more noncrop habitat but overall showing no consistent trend. Thus, models that used landscape-composition variables to predict pest-control dynamics demonstrated little potential to explain variation across studies, though prediction did improve when comparing studies with similar crop and landscape features. Overall, our work shows that surrounding noncrop habitat does not consistently improve pest management, meaning habitat conservation may bolster production in some systems and depress yields in others. Future efforts to develop tools that inform farmers when habitat conservation truly represents a win–win would benefit from increased understanding of how landscape effects are modulated by local farm management and the biology of pests and their enemies

Synthetic Biology Open Language (SBOL) Version 1.1.0

In this BioBricks Foundation Request for Comments (BBF RFC), we specify the Synthetic Biology Open Language (SBOL) Version 1.1.0 to enable the electronic exchange of information describing DNA components used in synthetic biology. We define: 1. the vocabulary, a set of preferred terms and 2. the core data model, a common computational representation

Heavy quarkonium: progress, puzzles, and opportunities

A golden age for heavy quarkonium physics dawned a decade ago, initiated by the confluence of exciting advances in quantum chromodynamics (QCD) and an explosion of related experimental activity. The early years of this period were chronicled in the Quarkonium Working Group (QWG) CERN Yellow Report (YR) in 2004, which presented a comprehensive review of the status of the field at that time and provided specific recommendations for further progress. However, the broad spectrum of subsequent breakthroughs, surprises, and continuing puzzles could only be partially anticipated. Since the release of the YR, the BESII program concluded only to give birth to BESIII; the $B$-factories and CLEO-c flourished; quarkonium production and polarization measurements at HERA and the Tevatron matured; and heavy-ion collisions at RHIC have opened a window on the deconfinement regime. All these experiments leave legacies of quality, precision, and unsolved mysteries for quarkonium physics, and therefore beg for continuing investigations. The plethora of newly-found quarkonium-like states unleashed a flood of theoretical investigations into new forms of matter such as quark-gluon hybrids, mesonic molecules, and tetraquarks. Measurements of the spectroscopy, decays, production, and in-medium behavior of c\bar{c}, b\bar{b}, and b\bar{c} bound states have been shown to validate some theoretical approaches to QCD and highlight lack of quantitative success for others. The intriguing details of quarkonium suppression in heavy-ion collisions that have emerged from RHIC have elevated the importance of separating hot- and cold-nuclear-matter effects in quark-gluon plasma studies. This review systematically addresses all these matters and concludes by prioritizing directions for ongoing and future efforts.Comment: 182 pages, 112 figures. Editors: N. Brambilla, S. Eidelman, B. K. Heltsley, R. Vogt. Section Coordinators: G. T. Bodwin, E. Eichten, A. D. Frawley, A. B. Meyer, R. E. Mitchell, V. Papadimitriou, P. Petreczky, A. A. Petrov, P. Robbe, A. Vair

The state of the Martian climate

60°N was +2.0°C, relative to the 1981–2010 average value (Fig. 5.1). This marks a new high for the record. The average annual surface air temperature (SAT) anomaly for 2016 for land stations north of starting in 1900, and is a significant increase over the previous highest value of +1.2°C, which was observed in 2007, 2011, and 2015. Average global annual temperatures also showed record values in 2015 and 2016. Currently, the Arctic is warming at more than twice the rate of lower latitudes

Multiethnic Genome-Wide Association Study of Diabetic Retinopathy Using Liability Threshold Modeling of Duration of Diabetes and Glycemic Control

Correction: Volume69, Issue6 Page1306-1306 DOI10.2337/db20-er06a Published JUN 2020To identify genetic variants associated with diabetic retinopathy (DR), we performed a large multiethnic genome-wide association study. Discovery included eight European cohorts (n = 3,246) and seven African American cohorts (n = 2,611). We meta-analyzed across cohorts using inverse-variance weighting, with and without liability threshold modeling of glycemic control and duration of diabetes. Variants with a P valuePeer reviewe