Final Report on MITRE Evaluations for the DARPA Big Mechanism Program

This report presents the evaluation approach developed for the DARPA Big Mechanism program, which aimed at developing computer systems that will read research papers, integrate the information into a computer model of cancer mechanisms, and frame new hypotheses. We employed an iterative, incremental approach to the evaluation of the three phases of the program. In Phase I, we evaluated the ability of system and human teams ability to read-with-a-model to capture mechanistic information from the biomedical literature, integrated with information from expert curated biological databases. In Phase II we evaluated the ability of systems to assemble fragments of information into a mechanistic model. The Phase III evaluation focused on the ability of systems to provide explanations of experimental observations based on models assembled (largely automatically) by the Big Mechanism process. The evaluation for each phase built on earlier evaluations and guided developers towards creating capabilities for the new phase. The report describes our approach, including innovations such as a reference set (a curated data set limited to major findings of each paper) to assess the accuracy of systems in extracting mechanistic findings in the absence of a gold standard, and a method to evaluate model-based explanations of experimental data. Results of the evaluation and supporting materials are included in the appendices.Comment: 46 pages, 8 figure

Real-time stream processing in radio astronomy

A major challenge in modern radio astronomy is dealing with the massive data volumes generated by wide-bandwidth receivers. Such massive data rates are often too great for a single device to cope, and so processing must be split across multiple devices working in parallel. These devices must work in unison to process incoming data in real time, reduce the data volume to a manageable size, and output a science-ready data product. The aim of this chapter is to give a broad overview of how digital systems for radio telescopes are commonly implemented, with a focus on real-time stream processing over multiple compute devices.Comment: Chapter to appear in "Big Data in Radio Astronomy: Scientific Data Processing for Advanced Radio Telescopes

Trademarks, Certification Marks and Technical Standards

The names of many technical standards such as Wi-Fi, Bluetooth and DVD have become household terms known throughout the developed world. This chapter describes different approaches that have been taken with respect to the naming and legal protection of technical standards, ranging from those that are wholly unregulated to those that are administered under strict certification and compliance regimes. It concludes by questioning the need for aggressive protection of marks that exist largely to inform consumers about technical product features rather than the source of standards themselves

A learning approach to knowledge acquisition for intelligent interface agents

Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1993.Includes bibliographical references (leaves 99-100).by Robyn Arlene Edelson Kozierok.M.S