The Hanabi Challenge: A New Frontier for AI Research

From the early days of computing, games have been important testbeds for studying how well machines can do sophisticated decision making. In recent years, machine learning has made dramatic advances with artificial agents reaching superhuman performance in challenge domains like Go, Atari, and some variants of poker. As with their predecessors of chess, checkers, and backgammon, these game domains have driven research by providing sophisticated yet well-defined challenges for artificial intelligence practitioners. We continue this tradition by proposing the game of Hanabi as a new challenge domain with novel problems that arise from its combination of purely cooperative gameplay with two to five players and imperfect information. In particular, we argue that Hanabi elevates reasoning about the beliefs and intentions of other agents to the foreground. We believe developing novel techniques for such theory of mind reasoning will not only be crucial for success in Hanabi, but also in broader collaborative efforts, especially those with human partners. To facilitate future research, we introduce the open-source Hanabi Learning Environment, propose an experimental framework for the research community to evaluate algorithmic advances, and assess the performance of current state-of-the-art techniques.Comment: 32 pages, 5 figures, In Press (Artificial Intelligence

Nitric Oxide Enhances Desiccation Tolerance of Recalcitrant Antiaris toxicaria Seeds via Protein S-Nitrosylation and Carbonylation

The viability of recalcitrant seeds is lost following stress from either drying or freezing. Reactive oxygen species (ROS) resulting from uncontrolled metabolic activity are likely responsible for seed sensitivity to drying. Nitric oxide (NO) and the ascorbate-glutathione cycle can be used for the detoxification of ROS, but their roles in the seed response to desiccation remain poorly understood. Here, we report that desiccation induces rapid accumulation of H2O2, which blocks recalcitrant Antiaris toxicaria seed germination; however, pretreatment with NO increases the activity of antioxidant ascorbate-glutathione pathway enzymes and metabolites, diminishes H2O2 production and assuages the inhibitory effects of desiccation on seed germination. Desiccation increases the protein carbonylation levels and reduces protein S-nitrosylation of these antioxidant enzymes; these effects can be reversed with NO treatment. Antioxidant protein S-nitrosylation levels can be further increased by the application of S-nitrosoglutathione reductase inhibitors, which further enhances NO-induced seed germination rates after desiccation and reduces desiccation-induced H2O2 accumulation. These findings suggest that NO reinforces recalcitrant seed desiccation tolerance by regulating antioxidant enzyme activities to stabilize H2O2 accumulation at an appropriate concentration. During this process, protein carbonylation and S-nitrosylation patterns are used as a specific molecular switch to control antioxidant enzyme activities

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Ranking agencies under moral hazard

We provide rankings across uncertain outputs generated by agents functioning within the Principal-Agent paradigm. For agents who are identical except for their productivity, a necessary (but not sufficient) condition for an agent to be preferred is that her output dominates that of lower agents in the sense of First Degree Stochastic Dominance (FDSD) at every level of effort. Sufficient conditions are based on Blackwell's ranking of information systems and involves a characterization of FDSD using stochastic matrices. Our conditions for ranking outputs extends earlier results concerning the value of information within the agency framework. We also show how our techniques can be adapted to rank agents even if the first-order approach for determining optimal contracts fails to hold.

2nd International Conference on Cognitive Radio Oriented Wireless Networks and Communications, CrownCom

peer-reviewedThe demand for frequency spectrum and diversity of wireless devices accessing this spectrum depends upon the time of day, the characteristics of a frequency band, and the geographical location of the observer/wireless device. This paper highlights the value of employing a novel dynamic spectrum access technology using a highly reconfigurable spectrum access scheme with excellent frequency diversity properties. We name this robust scheme selective subcarrier multi-carrier code division multiple access (SS-MC-CDMA). This paper contains three main contributions. Firstly, the reconfigurability options in a physical layer (PHY) using MC-CDMA and the flexibility in system design of a cognitive radio are presented. Secondly, an application of the novel SS-MC-CDMA system in a dynamic spectrum access (DSA) scenario is developed in order to indicate the value and potential of this system. Finally, based on this scenario, we present some initial key results from both simulation and real-world experiments

Exploring the reconfigurability options of multi-carrier CDMA in cognitive radio systems

The ever-increasing demands for access to frequency spectrum and more efficient methods of using this spectrum involving multi-carrier techniques are driving the development of reconfigurable and cognitive wireless devices. The potential for, and the need to accommodate the potentially time-varying entropy in these wireless systems presents several design and implementation challenges. However, significant opportunities for innovation extending from the wireless terminal implementation to the business and market models also exist. This paper focuses on the physical (PHY) and medium-access control (MAC) layer issues of these emerging systems, highlighting the following three main contributions: 1. An introduction to reconfigurable multi-carrier code division multiple access (MC-CDMA) 2. An exploration of the use of reconfigurable MC-CDMA and its impact on the design of the physical (PHY) and medium access control (MAC) layers in a cognitive radio context. 3. An overview of the practical design and development considerations of this novel system which is being implemented on a real cognitive radio development testbed

Study designs for passing sight distance requirements. Final report.

Federal Highway Administration, Office of Safety and Traffic Operations Research and Development, McLean, Va.Mode of access: Internet.Author corporate affiliation: Bellomo-McGee, Inc., Vienna, Va.Report covers the period Oct 1990-Sept 1991Subject code: CCJSubject code: CGDSubject code: GHESubject code: RCBDLSubject code: WOB*CSubject code: YE

Annexin A5 is the Most Abundant Membrane-Associated Protein in Stereocilia but is Dispensable for Hair-Bundle Development and Function

The phospholipid- and Ca2+-binding protein annexin A5 (ANXA5) is the most abundant membrane-associated protein of ~P23 mouse vestibular hair bundles, the inner ear’s sensory organelle. Using quantitative mass spectrometry, we estimated that ANXA5 accounts for ~15,000 copies per stereocilium, or ~2% of the total protein there. Although seven other annexin genes are expressed in mouse utricles, mass spectrometry showed that none were present at levels near ANXA5 in bundles and none were upregulated in stereocilia of Anxa5−/− mice. Annexins have been proposed to mediate Ca2+-dependent repair of membrane lesions, which could be part of the repair mechanism in hair cells after noise damage. Nevertheless, mature Anxa5−/− mice not only have normal hearing and balance function, but following noise exposure, they are identical to wild-type mice in their temporary or permanent changes in hearing sensitivity. We suggest that despite the unusually high levels of ANXA5 in bundles, it does not play a role in the bundle’s key function, mechanotransduction, at least until after two months of age in the cochlea and six months of age in the vestibular system. These results reinforce the lack of correlation between abundance of a protein in a specific compartment or cellular structure and its functional significance

System and method for light assisted friction stir processing and welding of metallic and non-metallic materials

PatentAn apparatus for use in a friction stir operation, such as friction stir welding (FSW) or friction stir processing (FSP). The apparatus may have a rotating tool adapted to be plunged into a material, where the material is susceptible to being softened by heating. The rotating tool may further be adapted to be advanced along a surface of the material. An optical energy generating subsystem may be used to heat a portion of the material using optical energy as the tool is advanced along the material