Beyond Ads: Sequential Decision-Making Algorithms in Law and Public Policy

We explore the promises and challenges of employing sequential decision-making algorithms - such as bandits, reinforcement learning, and active learning - in law and public policy. While such algorithms have well-characterized performance in the private sector (e.g., online advertising), their potential in law and the public sector remains largely unexplored, due in part to distinct methodological challenges of the policy setting. Public law, for instance, can pose multiple objectives, necessitate batched and delayed feedback, and require systems to learn rational, causal decision-making policies, each of which presents novel questions at the research frontier. We highlight several applications of sequential decision-making algorithms in regulation and governance, and discuss areas for needed research to render such methods policy-compliant, more widely applicable, and effective in the public sector. We also note the potential risks of such deployments and describe how sequential decision systems can also facilitate the discovery of harms. We hope our work inspires more investigation of sequential decision making in law and public policy, which provide unique challenges for machine learning researchers with tremendous potential for social benefit.Comment: Version 1 presented at Causal Inference Challenges in Sequential Decision Making: Bridging Theory and Practice, a NeurIPS 2021 Worksho

Deconvoluting heme biosynthesis to target blood-stage malaria parasites

Heme metabolism is central to blood-stage infection by the malaria parasite Plasmodium falciparum. Parasites retain a heme biosynthesis pathway but do not require its activity during infection of heme-rich erythrocytes, where they can scavenge host heme to meet metabolic needs. Nevertheless, heme biosynthesis in parasite-infected erythrocytes can be potently stimulated by exogenous 5-aminolevulinic acid (ALA), resulting in accumulation of the phototoxic intermediate protoporphyrin IX (PPIX). Here we use photodynamic imaging, mass spectrometry, parasite gene disruption, and chemical probes to reveal that vestigial host enzymes in the cytoplasm of Plasmodium-infected erythrocytes contribute to ALA-stimulated heme biosynthesis and that ALA uptake depends on parasite-established permeability pathways. We show that PPIX accumulation in infected erythrocytes can be harnessed for antimalarial chemotherapy using luminol-based chemiluminescence and combinatorial stimulation by low-dose artemisinin to photoactivate PPIX to produce cytotoxic reactive oxygen. This photodynamic strategy has the advantage of exploiting host enzymes refractory to resistance-conferring mutations. DOI: http://dx.doi.org/10.7554/eLife.09143.00

Performance of Sweetpotato for Bioregenerative Life Support

Sweetpotato was successfully grown to harvest maturity in a large-scale atmospherically-closed controlled environment chamber. Yield of edible biomass and capacity for contributing to air revitalization and water recovery were documented. Yield was slightly less than that found in smaller-scale studies, but this is not unusual (Wheeler 1999). Continued work is suggested to improve control of storage root initiation, bulking and vine growth

Razor clam to RoboClam: burrowing drag reduction mechanisms and their robotic adaptation

Estimates based on the strength, size, and shape of the Atlantic razor clam (Ensis directus) indicate that the animal's burrow depth should be physically limited to a few centimeters; yet razor clams can dig as deep as 70 cm. By measuring soil deformations around burrowing E. directus, we have found the animal reduces drag by contracting its valves to initially fail, and then fluidize, the surrounding substrate. The characteristic contraction time to achieve fluidization can be calculated directly from soil properties. The geometry of the fluidized zone is dictated by two commonly-measured geotechnical parameters: coefficient of lateral earth pressure and friction angle. Calculations using full ranges for both parameters indicate that the fluidized zone is a local effect, occurring between 1–5 body radii away from the animal. The energy associated with motion through fluidized substrate—characterized by a depth-independent density and viscosity—scales linearly with depth. In contrast, moving through static soil requires energy that scales with depth squared. For E. directus, this translates to a 10X reduction in the energy required to reach observed burrow depths. For engineers, localized fluidization offers a mechanically simple and purely kinematic method to dramatically reduce energy costs associated with digging. This concept is demonstrated with RoboClam, an E. directus-inspired robot. Using a genetic algorithm to find optimal digging kinematics, RoboClam has achieved localized fluidization burrowing performance comparable to that of the animal, with a linear energy-depth relationship, in both idealized granular glass beads and E. directus' native cohesive mudflat habitat.Battelle Memorial InstituteBluefin RoboticsChevron Corporatio

Multi-Substrate Burrowing Performance and Constitutive Modeling of RoboClam: A Biomimetic Robot Based on Razor Clams

The Atlantic razor clam (Ensis directus) reduces burrowing drag by using motions of its shell to fluidize a thin layer of substrate around its body. We have developed RoboClam, a robot that digs using the same mechanisms as Ensis, to explore how localized fluidization burrowing can be extended to engineering applications. In this work we present burrowing performance results of RoboClam in two distinctly different substrates: ideally granular 1mm soda lime glass beads and cohesive ocean mudflat soil. Using a genetic algorithm to optimize RoboClam’s kinematics, the machine was able to burrow in both substrates with a power law relationship between digging energy and depth of n = 1.17. Pushing through static soil has a theoretical energy-depth power law of n = 2, which means that Ensis-inspired burrowing motions can provide exponentially higher energy efficiency. We propose a theoretical constitutive model that describes how a fluidized region should form around a contracting body in virtually any type of saturated soil. The model predicts fluidization to be a relatively local effect, extending only two to three characteristic lengths away from the body, depending on friction angle and coefficient of lateral earth pressure, two commonly measured soil parameters.Battelle Memorial InstituteBluefin RoboticsChevron Corporatio

Surveillance guidelines for disease elimination: a case study of canine rabies

Surveillance is a critical component of disease control programmes but is often poorly resourced, particularly in developing countries lacking good infrastructure and especially for zoonoses which require combined veterinary and medical capacity and collaboration. Here we examine how successful control, and ultimately disease elimination, depends on effective surveillance. We estimated that detection probabilities of <0.1 are broadly typical of rabies surveillance in endemic countries and areas without a history of rabies. Using outbreak simulation techniques we investigated how the probability of detection affects outbreak spread, and outcomes of response strategies such as time to control an outbreak, probability of elimination, and the certainty of declaring freedom from disease. Assuming realistically poor surveillance (probability of detection <0.1), we show that proactive mass dog vaccination is much more effective at controlling rabies and no more costly than campaigns that vaccinate in response to case detection. Control through proactive vaccination followed by 2 years of continuous monitoring and vaccination should be sufficient to guarantee elimination from an isolated area not subject to repeat introductions. We recommend that rabies control programmes ought to be able to maintain surveillance levels that detect at least 5% (and ideally 10%) of all cases to improve their prospects of eliminating rabies, and this can be achieved through greater intersectoral collaboration. Our approach illustrates how surveillance is critical for the control and elimination of diseases such as canine rabies and can provide minimum surveillance requirements and technical guidance for elimination programmes under a broad-range of circumstances

Culture shapes how we look at faces

Background: Face processing, amongst many basic visual skills, is thought to be invariant across all humans. From as early as 1965, studies of eye movements have consistently revealed a systematic triangular sequence of fixations over the eyes and the mouth, suggesting that faces elicit a universal, biologically-determined information extraction pattern. Methodology/Principal Findings: Here we monitored the eye movements of Western Caucasian and East Asian observers while they learned, recognized, and categorized by race Western Caucasian and East Asian faces. Western Caucasian observers reproduced a scattered triangular pattern of fixations for faces of both races and across tasks. Contrary to intuition, East Asian observers focused more on the central region of the face. Conclusions/Significance: These results demonstrate that face processing can no longer be considered as arising from a universal series of perceptual events. The strategy employed to extract visual information from faces differs across cultures

Neurodevelopmental multimorbidity and educational outcomes of Scottish schoolchildren : A population-based record linkage cohort study

Data Availability: All health data are owned by the Information Services Division of NHS National Services Scotland (https://www.isdscotland.org), and all education data are owned by the ScotXed Unit, which is part of the Educational Analytical Services Division within the Learning and Justice Directorate of the Scottish Government (www2.gov.scot/Topics/Statistics/ScotXed). Interested researchers may apply at these sites for data access. Funding: The study was sponsored by Health Data Research UK (www.hdruk.ac.uk) (grant reference number MR/S003800/1) (MF) which is a joint investment led by the Medical Research Council, together with the National Institute for Health Research (England), the Chief Scientist Office (Scotland), Health and Care Research Wales, Health and Social Care Research and Development Division (Public Health Agency, Northern Ireland), the Engineering and Physical Sciences Research Council, the Economic and Social Research Council, the British Heart Foundation and Wellcome. There was additional funding from the Carnegie Trust for the Universities of Scotland (grant reference VAC007974) (EES) and an MRC Mental Health Data Pathfinder grant (grant reference MC_PC_17217) (MF, JPP, DK, SC).Peer reviewedPublisher PD