2,798 research outputs found

    Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

    Full text link
    During sleep and awake rest, the hippocampus replays sequences of place cells that have been activated during prior experiences. These have been interpreted as a memory consolidation process, but recent results suggest a possible interpretation in terms of reinforcement learning. The Dyna reinforcement learning algorithms use off-line replays to improve learning. Under limited replay budget, a prioritized sweeping approach, which requires a model of the transitions to the predecessors, can be used to improve performance. We investigate whether such algorithms can explain the experimentally observed replays. We propose a neural network version of prioritized sweeping Q-learning, for which we developed a growing multiple expert algorithm, able to cope with multiple predecessors. The resulting architecture is able to improve the learning of simulated agents confronted to a navigation task. We predict that, in animals, learning the world model should occur during rest periods, and that the corresponding replays should be shuffled.Comment: Living Machines 2018 (Paris, France

    Schoolbus driver performance can be improved with driver training, safety incentivisation, and vehicle roadworthy modifications

    Get PDF
    In South Africa (SA), the school transport industry provides millions of children with a means of travelling to and from school. The industry has, however, been reported to be plagued by widespread safety concerns. The consequent road traffic incidents have often been attributed to driver factors, including driving in excess of legal speeds or at inappropriate speeds; driving while under the influence of alcohol, while sleepy or fatigued; or driving without using protective equipment for vehicle occupants. There are currently very few SA interventions that specifically target this important industry role-player. The Safe Travel to School Programme was recently implemented by a national child safety agency, with a focus on driver road safety awareness, defensive driver training, eye-testing, vehicle roadworthy inspections with selected upgrades, incentives for safe performance, and implementation of a vehicle telematics tracking system with regular, individual driving behaviour information updates. This quasi-experimental study offers an evaluation of the initial impact on safety performance of this telematics-based driver and vehicle safety intervention in terms of speeding, acceleration, braking, cornering, and time-of-day driving, and compares the school transport driver performance with that of general motorists. Despite concerns that some school transport vehicles are used for multiple purposes outside of school transport duties, at night, and for longer distances, overall these vehicles recorded lower percentages of speeding, lower harsh braking, and lower average harsh cornering and acceleration than general driversInstitute for Social and Health Studies (ISHS

    Schoolbus driver performance can be improved with driver training, safety incentivisation, and vehicle roadworthy modifications

    Get PDF
    In South Africa (SA), the school transport industry provides millions of children with a means of travelling to and from school. The industry has, however, been reported to be plagued by widespread safety concerns. The consequent road traffic incidents have often been attributed to driver factors, including driving in excess of legal speeds or at inappropriate speeds; driving while under the influence of alcohol, while sleepy or fatigued; or driving without using protective equipment for vehicle occupants. There are currently very few SA interventions that specifically target this important industry role-player. The Safe Travel to School Programme was recently implemented by a national child safety agency, with a focus on driver road safety awareness, defensive driver training, eye- testing, vehicle roadworthy inspections with selected upgrades, incentives for safe performance, and implementation of a vehicle telematics tracking system with regular, individual driving behaviour information updates. This quasi-experimental study offers an evaluation of the initial impact on safety performance of this telematics-based driver and vehicle safety intervention in terms of speeding, acceleration, braking, cornering, and time-of-day driving, and compares the school transport driver performance with that of general motorists. Despite concerns that some school transport vehicles are used for multiple purposes outside of school transport duties, at night, and for longer distances, overall these vehicles recorded lower percentages of speeding, lower harsh braking, and lower average harsh cornering and acceleration than general drivers

    Schoolbus driver performance can be improved with driver training, safety incentivisation, and vehicle roadworthy modifications

    Get PDF
    In South Africa (SA), the school transport industry provides millions of children with a means of travelling to and from school. The industry has, however, been reported to be plagued by widespread safety concerns. The consequent road traffic incidents have often been attributed to driver factors, including driving in excess of legal speeds or at inappropriate speeds; driving while under the influence of alcohol, while sleepy or fatigued; or driving without using protective equipment for vehicle occupants. There are currently very few SA interventions that specifically target this important industry role-player. The Safe Travel to School Programme was recently implemented by a national child safety agency, with a focus on driver road safety awareness, defensive driver training, eye- testing, vehicle roadworthy inspections with selected upgrades, incentives for safe performance, and implementation of a vehicle telematics tracking system with regular, individual driving behaviour information updates. This quasi-experimental study offers an evaluation of the initial impact on safety performance of this telematics-based driver and vehicle safety intervention in terms of speeding, acceleration, braking, cornering, and time-of-day driving, and compares the school transport driver performance with that of general motorists. Despite concerns that some school transport vehicles are used for multiple purposes outside of school transport duties, at night, and for longer distances, overall these vehicles recorded lower percentages of speeding, lower harsh braking, and lower average harsh cornering and acceleration than general drivers

    First Dinosaur Tracks from the Arabian Peninsula

    Get PDF
    Background: The evolutionary history of Mesozoic terrestrial vertebrates from the Arabian Peninsula is virtually unknown. Despite vast exposures of rocky outcrops, only a handful of fossils have yet been described from the region. Here we report a multi-taxon dinosaur track assemblage near Madar village, 47 km north of Sana’a, Republic of Yemen. This represents the first dinosaur tracksite from the Arabian Peninsula, and the only multi-taxon dinosaur ichnosite in the Middle East. Methodology/Findings: Measurements were taken directly from trackway impressions, following standard ichnological conventions. The presence of bipedal trackmakers is evidenced by a long series of pes imprints preserving smoothly rounded posterior margins, no evidence of a hallux, bluntly rounded digit tips and digital divarication angles characteristic of ornithopod dinosaurs. Nearby, eleven parallel quadrupedal trackways document a sauropod herd that included large and small individuals traveling together. Based on the morphology of manus impressions along with a narrow-gauged stance, the quadrupedal trackways were made by non-titanosauriform neosauropods. Additional isolated tracks and trackways of sauropod and ornithopod dinosaurs are preserved nearby. Conclusions/Significance: Taken together, these discoveries present the most evocative window to date into the evolutionary history of dinosaurs of the Arabian Peninsula. Given the limited Mesozoic terrestrial record from the region, this discovery is of both temporal and geographic significance, and massive exposures of similarly-aged outcrops nearby offe

    Association of Low-Dose Exposure to Persistent Organic Pollutants with Global DNA Hypomethylation in Healthy Koreans

    Get PDF
    BACKGROUND: Global DNA methylation levels have been reported to be inversely associated with blood levels of persistent organic pollutants (POPs), xenobiotics that accumulate in adipose tissue. Whether these associations extend to a population with much lower concentrations of POPs is not known. OBJECTIVES: This study was performed to examine whether low-dose exposure to POPs was associated with global DNA hypomethylation in Koreans. METHODS: The amount of global DNA by hypomethylation was estimated by the percent 5-methyl-cytosine (%5-mC) in Alu and LINE-1 assays in 86 apparently healthy Koreans. Among various POPs, organochlorine (OC) pesticides, polychlorinated bipheryls (PCBs), and polybrominated dipherylethers (PBDEs) were measured. RESULTS: Most OC pesticides were inversely and significantly associated with %5-mC in the Alu assay, with correlation coefficients in the range -0.2 to -0.3 after adjusting for age, sex, body mass index, smoking, and alcohol. The strongest OC pesticide associations with %5-mC in the Alu assay were observed with oxychlordane, trans-nonachlor, and p,p'-dichlorodiphenyldichloroethylene. The correlation coefficient of age with %5-mC in the Alu assay was -0.24, similar to correlations of OC pesticides with %5-mC in the Alu assay. Most PCBs and PBDEs showed nonsignificant inverse trends with %5-mC in the Alu assay, but for some PCBs the U-shaped association was significant. On the other hand, POPs were not associated with %5-mC in the LINE-1 assay. CONCLUSIONS: We found that low-dose exposure to Pops, in particular OC pesticides, was associated with global DNA hypomethylation in apparently healthy Koreans.open1195102sciescopu

    Soundness and completeness proofs by coinductive methods

    Get PDF
    We show how codatatypes can be employed to produce compact, high-level proofs of key results in logic: the soundness and completeness of proof systems for variations of first-order logic. For the classical completeness result, we first establish an abstract property of possibly infinite derivation trees. The abstract proof can be instantiated for a wide range of Gentzen and tableau systems for various flavors of first-order logic. Soundness becomes interesting as soon as one allows infinite proofs of first-order formulas. This forms the subject of several cyclic proof systems for first-order logic augmented with inductive predicate definitions studied in the literature. All the discussed results are formalized using Isabelle/HOL’s recently introduced support for codatatypes and corecursion. The development illustrates some unique features of Isabelle/HOL’s new coinductive specification language such as nesting through non-free types and mixed recursion–corecursion
    corecore