Implementing Racing AI using Q-Learning and Steering Behaviours

Artificial intelligence has become a fundamental component of modern computer games as developers are producing ever more realistic experiences. This is particularly true of the racing game genre in which AI plays a fundamental role. Reinforcement learning (RL) techniques, notably Q-Learning (QL), have been growing as feasible methods for implementing AI in racing games in recent years. The focus of this research is on implementing QL to create a policy which the AI agents to utilise in a racing game using the Unity 3D game engine. QL is used (offline) to teach the agent appropriate throttle values around each part of the circuit whilst the steering is handled using a predefined racing line. Two variations of the QL algorithm were implemented to examine their effectiveness. The agents also make use of Steering Behaviours (including obstacle avoidance) to ensure that they can adapt their movements in real-time against other agents and players. Initial experiments showed that both types performed well and produced competitive lap times when compared to a player

Reactions to vocational interest test feedback as related to style of feedback report and authenticity of information.

Dept. of Psychology. Paper copy at Leddy Library: Theses & Major Papers - Basement, West Bldg. / Call Number: Thesis1976 .T78. Source: Masters Abstracts International, Volume: 40-07, page: . Thesis (M.A.)--University of Windsor (Canada), 1976

Testing the neutrality of matter by acoustic means in a spherical resonator

New measurements to test the neutrality of matter by acoustic means are reported. The apparatus is based on a spherical capacitor filled with gaseous SF$_6$ excited by an oscillating electric field. The apparatus has been calibrated measuring the electric polarizability. Assuming charge conservation in the $\beta$ decay of the neutron, the experiment gives a limit of $\epsilon_\text{p-e}\lesssim1\cdot10^{-21}$ for the electron-proton charge difference, the same limit holding for the charge of the neutron. Previous measurements are critically reviewed and found incorrect: the present result is the best limit obtained with this technique

Changes in undergraduate student alcohol consumption as they progress through university

BACKGROUND: Unhealthy alcohol use amongst university students is a major public health concern. Although previous studies suggest a raised level of consumption amongst the UK student population there is little consistent information available about the pattern of alcohol consumption as they progress through university. The aim of the current research was to describe drinking patterns of UK full-time undergraduate students as they progress through their degree course. METHOD: Data were collected over three years from 5895 undergraduate students who began their studies in either 2000 or 2001. Longitudinal data (i.e. Years 1–3) were available from 225 students. The remaining 5670 students all responded to at least one of the three surveys (Year 1 n = 2843; Year 2 n = 2219; Year 3 n = 1805). Results: Students reported consuming significantly more units of alcohol per week at Year 1 than at Years 2 or 3 of their degree. Male students reported a higher consumption of units of alcohol than their female peers. When alcohol intake was classified using the Royal College of Physicians guidelines [1] there was no difference between male and females students in terms of the percentage exceeding recommended limits. Compared to those who were low level consumers students who reported drinking above low levels at Year 1 had at least 10 times the odds of continuing to consume above low levels at year 3. Students who reported higher levels of drinking were more likely to report that alcohol had a negative impact on their studies, finances and physical health. Consistent with the reduction in units over time students reported lower levels of negative impact during Year 3 when compared to Year 1. CONCLUSION: The current findings suggest that student alcohol consumption declines over their undergraduate studies; however weekly levels of consumption at Year 3 remain high for a substantial number of students. The persistence of high levels of consumption in a large population of students suggests the need for effective preventative and treatment interventions for all year groups

Primary or secondary? A dichotomy of the strontium isotope anomalies in the Ediacaran carbonates of Saudi Arabia

Secular variation of 87Sr/86Sr in carbonate strata has been widely used in regional and global chemostratigraphic correlations. Typically, diagenesis results in higher 87Sr/86Sr signals relative to their primary composition due to the alteration by Rb-rich fluids and radiogenic decay of 87Rb to 87Sr. Surprisingly, 87Sr/86Sr values in the Ediacaran limestones from Saudi Arabia (from 0.7029 to 0.7059) are significantly lower than typical Ediacaran seawater values (mostly from 0.7080 to 0.7090) based on a global compilation. Understanding the origin of these anomalies is important insofar as early macrofossils are preserved in these strata. Two hypotheses have been independently evaluated in this study. The first hypothesis shows a low temperature scenario with isolated oceans or lakes in proximity to a mafic source. The second hypothesis is characterized by a high temperature scenario with profound overprints by juvenile hydrothermal fluids. Integrated Sr and Nd isotope data reveal that the 87Sr/86Sr anomalies are closely coupled with positive εNd(t = 560 Ma) values (up to +4.1). Clear covariations between 87Sr/86Sr, εNd, TOC, δ13Ccarb, δ13Corg, and δ18Ocarb were found. Based on multiple lines of petrographic, field, and geochemical evidence, the second hypothesis (i.e., hydrothermal alteration by juvenile fluids) is preferred in this study. Thermogenic breakdown of organic matter in host sediments may have caused the increasingly low TOC abundance and high δ13Corg signals of the residual organic matter. We argue that the concept that the Ediacaran biotic radiation took place in an isolated lake environment should be treated with caution. These remarkably low 87Sr/86Sr signals have neither temporal nor biogeochemical significance. Sr isotope chemostratigraphy in this particular region may not be a reliable tool for stratigraphic correlations

Growth Dynamics of Australia's Polar Dinosaurs

Analysis of bone microstructure in ornithopod and theropod dinosaurs from Victoria, Australia, documents ontogenetic changes, providing insight into the dinosaurs' successful habitation of Cretaceous Antarctic environments. Woven-fibered bone tissue in the smallest specimens indicates rapid growth rates during early ontogeny. Later ontogeny is marked by parallel-fibered tissue, suggesting reduced growth rates approaching skeletal maturity. Bone microstructure similarities between the ornithopods and theropods, including the presence of LAGs in each group, suggest there is no osteohistologic evidence supporting the hypothesis that polar theropods hibernated seasonally. Results instead suggest high-latitude dinosaurs had growth trajectories similar to their lower-latitude relatives and thus, rapid early ontogenetic growth and the cyclical suspensions of growth inherent in the theropod and ornithopod lineages enabled them to successfully exploit polar regions

The role of acid-base imbalance in statin-induced myotoxicity

Disturbances in acid-base balance, such as acidosis and alkalosis, have potential to alter the pharmacological and toxicological outcomes of statin therapy. Statins are commonly prescribed for elderly patients who have multiple co-morbidities such as diabetes mellitus, cardiovascular and renal diseases. These patients are at risk of developing acid-base imbalance. In the present study, the effect of disturbances in acid-base balance on the inter-conversion of simvastatin and pravastatin between lactone and hydroxy acid forms have been investigated in physiological buffers, human plasma and cell culture medium over pH ranging from 6.8 to 7.8. The effects of such inter-conversion on cellular uptake and myotoxicity of statins were assessed in vitro using C2C12 skeletal muscle cells under conditions relevant to acidosis, alkalosis and physiological pH. Results indicate that the conversion of the lactone forms of simvastatin and pravastatin to the corresponding hydroxy acid is strongly pH-dependent. At physiological and alkaline pH, substantial proportions of simvastatin lactone (~ 87% and 99%, respectively) and pravastatin lactone (~ 98% and 99%, respectively) were converted to the active hydroxy acid forms after 24 hours of incubation at 37 °C. At acidic pH, conversion occurs to a lower extent, resulting in greater proportion of statin remaining in the more lipophilic lactone form. However, pH alteration did not influence the conversion of the hydroxy acid forms of simvastatin and pravastatin to the corresponding lactones. Furthermore, acidosis has been shown to hinder the metabolism of the lactone form of statins by inhibiting hepatic microsomal enzyme activities. Lipophilic simvastatin lactone was found to be more cytotoxic to undifferentiated and differentiated skeletal muscle cells compared to more hydrophilic simvastatin hydroxy acid, pravastatin lactone and pravastatin hydroxy acid. Enhanced cytotoxicity of statins was observed under acidic conditions and is attributed to increased cellular uptake of the more lipophilic lactone or unionized hydroxy acid form. Consequently, our results suggest that co-morbidities associated with acid-base imbalance can play a substantial role in the development and potentiation of statin-induced myotoxicity

Impact of CO₂ impurity on CO₂ compression, liquefaction and transportation

Abstract The impurities present in carbon dioxide (CO2) streams for Carbon Capture and Storage (CCS) schemes are extremely important for CO2 pipeline and ship transportation affecting, for instance, the range of operation, safety considerations, fracture, cracking, corrosion control, dispersion in the event of a release, fluid density, operating pressure and temperature and the quantity of CO2 that can be transported. The range and levels of potential impurities present in captured CO2 from CO2 capture facilities will differ between sources and also between the capture technologies installed at the CO2 emission sources. However, the potential CO2 specifications that could enter the transport and storage systems, particularly from industrial sources, remain relatively under-researched. Consequently, the effect of these potential impurities in CO2 streams on CO2 transportation also needs to be understood. This paper summarises the main findings of an IEAGHG study, “Impact of CO2 Impurity on CO2 Compression, Liquefaction and Transportation”, commissioned to identify potential impurities and address the consequences of their impact on CO2 transportation