Real Time Strategy Games: A Reinforcement Learning Approach

AbstractIn this paper we proposed reinforcement learning algorithms with the generalized reward function. In our proposed method we use Q-learning1 and SARSA1 algorithms with generalised reward function to train the reinforcement learning agent. We evaluated the performance of our proposed algorithms on Real Time Strategy (RTS) game called BattleCity. There are two main advantages of having such an approach as compared to other works in RTS. (1) We can ignore the concept of a simulator which is often game specific and is usually hard coded in any type of RTS games (2) our system can learn from interaction with any opponents and quickly change the strategy according to the opponents and do not need any human traces as used in previous works

A comparative evaluation of frictional resistance and surface roughness of silver coated and uncoated stainless-steel bracket wire assembly- An in-vitro study

Silver ions act as potent antimicrobial agents. Silver coating of brackets and the archwires can help reduce the formation of white spot lesions and caries which is commonly seen with fixed orthodontic treatment. However, this may affect the friction and surface roughness of the bracket-wire assembly which in turn affects the biological tooth movement. MATERIAL AND METHODS: A total of 60 samples were included in the study which was divided into four groups. Group-1: * 15 silver coated 0.022 x 0.028" slot MBT prescription maxillary central incisor brackets * 15 silver coated 0.019 x 0.025" stainless-steel wires; Group-2: * 15 uncoated 0.022 x 0.028" slot MBT prescription maxillary central incisor brackets * 15 silver coated 0.019 x 0.025" stainless-steel wires; Group-3: * 15 silver coated 0.022 x 0.028" slot MBT prescription maxillary central incisor brackets * 15 uncoated 0.019 x 0.025" stainless-steel wires; Group-4: * 15 uncoated 0.022x0.028" slot MBT prescription maxillary central incisor brackets * 15 uncoated 0.019 x 0.025" stainless-steel wires. All brackets and wires used were of American Orthodontics, St. Paul, USA. Surface modification of wires and brackets was carried out using the Vacuum Coating Unit model by Thermal Vacuum Evaporation method with silver nanoparticles (10 nm size). The frictional resistance of all brackets and wires was checked using Universal Testing Machine. RESULTS: On comparison of maximum load, it was found that friction was highest in group 3, followed by group 1, group 4 and group 2. The mean difference between all groups was found to be statistically significant with a P value Group 1> Group 2> Group 3 *Wire roughness: Group 4> Group 1> Group 2> Group 3. CONCLUSIONS: This study concluded that friction was least when only the wire was coated with silver and the bracket was uncoated and it was the most when the bracket was coated and the wire was uncoated. The surface roughness after the friction test was the least when the wire was uncoated. Key words:Silver nanoparticles, Frictional Resistance, Surface Roughness

Studies on pollen micro-morphology, pollen storage methods, and cross-compatibility among grape (Vitis spp.) genotypes

The knowledge of pollen morphology, suitable storage condition, and species compatibility is vital for a successful grapevine improvement programme. Ten grape genotypes from three different species, viz., Vitis vinifera L., Vitis parviflora Roxb., and Vitis champini Planc., were studied for their pollen structure and pollen storage with the objective of determining their utilization in grape rootstock improvement programs. Pollen morphology was examined through the use of a scanning electron microscope (SEM). The viability of the pollen was assessed using 2,3,5-triphenyltetrazolium chloride (TTC). In vitro pollen germination was investigated using the semi-solid medium with 10 % sucrose, 100 mg/L boric acid, and 300 mg/L calcium nitrate. The results revealed variations in pollen micro-morphology in 10 genotypes, with distinct pollen dimensions, shapes, and exine ornamentation. However, species-wise, no clear difference was found for these parameters. Pollen of V. parviflora Roxb. and Dogridge was acolporated and did not germinate. The remaining eight genotypes exhibited tricolporated pollen and showed satisfactory in vitro pollen germination. Storage temperature and duration interactions showed that, at room temperature, pollen of most of the grape genotypes can be stored for up to 1 day only with an acceptable pollen germination rate (>30 %). However, storage for up to 7 days was successfully achieved at 4 °C, except for ‘Pearl of Csaba’. The most effective storage conditions were found to be at −20 °C and −196 °C (in liquid N2), enabling pollen storage for a period of up to 30 days, and can be used for pollination to overcome the challenge of asynchronous flowering. Four interspecific combinations were studied for their compatibility, among which V. parviflora Roxb. × V. vinifera L. (Pusa Navrang) and V. parviflora Roxb. × V. champini Planc. (Salt Creek) showed high cross-compatibility, offering their potential use for grape rootstock breeding. However, V. parviflora Roxb. × V. vinifera L. (Male Hybrid) recorded the lowest compatibility index among studied crosses. In the case of self-pollinated flowers from V. parviflora Roxb. and V. parviflora Roxb. × V. champini Planc. (Dogridge), pollen failed to germinate on the stigma due to male sterility caused by acolporated pollen. As a result, the flowers of these genotypes functioned as females, which means they are ideal female parents for grape breeding without the need for the tedious process of emasculation