Ensemble-Based Deep Reinforcement Learning for Chatbots

Trainable chatbots that exhibit fluent and human-like conversations remain a big challenge in artificial intelligence. Deep Reinforcement Learning (DRL) is promising for addressing this challenge, but its successful application remains an open question. This article describes a novel ensemble-based approach applied to value-based DRL chatbots, which use finite action sets as a form of meaning representation. In our approach, while dialogue actions are derived from sentence clustering, the training datasets in our ensemble are derived from dialogue clustering. The latter aim to induce specialised agents that learn to interact in a particular style. In order to facilitate neural chatbot training using our proposed approach, we assume dialogue data in raw text only – without any manually-labelled data. Experimental results using chitchat data reveal that (1) near human-like dialogue policies can be induced, (2) generalisation to unseen data is a difficult problem, and (3) training an ensemble of chatbot agents is essential for improved performance over using a single agent. In addition to evaluations using held-out data, our results are further supported by a human evaluation that rated dialogues in terms of fluency, engagingness and consistency – which revealed that our proposed dialogue rewards strongly correlate with human judgements

Heterogeneous photocatalytic treatment of pharmaceutical micropollutants: Effects of wastewater effluent matrix and catalyst modifications

This study evaluates the applicability of TiO2-based photocatalysts for the treatment of pharmaceutical micropollutants in secondary wastewater effluent (SWE). Photolytic experiments using SWEs with different compositions demonstrated that the rates of photocatalytic degradation of acetaminophen and carbamazepine inversely correlated with the concentration of dissolved organic carbon (DOC), regardless of the type of applied light source and initial pharmaceutical concentration. The critical relevance of organic matter to the scavenging behavior of SWE was further verified by assessing the photocatalytic performance as a function of the concentrations of potential effluent-derived quenchers (i.e., NO3 -, Cl-, alkalinity, and humic acid). Kinetic comparison of the degradation of trace levels of pharmaceuticals (i.e., caffeine, cimetidine, propranolol, and sulfamethoxazole) using TiO2/UV-A, TiO2/UV-C, and H2O2/UV-C systems revealed that heterogeneous processes showed more significant performance reduction with increasing DOC concentration; this result indicates that organic matter plays dual roles in the scavenging activity of an effluent matrix: (1) OH radical (OH) quenching and (2) active-site coverage. TiO2 surface modifications (i.e., Pt and SiOx loading) accelerated the degradation of all the tested pharmaceuticals in SWEs to a certain degree. Particularly, the relevant altered surface affinity preferentially increased the susceptibility of specific pharmaceuticals to photocatalytic treatment. The presence of the effluent matrix substantially impaired the performance of visible-light-active photocatalysts in most cases. However, photocatalytic pharmaceutical degradation on Pt-doped TiO2, which occurs via direct charge transfer, was much less hindered in SWEs than that on Pt-deposited WO3, which occurs via OH-mediated oxidation.close5

Measurement of Magnetic Field Properties of a 3.0 T/m Air-core HTS Quadrupole Magnet and Optimal Shape Design to Increase the Critical Current Reduced by the Incident Magnetic Field

Air-core high-temperature superconducting quadrupole magnets (AHQMs) differ from conventional iron-core quadrupole magnets, in that their iron cores are removed, and instead high-temperature superconductors (HTSs) are applied. The high operating temperature and high thermal stability of HTS magnets can improve their thermodynamic cooling efficiency. Thus, HTS magnets are more suitable than low temperature superconducting magnets for withstanding radiation and high heat loads in the hot cells of accelerators. AHQMs are advantageous because they are compact, light, and free from the hysteresis of ferromagnetic materials, due to the removal of the iron-core. To verify the feasibility of the use of AHQMs, we designed and fabricated a 3.0 T/m AHQM. The magnetic field properties of the fabricated AHQM were evaluated. Additionally, the characteristics of the air-core model and iron-core model of 9.0 T/m were compared in the scale for practical operation. In comparison with the iron-core model, AHQM significantly reduces the critical current (I[subscript C]) due to the strong magnetic field inside the coil. In this study, a method for the accurate calculation of I[subscript C] is introduced, and the calculated results are compared with measured results. Furthermore, the optimal shape design of the AHQM to increase the critical current is introduced. Keywords: air-core quadrupole magnet; critical current degradation; heavy-lon accelerator; high-temperature superconductor; iron-core quadrupole magnet; optimum shape designKorea Electric Power Corporation (Grant R17XA05_32)“Human Resources Program in Energy Technology” of the Korea Institute of Energy Technology Evaluation and Planning (KETEP), granted financial resource from the Ministry of Trade, Industry and Energy, Republic of Korea. (No. 20184030202270

Long-Term Compressive Strength Development of Steel Fiber Shotcrete from Cores Based on Accelerator Types at Tunnel Site

In this study, cement minerals, aluminates, and alkali-free accelerators incorporated with steel fiber were used to scrutinize the influence of accelerating agents on the long-term performance of tunneling shotcrete. Performance tests were identified based on the core compressive strength of mix shotcrete specimens with different types of accelerating agents throughout timeframes of 1, 3, 6, and 12 months. Here, 37 kg of steel fiber was incorporated into the cement mineral and aluminate mixes, and 40 kg of steel fiber was incorporated in an alkali-free mix for the shotcrete mix design. The KSF 2784 and ASTM 214 standards were followed for specimen fabrication and core cutting. For all specimens, shotcrete test panels of 250 × 600 × 500 mm were manufactured for core compressive strength tests conducted using 100, 75 and 55 mm diameter cylindrical molds and a length-to-diameter ratio of 2. The 1-month compressive strength of all test variables satisfied the Korea Expressway Co. standard of 21 MPa. The core compressive strength of the shotcrete specimens showed a tendency to increase with age, but a strength reduction occurred in 6 months and increased again at 12 months. Moreover, the impact of the diameter changes in the shotcrete core specimens was analyzed based on the mixing. For 12 months, a large increase in the core compressive strength occurred, particularly in the alkali-free specimens. The comparison also focused on the relative strength compared with a cast concrete mold and shotcrete core specimens. It is necessary to use alkali-free accelerators considering the long-term performance of tunnels and worker safety

Long-Term Compressive Strength Development of Steel Fiber Shotcrete from Cores Based on Accelerator Types at Tunnel Site

In this study, cement minerals, aluminates, and alkali-free accelerators incorporated with steel fiber were used to scrutinize the influence of accelerating agents on the long-term performance of tunneling shotcrete. Performance tests were identified based on the core compressive strength of mix shotcrete specimens with different types of accelerating agents throughout timeframes of 1, 3, 6, and 12 months. Here, 37 kg of steel fiber was incorporated into the cement mineral and aluminate mixes, and 40 kg of steel fiber was incorporated in an alkali-free mix for the shotcrete mix design. The KSF 2784 and ASTM 214 standards were followed for specimen fabrication and core cutting. For all specimens, shotcrete test panels of 250 × 600 × 500 mm were manufactured for core compressive strength tests conducted using 100, 75 and 55 mm diameter cylindrical molds and a length-to-diameter ratio of 2. The 1-month compressive strength of all test variables satisfied the Korea Expressway Co. standard of 21 MPa. The core compressive strength of the shotcrete specimens showed a tendency to increase with age, but a strength reduction occurred in 6 months and increased again at 12 months. Moreover, the impact of the diameter changes in the shotcrete core specimens was analyzed based on the mixing. For 12 months, a large increase in the core compressive strength occurred, particularly in the alkali-free specimens. The comparison also focused on the relative strength compared with a cast concrete mold and shotcrete core specimens. It is necessary to use alkali-free accelerators considering the long-term performance of tunnels and worker safety

An Autonomous Driving System for Unknown Environments using a Unified Map

Recently, there have been significant advances in self-driving cars, which will play key roles in future intelligent transportation systems. In order for these cars to be successfully deployed on real roads, they must be able to autonomously drive along collision-free paths while obeying traffic laws. In contrast to many existing approaches that use prebuilt maps of roads and traffic signals, we propose algorithms and systems using Unified Map built with various onboard sensors to detect obstacles, other cars, traffic signs, and pedestrians. The proposed map contains not only the information on real obstacles nearby but also traffic signs and pedestrians as virtual obstacles. Using this map, the path planner can efficiently find paths free from collisions while obeying traffic laws. The proposed algorithms were implemented on a commercial vehicle and successfully validated in various environments, including the 2012 Hyundai Autonomous Ground Vehicle Competition.11Nsciescopu

Vision system and depth processing for DRC-HUBO+

Abstract—This paper presents a vision system and a depth processing algorithm for DRC-HUBO+, the winner of the DRC finals 2015. Our system is designed to reliably capture 3D infor-mation of a scene and objects robust to challenging environment conditions. We also propose a depth-map upsampling method that produces an outliers-free depth map by explicitly handling depth outliers. Our system is suitable for an interactive robot with real-world that requires accurate object detection and pose estimation. We evaluate our depth processing algorithm over state-of-the-art algorithms on several synthetic and real-world datasets. I