APRIL: Active Preference-learning based Reinforcement Learning

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both standard RL and inverse reinforcement learning. Although with a limited expertise, the human expert is still often able to emit preferences and rank the agent demonstrations. Earlier work has presented an iterative preference-based RL framework: expert preferences are exploited to learn an approximate policy return, thus enabling the agent to achieve direct policy search. Iteratively, the agent selects a new candidate policy and demonstrates it; the expert ranks the new demonstration comparatively to the previous best one; the expert's ranking feedback enables the agent to refine the approximate policy return, and the process is iterated. In this paper, preference-based reinforcement learning is combined with active ranking in order to decrease the number of ranking queries to the expert needed to yield a satisfactory policy. Experiments on the mountain car and the cancer treatment testbeds witness that a couple of dozen rankings enable to learn a competent policy

Dye-sensitized solar cells: Investigation of D-A-π-A organic sensitizers based on [1,2,5]selenadiazolo[3,4-c]pyridine

The authors gratefully acknowledge financial support from the Russian Science Foundation (grant no. 15-13-10022). Wenjun Wu thanks the Scientific Committee of Shanghai (14ZR1409700) for financial support. The authors thank the Leverhulme Trust for an International Network grant.We report two series of D-A-π-A metal-free organic sensitizers for dye-sensitized solar cells (DSSCs) based on triphenylamine and N-hexyl-carbazole as electronic donors, respectively. Through varying auxiliary acceptors and π-spacers, several significant consequences on cell efficiency were identified: (i) a broadened UV-Vis absorption spectrum and low-lying LUMO level with [1,2,5]selenadiazolo [3,4-c] pyridine as auxiliary acceptor; (ii) compensation for the absorption valley around 400 nm in the UV-vis spectra by the introduction of a thiophene unit into the π-bridge; (iii) effective improvement of the power conversion efficiency (PCE) by means of cosensitization, leading to dye OKT-1 , 3.10% PCE, increased to 4.19% with squaraine dye SQ2 as co-sensitizer. The design criteria identified have opened the door for further optimization of this new dye family.PostprintPeer reviewe

Importance of Spin-Orbit Coupling in Hybrid Organic/Inorganic Perovskites for Photovoltaic Applications

International audienceThree-dimensional (3D) hybrid perovskites CH3NH3PbX3 (X = Br, I) have recently been suggested as new key materials for dye-sensitized solar cells (DSSC) leading to a new class of hybrid semiconductor photovoltaic cells (HSPC). Thanks to density functional theory calculations, we show that the band gap of these compounds is dominated by a giant spin-orbit coupling (SOC) in the conduction-band (CB). At room temperature, direct and isotropic optical transitions are associated to a spin-orbit split-off band related to the triply degenerated CB of the cubic lattice without SOC. Due to the strong SOC, the electronic states involved in the optical absorption are only slightly perturbed by local distortions of the lattice. In addition, band offset calculations confirm that CH3NH3PbX3/TiO2 is a reference material for driving electrons toward the electrode in HSPC. Two-dimensional (2D) hybrids are also suggested to reach further flexibility for light conversion efficiency. Our study affords the basic concepts to reach the level of knowledge already attained for optoelectronic properties of conventional semiconductors

Non-solvolytic synthesis of aqueous soluble TiO2 nanoparticles and real-time dynamic measurements of the nanoparticle formation.

Highly aqueously dispersible (soluble) TiO2 nanoparticles are usually synthesized by a solution-based sol-gel (solvolysis/condensation) process, and no direct precipitation of titania has been reported. This paper proposes a new approach to synthesize stable TiO2 nanoparticles by a non-solvolytic method - direct liquid phase precipitation at room temperature. Ligand-capped TiO2 nanoparticles are more readily solubilized compared to uncapped TiO2 nanoparticles, and these capped materials show distinct optical absorbance/emission behaviors. The influence of ligands, way of reactant feeding, and post-treatment on the shape, size, crystalline structure, and surface chemistry of the TiO2 nanoparticles has been thoroughly investigated by the combined use of X-ray diffraction, transmission electron microscopy, UV-visible (UV-vis) spectroscopy, and photoluminescence (PL). It is found that all above variables have significant effects on the size, shape, and dispersivity of the final TiO2 nanoparticles. For the first time, real-time UV-vis spectroscopy and PL are used to dynamically detect the formation and growth of TiO2 nanoparticles in solution. These real-time measurements show that the precipitation process begins to nucleate after an initial inhibition period of about 1 h, thereafter a particle growth occurs and reaches the maximum point after 2 h. The synthesis reaction is essentially completed after 4 h.RIGHTS : This article is licensed under the BioMed Central licence at http://www.biomedcentral.com/about/license which is similar to the 'Creative Commons Attribution Licence'. In brief you may : copy, distribute, and display the work; make derivative works; or make commercial use of the work - under the following conditions: the original author must be given credit; for any reuse or distribution, it must be made clear to others what the license terms of this work are

High Electrocatalytic Activity of Vertically Aligned Single-Walled Carbon Nanotubes towards Sulfide Redox Shuttles

Vertically aligned single-walled carbon nanotubes (VASWCNTs) have been successfully transferred onto transparent conducting oxide glass and implemented as efficient low-cost, platinum-free counter electrode in sulfide –mediated dye-sensitized solar cells (DSCs), featuring notably improved electrocatalytic activity toward thiolate/disulfide redox shuttle over conventional Pt counter electrodes. Impressively, device with VASWCNTs counter electrode demonstrates a high fill factor of 0.68 and power conversion efficiency up to 5.25%, which is significantly higher than 0.56 and 3.49% for that with a conventional Pt electrode. Moreover, VASWCNTs counter electrode produces a charge transfer resistance of only 21.22 Ω towards aqueous polysulfide electrolyte commonly applied in quantum dots-sensitized solar cells (QDSCs), which is several orders of magnitude lower than that of a typical Pt electrode. Therefore, VASWCNTs counter electrodes are believed to be a versatile candidate for further improvement of the power conversion efficiency of other iodine-free redox couple based DSCs and polysulfide electrolyte based QDSCs