GOPlan: Goal-conditioned Offline Reinforcement Learning by Planning with Learned Models

Offline goal-conditioned RL (GCRL) offers a feasible paradigm to learn general-purpose policies from diverse and multi-task offline datasets. Despite notable recent progress, the predominant offline GCRL methods have been restricted to model-free approaches, constraining their capacity to tackle limited data budgets and unseen goal generalization. In this work, we propose a novel two-stage model-based framework, Goal-conditioned Offline Planning (GOPlan), including (1) pretraining a prior policy capable of capturing multi-modal action distribution within the multi-goal dataset; (2) employing the reanalysis method with planning to generate imagined trajectories for funetuning policies. Specifically, the prior policy is based on an advantage-weighted Conditioned Generative Adversarial Networks that exhibits distinct mode separation to overcome the pitfalls of out-of-distribution (OOD) actions. For further policy optimization, the reanalysis method generates high-quality imaginary data by planning with learned models for both intra-trajectory and inter-trajectory goals. Through experimental evaluations, we demonstrate that GOPlan achieves state-of-the-art performance on various offline multi-goal manipulation tasks. Moreover, our results highlight the superior ability of GOPlan to handle small data budgets and generalize to OOD goals.Comment: Spotlight Presentation at Goal-conditioned Reinforcement Learning Workshop at NeurIPS, 202

Review of the Resources and Utilization of Bamboo in China

China has made a breakthrough in the development and scientific cultivation of bamboo. At present, China ranks first in bamboo research worldwide, because of numerous research units and strong technical force. This chapter focuses on the utilization of bamboo resources such as food, roofs and walls of houses, fences, and domestic and agricultural implements such as water containers, food and drink container hats, arrows, quiver, etc. A total of 861 species and infraspecific taxa belonging to 43 genera have been reported and include 707 species, 52 varieties, 98 forma, and 4 hybrids, which are naturally distributed in 21 provinces. The national bamboo forest covers 6.01 million ha, including 4.43 million ha of Moso bamboo and 1.58 million ha of other bamboo species. As the country develops and new economic activities emerge, bamboo production has shifted from harsh processing, such as bamboo basket, to finished machining, such as bamboo flooring. The bamboo industry has attracted new opportunities as a new energy source, particularly renewable energy, and may be considered a lignocellulose substrate for bioethanol production because of its environmental benefits and high annual biomass yield

A loss-of-function allele of OsHMA3 associated with high cadmium accumulation in shoots and grain of Japonica rice cultivars

This article is protected by copyright. All rights reserved.Peer reviewedPostprin

How far has international HRM travelled? A systematic review of literature on multinational corporations (2000-2014)

This article reviews the present state of research on multinational corporations (MNCs) in the international human resource management (IHRM) literature. Drawing on 342 articles from 39 English journals in the business and management field published over the period of 2000-2014, we identify three key strands within this section of the IHRM scholarly field (MNC country of origin/domicile effects; expatriates management; and, intra-organizational knowledge and strategy flows). Building up on our detailed assessment of trends in the literature based on a systematic review, we propose areas where the field could be developed and extended through drawing on insights from, and building synthesis with, cognate fields. We conclude that major developments on the ground – the increasing numbers of unskilled expatriate workers, the rise of MNCs from emerging markets, and the growth of transnational alternative investors – have the potential to transform the field of enquiry, yet are only starting to appear in the IHRM literature. In developing new major areas of enquiry – and in extending existing ones – insights may be drawn from the literature on comparative institutional analysis to take fuller account of trans-national actors