On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learning

Recently, unsupervised representation learning (URL) has improved the sample efficiency of Reinforcement Learning (RL) by pretraining a model from a large unlabeled dataset. The underlying principle of these methods is to learn temporally predictive representations by predicting future states in the latent space. However, an important challenge of this approach is the representational collapse, where the subspace of the latent representations collapses into a low-dimensional manifold. To address this issue, we propose a novel URL framework that causally predicts future states while increasing the dimension of the latent manifold by decorrelating the features in the latent space. Through extensive empirical studies, we demonstrate that our framework effectively learns predictive representations without collapse, which significantly improves the sample efficiency of state-of-the-art URL methods on the Atari 100k benchmark. The code is available at https://github.com/dojeon-ai/SimTPR.Comment: Accepted to ICML 202

Differences in the Tongue Features of Primary Dysmenorrhea Patients and Controls over a Normal Menstrual Cycle

Background. The aims of this study were to investigate the relationships between tongue features and the existence of menstrual pain and to provide basic information regarding the changes in tongue features during a menstrual cycle. Methods. This study was conducted at the Kyung Hee University Medical Center. Forty-eight eligible participants aged 20 to 29 years were enrolled and assigned to two groups according to their visual analogue scale (VAS) scores. Group A included 24 females suffering from primary dysmenorrhea (PD) caused by qi stagnation and blood stasis syndrome with VAS ≥ 4. In contrast, Group B included 24 females with few premenstrual symptoms and VAS < 4. All participants completed four visits (menses-follicular-luteal-menses phases), and the tongue images were taken by using a computerized tongue image analysis system (CTIS). Results. The results revealed that the tongue coating color value and the tongue coating thickness in the PD group during the menstrual phase were significantly lower than those of the control group (P=0.031 and P=0.029, resp.). Conclusions. These results suggest that the tongue features obtained from the CTIS may serve as a supplementary means for the differentiation of syndromes and the evaluation of therapeutic effect and prognosis in PD. Trial Registration. This trial was registered with Clinical Research Information Service, registration number KCT0001604, registered on 27 August 2015

Design and fabrication of materials with desired deformation behavior

Figure 1: Two examples of real and replicated objects. Thanks to our data-driven process, we are able to measure, simulate, and obtain material combinations of non-linear base materials that match a desired deformation behavior. We can then print those objects with multi-material 3D printers using two materials (blue and black) with varying internal microstructure. This paper introduces a data-driven process for designing and fab-ricating materials with desired deformation behavior. Our process starts with measuring deformation properties of base materials. For each base material we acquire a set of example deformations, and we represent the material as a non-linear stress-strain relationship in a finite-element model. We have validated our material measure-ment process by comparing simulations of arbitrary stacks of base materials with measured deformations of fabricated material stacks. After material measurement, our process continues with designing stacked layers of base materials. We introduce an optimization pro-cess that finds the best combination of stacked layers that meets a user’s criteria specified by example deformations. Our algorithm employs a number of strategies to prune poor solutions from the combinatorial search space. We demonstrate the complete process by designing and fabricating objects with complex heterogeneous materials using modern multi-material 3D printers

Closely Mounted Compact Wideband Diversity Antenna for Mobile Phone Applications

Here a compact wideband diversity antenna covering the PCS/UMTS/WiMAX bands with high isolation and low enveloped correlation coefficient (ECC) is proposed. To widen the bandwidth, the proposed antenna uses a structure with a gap-coupled feed and an inductively shorted line that has capacitive compensation between the radiator and the ground plane. Also, a suspended line with a parasitic element is used to enhance the isolation between the two antennas

Development of a compact ICRF antenna for high-power and long-pulse plasma heating in the KSTAR

For the high-power and long-pulse ion cyclotron range of frequencies (ICRF) heating of the KSTAR plasma, we developed the compact ICRF antenna (CIA). The target injection power of CIA is 2 MW for 300 s. In order to continue injecting the power into plasma even if drastic instantaneous changes occur in the plasma condition, such as ELM events, we adopted the internal conjugate-T method for the load resilience. Between antenna heads and the junction point, impedance transformers were inserted to satisfy the condition of conjugate-T in a limited space keeping the electric field on the transformer low enough. To reduce the risk of water leakage into the vacuum chamber, only the backsides of antenna heads are water-cooled in the in-vessel region