Sample-efficient Reinforcement Learning Representation Learning with Curiosity Contrastive Forward Dynamics Model

Developing an agent in reinforcement learning (RL) that is capable of performing complex control tasks directly from high-dimensional observation such as raw pixels is yet a challenge as efforts are made towards improving sample efficiency and generalization. This paper considers a learning framework for Curiosity Contrastive Forward Dynamics Model (CCFDM) in achieving a more sample-efficient RL based directly on raw pixels. CCFDM incorporates a forward dynamics model (FDM) and performs contrastive learning to train its deep convolutional neural network-based image encoder (IE) to extract conducive spatial and temporal information for achieving a more sample efficiency for RL. In addition, during training, CCFDM provides intrinsic rewards, produced based on FDM prediction error, encourages the curiosity of the RL agent to improve exploration. The diverge and less-repetitive observations provide by both our exploration strategy and data augmentation available in contrastive learning improve not only the sample efficiency but also the generalization. Performance of existing model-free RL methods such as Soft Actor-Critic built on top of CCFDM outperforms prior state-of-the-art pixel-based RL methods on the DeepMind Control Suite benchmark

SoftGroup++: Scalable 3D Instance Segmentation with Octree Pyramid Grouping

Existing state-of-the-art 3D point cloud instance segmentation methods rely on a grouping-based approach that groups points to obtain object instances. Despite improvement in producing accurate segmentation results, these methods lack scalability and commonly require dividing large input into multiple parts. To process a scene with millions of points, the existing fastest method SoftGroup \cite{vu2022softgroup} requires tens of seconds, which is under satisfaction. Our finding is that $k$-Nearest Neighbor ($k$-NN), which serves as the prerequisite of grouping, is a computational bottleneck. This bottleneck severely worsens the inference time in the scene with a large number of points. This paper proposes SoftGroup++ to address this computational bottleneck and further optimize the inference speed of the whole network. SoftGroup++ is built upon SoftGroup, which differs in three important aspects: (1) performs octree $k$-NN instead of vanilla $k$-NN to reduce time complexity from $\mathcal{O}(n^2)$ to $\mathcal{O}(n \log n)$, (2) performs pyramid scaling that adaptively downsamples backbone outputs to reduce search space for $k$-NN and grouping, and (3) performs late devoxelization that delays the conversion from voxels to points towards the end of the model such that intermediate components operate at a low computational cost. Extensive experiments on various indoor and outdoor datasets demonstrate the efficacy of the proposed SoftGroup++. Notably, SoftGroup++ processes large scenes of millions of points by a single forward without dividing the input into multiple parts, thus enriching contextual information. Especially, SoftGroup++ achieves 2.4 points AP$_{50}$ improvement while nearly $6\times$ faster than the existing fastest method on S3DIS dataset. The code and trained models will be made publicly available.Comment: Technical repor

Multi-agent system with plug and play feature for distributed secondary control in microgrid—controller and power hardware-in-the-loop implementation

Distributed control and optimization strategies are a promising alternative approach to centralized control within microgrids. In this paper, a multi-agent system is developed to deal with the distributed secondary control of islanded microgrids. Two main challenges are identified in the coordination of a microgrid: (i) interoperability among equipment from different vendors; and (ii) online re-configuration of the network in the case of alteration of topology. To cope with these challenges, the agents are designed to communicate with physical devices via the industrial standard IEC 61850 and incorporate a plug and play feature. This allows interoperability within a microgrid at agent layer as well as allows for online re-configuration upon topology alteration. A test case of distributed frequency control of islanded microgrid with various scenarios was conducted to validate the operation of proposed approach under controller and power hardware-in-the-loop environment, comprising prototypical hardware agent systems and realistic communications network

Wearable devices for remote monitoring of hospitalized patients with COVID-19 in Vietnam

Patients with severe COVID-19 disease require monitoring with pulse oximetry as a minimal requirement. In many low- and middle- income countries, this has been challenging due to lack of staff and equipment. Wearable pulse oximeters potentially offer an attractive means to address this need, due to their low cost, battery operability and capacity for remote monitoring. Between July and October 2021, Ho Chi Minh City experienced its first major wave of SARS-CoV-2 infection, leading to an unprecedented demand for monitoring in hospitalized patients. We assess the feasibility of a continuous remote monitoring system for patients with COVID-19 under these circumstances as we implemented 2 different systems using wearable pulse oximeter devices in a stepwise manner across 4 departments

Psicología social y moral de COVID-19 en 69 países

La pandemia de COVID-19 ha afectado a todos los ámbitos de la vida humana, incluido el tejido económico y social de las sociedades. Una de las estrategias centrales para gestionar la salud pública a lo largo de la pandemia ha sido el envío de mensajes persuasivos y el cambio de comportamiento colectivo. Para ayudar a los estudiosos a comprender mejor la psicología social y moral que subyace al comportamiento en materia de salud pública, presentamos un conjunto de datos compuesto por 51.404 individuos de 69 países. Este conjunto de datos se recopiló para el proyecto de la Colaboración Internacional en Psicología Social y Moral de COVID-19 (ICSMP COVID-19). Esta encuesta de ciencias sociales invitó a participantes de todo el mundo a completar una serie de medidas morales y psicológicas y actitudes de salud pública sobre COVID-19 durante una fase temprana de la pandemia de COVID-19 (entre abril y junio de 2020). La encuesta incluía siete grandes categorías de preguntas: Creencias sobre COVID-19 y conductas de cumplimiento; identidad y actitudes sociales; ideología; salud y bienestar; creencias morales y motivación; rasgos de personalidad; y variables demográficas. Presentamos los datos brutos y depurados, junto con todos los materiales de la encuesta, las visualizaciones de los datos y las evaluaciones psicométricas de las variables clave.The COVID-19 pandemic has affected all domains of human life, including the economic and social fabric of societies. One of the central strategies for managing public health throughout the pandemic has been through persuasive messaging and collective behaviour change. To help scholars better understand the social and moral psychology behind public health behaviour, we present a dataset comprising of 51,404 individuals from 69 countries. This dataset was collected for the International Collaboration on Social & Moral Psychology of COVID-19 project (ICSMP COVID-19). This social science survey invited participants around the world to complete a series of moral and psychological measures and public health attitudes about COVID-19 during an early phase of the COVID-19 pandemic (between April and June 2020). The survey included seven broad categories of questions: COVID-19 beliefs and compliance behaviours; identity and social attitudes; ideology; health and well-being; moral beliefs and motivation; personality traits; and demographic variables. We report both raw and cleaned data, along with all survey materials, data visualisations, and psychometric evaluations of key variables

National identity predicts public health support during a global pandemic (vol 13, 517, 2022) : National identity predicts public health support during a global pandemic (Nature Communications, (2022), 13, 1, (517), 10.1038/s41467-021-27668-9)

Publisher Copyright: © The Author(s) 2022.In this article the author name ‘Agustin Ibanez’ was incorrectly written as ‘Augustin Ibanez’. The original article has been corrected.Peer reviewe

National identity predicts public health support during a global pandemic.

Changing collective behaviour and supporting non-pharmaceutical interventions is an important component in mitigating virus transmission during a pandemic. In a large international collaboration (Study 1, N = 49,968 across 67 countries), we investigated self-reported factors associated with public health behaviours (e.g., spatial distancing and stricter hygiene) and endorsed public policy interventions (e.g., closing bars and restaurants) during the early stage of the COVID-19 pandemic (April-May 2020). Respondents who reported identifying more strongly with their nation consistently reported greater engagement in public health behaviours and support for public health policies. Results were similar for representative and non-representative national samples. Study 2 (N = 42 countries) conceptually replicated the central finding using aggregate indices of national identity (obtained using the World Values Survey) and a measure of actual behaviour change during the pandemic (obtained from Google mobility reports). Higher levels of national identification prior to the pandemic predicted lower mobility during the early stage of the pandemic (r = -0.40). We discuss the potential implications of links between national identity, leadership, and public health for managing COVID-19 and future pandemics

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Impact of opioid-free analgesia on pain severity and patient satisfaction after discharge from surgery: multispecialty, prospective cohort study in 25 countries

Background: Balancing opioid stewardship and the need for adequate analgesia following discharge after surgery is challenging. This study aimed to compare the outcomes for patients discharged with opioid versus opioid-free analgesia after common surgical procedures.Methods: This international, multicentre, prospective cohort study collected data from patients undergoing common acute and elective general surgical, urological, gynaecological, and orthopaedic procedures. The primary outcomes were patient-reported time in severe pain measured on a numerical analogue scale from 0 to 100% and patient-reported satisfaction with pain relief during the first week following discharge. Data were collected by in-hospital chart review and patient telephone interview 1 week after discharge.Results: The study recruited 4273 patients from 144 centres in 25 countries; 1311 patients (30.7%) were prescribed opioid analgesia at discharge. Patients reported being in severe pain for 10 (i.q.r. 1-30)% of the first week after discharge and rated satisfaction with analgesia as 90 (i.q.r. 80-100) of 100. After adjustment for confounders, opioid analgesia on discharge was independently associated with increased pain severity (risk ratio 1.52, 95% c.i. 1.31 to 1.76; P < 0.001) and re-presentation to healthcare providers owing to side-effects of medication (OR 2.38, 95% c.i. 1.36 to 4.17; P = 0.004), but not with satisfaction with analgesia (beta coefficient 0.92, 95% c.i. -1.52 to 3.36; P = 0.468) compared with opioid-free analgesia. Although opioid prescribing varied greatly between high-income and low- and middle-income countries, patient-reported outcomes did not.Conclusion: Opioid analgesia prescription on surgical discharge is associated with a higher risk of re-presentation owing to side-effects of medication and increased patient-reported pain, but not with changes in patient-reported satisfaction. Opioid-free discharge analgesia should be adopted routinely