Scaling Law for Recommendation Models: Towards General-purpose User Representations

Recent advancement of large-scale pretrained models such as BERT, GPT-3, CLIP, and Gopher, has shown astonishing achievements across various task domains. Unlike vision recognition and language models, studies on general-purpose user representation at scale still remain underexplored. Here we explore the possibility of general-purpose user representation learning by training a universal user encoder at large scales. We demonstrate that the scaling law is present in user representation learning areas, where the training error scales as a power-law with the amount of computation. Our Contrastive Learning User Encoder (CLUE), optimizes task-agnostic objectives, and the resulting user embeddings stretch our expectation of what is possible to do in various downstream tasks. CLUE also shows great transferability to other domains and companies, as performances on an online experiment shows significant improvements in Click-Through-Rate (CTR). Furthermore, we also investigate how the model performance is influenced by the scale factors, such as training data size, model capacity, sequence length, and batch size. Finally, we discuss the broader impacts of CLUE in general.Comment: Accepted at AAAI 2023. This version includes the technical appendi

Public awareness and individual responsibility needed for judicious use of antibiotics: a qualitative study of public beliefs and

BACKGROUND: High consumption of antibiotics has been identified as an important driver for the increasing antibiotic resistance, considered to be one of the greatest threats to public health globally. Simply informing the public about this consequence is insufficient to induce behavioral change. This study explored beliefs and perceptions among Swedes, with the aim of identifying factors promoting and hindering a judicious approach to antibiotics use. The study focused primarily on the medical use of antibiotics, also considering other aspects connected with antibiotic resistance, such as travelling and food consumption. METHODS: Data were collected through focus group discussions at the end of 2016. Twenty-three Swedes were recruited using an area-based approach and purposive sampling, aiming for as heterogeneous groups as possible regarding gender (13 women, 10 men), age (range 20-81, mean 38), and education level. Interview transcripts were analyzed using qualitative content analysis. The Health Belief Model was used as a theoretical framework. RESULTS: Antibiotic resistance was identified by participants as a health threat with the potential for terrible consequences. The severity of the problem was perceived more strongly than the actual likelihood of being affected by it. Metaphors such as climate change were abundantly employed to describe antibiotic resistance as a slowly emerging problem. There was a tension between individual (egoistic) and collective (altruistic) reasons for engaging in judicious behavior. The individual effort needed and antibiotics overprescribing were considered major barriers to such behavior. In their discussions, participants stressed the need for empowerment, achieved through good health communication from authorities and family physicians. CONCLUSIONS: Knowledge about antibiotic consumption and resistance, as well as values such as altruism and trust in the health care system, has significant influence on both perceptions of individual responsibility and on behavior. This suggests that these factors should be emphasized in health education and health promotion. To instead frame antibiotic resistance as a slowly emerging disaster, risks diminish the public perception of being susceptible to it

Statistical analysis of dust storms in the United Arab Emirates

© 2019 Elsevier B.V. Desert dust storms perturb economic activities and are dangerous for human health. Since such phenomena are frequent across the United Arab Emirates (UAE), this paper presents the results of the analysis of a data set of eight years (2010–2017) obtained from Hourly Global Surface data (DS3505) datasets from the National Climatic Data Center (NCDC) Climate Data, at eight international airports in the UAE. The observations were classified based on the dust storm intensity in Severe dust storm, Dust storm, Blowing dust and None, and studied per month, season, year and location. The existence of similarities of the events from each site has been tested. It was shown that Blowing dust and None series are not stationary and a have monotonic trend (opposite to each other). Change points are emphasized for the same series, mainly in 2013. Five clusters were built for the monthly series, showing once again the dissimilarities of the dust storm events at the eight international airports

Allergic rhinitis in northern vietnam: increased risk of urban living according to a large population survey

<p>Abstract</p> <p>Background</p> <p>Little is known about prevalence and risk factors of allergic rhinitis and chronic nasal symptoms among adults in Vietnam. We aimed to estimate the prevalence, risk factor patterns and co-morbidities of allergic rhinitis and chronic nasal symptoms in one urban and one rural area in northern Vietnam.</p> <p>Methods</p> <p>A cross-sectional questionnaire survey was conducted from August 2007 to January 2008 in urban Hoankiem and rural Bavi in Hanoi among adults aged 21-70 years. Of 7008 randomly selected subjects, 91.7% participated in Bavi and 70.3% in Hoankiem.</p> <p>Results</p> <p>Allergic rhinitis ever or chronic nasal symptoms were reported by 50.2%. The prevalence of allergic rhinitis ever was considerably higher in Hoankiem compared to Bavi, 29.6% vs 10.0% (p < 0.001). Allergic rhinitis ever and chronic nasal symptoms were both significantly associated with asthma and respiratory symptoms, respectively (p < 0.001). Exposure to gas, dust or fumes at work was significantly associated with allergic rhinitis ever, OR 1.57 (95% CI 1.34 - 1.84), nasal blocking, OR 1.90 (95% CI 1.68 - 2.15) and runny nose, OR 1.32 (95% CI 1.17 - 1.49), while somewhat surprisingly no association with smoking was found. Female sex was a significant risk factor for both nasal blocking and runny nose.</p> <p>Conclusions</p> <p>Allergic rhinitis ever was considerably more common in the urban area. Nasal blocking and runny nose was each reported by about one third of the studied sample with no major urban-rural difference. Further, exposure to air pollution at work was significantly associated with allergic rhinitis ever, nasal blocking and runny nose.</p

SmokeHaz: systematic reviews and meta-analyses of the effects of smoking on respiratory health

Background: Smoking tobacco increases the risk of respiratory disease in adults and children, but communicating the magnitude of these effects in a scientific manner that is accessible and usable by public and policymakers presents a challenge. We have therefore summarised scientific data on the impact of smoking on respiratory diseases to provide the content for a unique resource, SmokeHaz. Methods: We conducted systematic reviews and meta-analyses of longitudinal studies (published to 2013) identified from electronic databases, grey literature, and experts. Random effect meta-analyses were used to pool the findings. Results: We included 216 papers. Among adult smokers, we confirmed substantially increased risks of lung cancer (Risk Ratio (RR) 10.92, 95% CI 8.28-14.40; 34 studies), COPD (RR 4.01, 95% CI 3.18-5.05; 22 studies) and asthma (RR 1.61, 95% CI 1.07-2.42; 8 studies). Exposure to passive smoke significantly increased the risk of lung cancer in adult non-smokers; and increased the risks of asthma, wheeze, lower respiratory infections, and reduced lung function in children. Smoking significantly increased the risk of sleep apnoea, and asthma exacerbations in adult and pregnant populations; and active and passive smoking increased the risk of tuberculosis. Conclusions: These findings have been translated into easily digestible content and published on the SmokeHaz website (www.smokehaz.eu)

The role of atmospheric deposition in the biogeochemistry of the Mediterranean Sea

Estimates of atmospheric inputs to the Mediterranean (MED) and some coastal areas are reviewed, and uncertainities in these estimates considered. Both the magnitude and the mineralogical composition of atmospheric dust inputs indicate that eolian deposition is an important (50%) or prevailing (>80%) contribution to sediments in the offshore waters of the entire Mediterranean (MED) basin. Model data for trace metals and nutrients indicate that the atmosphere delivers more than half the lead and nitrogen, one-third of total phosphorus, and 10% of the zinc entering the entire basin. Measured data in sub-basins, such as the north-western MED and northern Adriatic indicate an even greater proportion of atmospheric versus riverine inputs. When dissolved fluxes are compared (the form most likely to impinge on surface water biogeochemical cycles), the atmosphere is found to be 5 to 50 times more important than rivers for dissolved Zn and 15 to 30 times more important for Pb fluxes. Neglecting co-limitation by other nutrients, new production supported by atmospheric nitrogen deposition ranges from 2-4 g C m-2 yr-1, whereas atmospheric phosphorus deposition appears to support less than 1 g C m-2 yr-1. In spite of the apparently small contribution of atmospheric deposition to overall production in the basin it has been suggested that certain episodes of phytoplankton blooms are triggered by atmospheric deposition of N, P or Fe. Future studies are needed to clarify the extent and causal links between these episodic blooms and atmospheric/oceanographic forcing functions. A scientific program aimed at elucidating the possible biogeochemical effects of Saharan outbreaks in the MED through direct sampling of the ocean and atmosphere before and after such events is therefore highly recommended