Scaling Law for Recommendation Models: Towards General-purpose User Representations

Recent advancement of large-scale pretrained models such as BERT, GPT-3, CLIP, and Gopher, has shown astonishing achievements across various task domains. Unlike vision recognition and language models, studies on general-purpose user representation at scale still remain underexplored. Here we explore the possibility of general-purpose user representation learning by training a universal user encoder at large scales. We demonstrate that the scaling law is present in user representation learning areas, where the training error scales as a power-law with the amount of computation. Our Contrastive Learning User Encoder (CLUE), optimizes task-agnostic objectives, and the resulting user embeddings stretch our expectation of what is possible to do in various downstream tasks. CLUE also shows great transferability to other domains and companies, as performances on an online experiment shows significant improvements in Click-Through-Rate (CTR). Furthermore, we also investigate how the model performance is influenced by the scale factors, such as training data size, model capacity, sequence length, and batch size. Finally, we discuss the broader impacts of CLUE in general.Comment: Accepted at AAAI 2023. This version includes the technical appendi

Trends in Deceased Organ Donation and Utilization in Korea: 2000-2009

Continuous efforts have been made by the organ donation and transplantation community in Korea to increase organ donation by the deceased. The authors detailed trends of organ donation and utilization over the past 10 yr using data provided by the KONOS. The yearly number of deceased donors has grown gradually since 2003. The number and percentage of old donors (≥50 yr) and donors dying from intracranial hemorrhage has increased continuously. Therefore, the percentage of standard criteria donors (SCD) has been declining significantly, from 94% in 2000 to 79.2% in 2009. The number of organs transplanted per donor (OTPD) has also declined slightly since 2007, from 3.28 in 2007 to 2.95 in 2009. This decline may be attributable to increases in the number and percentage of extended criteria donors (ECD) and donors after cardiac death (DCD), since the OTPD was 2.25 for DCD, 2.5 for ECD, and 3.09 for SCD in 2009. In summary, the makeup of donors has changed significantly. There is an urgent need for establishment of an institutional framework including an independent organ procurement organization and for improvement for the National Transplant Act to increase deceased donor pool and to optimize management of ECD and DCD

Novel next generation sequencing panel method for the multiple detection and identification of foodborne pathogens in agricultural wastewater

Detecting and identifying the origins of foodborne pathogen outbreaks is a challenging. The Next-Generation Sequencing (NGS) panel method offers a potential solution by enabling efficient screening and identification of various bacteria in one reaction. In this study, new NGS panel primer sets that target 18 specific virulence factor genes from six target pathogens (Bacillus cereus, Yersinia enterocolitica, Staphylococcus aureus, Vibrio cholerae, Vibrio parahaemolyticus, and Vibrio vulnificus) were developed and optimized. The primer sets were validated for specificity and selectivity through singleplex PCR, confirming the expected amplicon size. Crosscheck and multiplex PCR showed no interference in the primer set or pathogenic DNA mixture. The NGS panel analysis of spiked water samples detected all 18 target genes in a single reaction, with pathogen concentrations ranging from 108 to 105 colony-forming units (CFUs) per target pathogen. Notably, the total sequence read counts from the virulence factor genes showed a positive association with the CFUs per target pathogen. However, the method exhibited relatively low sensitivity and occasional false positive results at low pathogen concentrations of 105 CFUs. To validate the detection and identification results, two sets of quantitative real-time PCR (qPCR) analyses were independently performed on the same spiked water samples, yielding almost the same efficiency and specificity compared to the NGS panel analysis. Comparative statistical analysis and Spearman correlation analysis further supported the similarity of the results by showing a negative association between the NGS panel sequence read counts and qPCR cycle threshold (Ct) values. To enhance NGS panel analysis for better detection, optimization of primer sets and real-time NGS sequencing technology are essential. Nonetheless, this study provides valuable insights into applying NGS panel analysis for multiple foodborne pathogen detection, emphasizing its potential in ensuring food safety

Non-irradiation-derived reactive oxygen species (ROS) and cancer: therapeutic implications

Owing to their chemical reactivity, radicals have cytocidal properties. Destruction of cells by irradiation-induced radical formation is one of the most frequent interventions in cancer therapy. An alternative to irradiation-induced radical formation is in principle drug-induced formation of radicals, and the formation of toxic metabolites by enzyme catalysed reactions. Although these developments are currently still in their infancy, they nevertheless deserve consideration. There are now numerous examples known of conventional anti-cancer drugs that may at least in part exert cytotoxicity by induction of radical formation. Some drugs, such as arsenic trioxide and 2-methoxy-estradiol, were shown to induce programmed cell death due to radical formation. Enzyme-catalysed radical formation has the advantage that cytotoxic products are produced continuously over an extended period of time in the vicinity of tumour cells. Up to now the enzymatic formation of toxic metabolites has nearly exclusively been investigated using bovine serum amine oxidase (BSAO), and spermine as substrate. The metabolites of this reaction, hydrogen peroxide and aldehydes are cytotoxic. The combination of BSAO and spermine is not only able to prevent tumour cell growth, but prevents also tumour growth, particularly well if the enzyme has been conjugated with a biocompatible gel. Since the tumour cells release substrates of BSAO, the administration of spermine is not required. Combination with cytotoxic drugs, and elevation of temperature improves the cytocidal effect of spermine metabolites. The fact that multidrug resistant cells are more sensitive to spermine metabolites than their wild type counterparts makes this new approach especially attractive, since the development of multidrug resistance is one of the major problems of conventional cancer therapy

Comparative effectiveness and safety of non-vitamin K antagonists for atrial fibrillation in clinical practice: GLORIA-AF Registry

Background and purpose: Prospectively collected data comparing the safety and effectiveness of individual non-vitamin K antagonists (NOACs) are lacking. Our objective was to directly compare the effectiveness and safety of NOACs in patients with newly diagnosed atrial fibrillation (AF). Methods: In GLORIA-AF, a large, prospective, global registry program, consecutive patients with newly diagnosed AF were followed for 3 years. The comparative analyses for (1) dabigatran vs rivaroxaban or apixaban and (2) rivaroxaban vs apixaban were performed on propensity score (PS)-matched patient sets. Proportional hazards regression was used to estimate hazard ratios (HRs) for outcomes of interest. Results: The GLORIA-AF Phase III registry enrolled 21,300 patients between January 2014 and December 2016. Of these, 3839 were prescribed dabigatran, 4015 rivaroxaban and 4505 apixaban, with median ages of 71.0, 71.0, and 73.0 years, respectively. In the PS-matched set, the adjusted HRs and 95% confidence intervals (CIs) for dabigatran vs rivaroxaban were, for stroke: 1.27 (0.79–2.03), major bleeding 0.59 (0.40–0.88), myocardial infarction 0.68 (0.40–1.16), and all-cause death 0.86 (0.67–1.10). For the comparison of dabigatran vs apixaban, in the PS-matched set, the adjusted HRs were, for stroke 1.16 (0.76–1.78), myocardial infarction 0.84 (0.48–1.46), major bleeding 0.98 (0.63–1.52) and all-cause death 1.01 (0.79–1.29). For the comparison of rivaroxaban vs apixaban, in the PS-matched set, the adjusted HRs were, for stroke 0.78 (0.52–1.19), myocardial infarction 0.96 (0.63–1.45), major bleeding 1.54 (1.14–2.08), and all-cause death 0.97 (0.80–1.19). Conclusions: Patients treated with dabigatran had a 41% lower risk of major bleeding compared with rivaroxaban, but similar risks of stroke, MI, and death. Relative to apixaban, patients treated with dabigatran had similar risks of stroke, major bleeding, MI, and death. Rivaroxaban relative to apixaban had increased risk for major bleeding, but similar risks for stroke, MI, and death. Registration: URL: https://www.clinicaltrials.gov. Unique identifiers: NCT01468701, NCT01671007. Date of registration: September 2013

Anticoagulant selection in relation to the SAMe-TT2R2 score in patients with atrial fibrillation. the GLORIA-AF registry

Aim: The SAMe-TT2R2 score helps identify patients with atrial fibrillation (AF) likely to have poor anticoagulation control during anticoagulation with vitamin K antagonists (VKA) and those with scores >2 might be better managed with a target-specific oral anticoagulant (NOAC). We hypothesized that in clinical practice, VKAs may be prescribed less frequently to patients with AF and SAMe-TT2R2 scores >2 than to patients with lower scores. Methods and results: We analyzed the Phase III dataset of the Global Registry on Long-Term Oral Antithrombotic Treatment in Patients with Atrial Fibrillation (GLORIA-AF), a large, global, prospective global registry of patients with newly diagnosed AF and ≥1 stroke risk factor. We compared baseline clinical characteristics and antithrombotic prescriptions to determine the probability of the VKA prescription among anticoagulated patients with the baseline SAMe-TT2R2 score >2 and ≤ 2. Among 17,465 anticoagulated patients with AF, 4,828 (27.6%) patients were prescribed VKA and 12,637 (72.4%) patients an NOAC: 11,884 (68.0%) patients had SAMe-TT2R2 scores 0-2 and 5,581 (32.0%) patients had scores >2. The proportion of patients prescribed VKA was 28.0% among patients with SAMe-TT2R2 scores >2 and 27.5% in those with scores ≤2. Conclusions: The lack of a clear association between the SAMe-TT2R2 score and anticoagulant selection may be attributed to the relative efficacy and safety profiles between NOACs and VKAs as well as to the absence of trial evidence that an SAMe-TT2R2-guided strategy for the selection of the type of anticoagulation in NVAF patients has an impact on clinical outcomes of efficacy and safety. The latter hypothesis is currently being tested in a randomized controlled trial. Clinical trial registration: URL: https://www.clinicaltrials.gov//Unique identifier: NCT01937377, NCT01468701, and NCT01671007

Guidelines for the use and interpretation of assays for monitoring autophagy (4th edition)1.

In 2008, we published the first set of guidelines for standardizing research in autophagy. Since then, this topic has received increasing attention, and many scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Thus, it is important to formulate on a regular basis updated guidelines for monitoring autophagy in different organisms. Despite numerous reviews, there continues to be confusion regarding acceptable methods to evaluate autophagy, especially in multicellular eukaryotes. Here, we present a set of guidelines for investigators to select and interpret methods to examine autophagy and related processes, and for reviewers to provide realistic and reasonable critiques of reports that are focused on these processes. These guidelines are not meant to be a dogmatic set of rules, because the appropriateness of any assay largely depends on the question being asked and the system being used. Moreover, no individual assay is perfect for every situation, calling for the use of multiple techniques to properly monitor autophagy in each experimental setting. Finally, several core components of the autophagy machinery have been implicated in distinct autophagic processes (canonical and noncanonical autophagy), implying that genetic approaches to block autophagy should rely on targeting two or more autophagy-related genes that ideally participate in distinct steps of the pathway. Along similar lines, because multiple proteins involved in autophagy also regulate other cellular pathways including apoptosis, not all of them can be used as a specific marker for bona fide autophagic responses. Here, we critically discuss current methods of assessing autophagy and the information they can, or cannot, provide. Our ultimate goal is to encourage intellectual and technical innovation in the field

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation

1