A Quantitative Review on Language Model Efficiency Research

Language models (LMs) are being scaled and becoming powerful. Improving their efficiency is one of the core research topics in neural information processing systems. Tay et al. (2022) provided a comprehensive overview of efficient Transformers that have become an indispensable staple in the field of NLP. However, in the section of "On Evaluation", they left an open question "which fundamental efficient Transformer one should consider," answered by "still a mystery" because "many research papers select their own benchmarks." Unfortunately, there was not quantitative analysis about the performances of Transformers on any benchmarks. Moreover, state space models (SSMs) have demonstrated their abilities of modeling long-range sequences with non-attention mechanisms, which were not discussed in the prior review. This article makes a meta analysis on the results from a set of papers on efficient Transformers as well as those on SSMs. It provides a quantitative review on LM efficiency research and gives suggestions for future research.Comment: 29 pages, 24 table

Embedding Mental Health Discourse for Community Recommendation

Our paper investigates the use of discourse embedding techniques to develop a community recommendation system that focuses on mental health support groups on social media. Social media platforms provide a means for users to anonymously connect with communities that cater to their specific interests. However, with the vast number of online communities available, users may face difficulties in identifying relevant groups to address their mental health concerns. To address this challenge, we explore the integration of discourse information from various subreddit communities using embedding techniques to develop an effective recommendation system. Our approach involves the use of content-based and collaborative filtering techniques to enhance the performance of the recommendation system. Our findings indicate that the proposed approach outperforms the use of each technique separately and provides interpretability in the recommendation process.Comment: Accepted to the 4th workshop on Computational Approaches to Discourse (CODI-2023) at ACL 202

Cyanide detoxification efficiency of injection and soak of hydroxocobalamin, sodium nitrite and sodium thiosulfate for sea water ornamental fish

The Oceanographic Museum offers interesting exhibits of several marine lives for tourist sightseeing and entertainment. These sea water ornamental fish are all caught in the wild. However, its health can be affected by cyanide poisoning during human fishing. Depending on the level of cyanide poisoning, fish can die after one and two weeks that caused economic damages for the museum. The present study is concerned with results of cyanide detoxification by using direct injection into cinnamon clownfish or soak of hydroxocobalamin, sodium nitrite and sodium thiosulfate with the aim of improving the health, survival and life time for fish, contributing to increasing economic efficiency for the Oceanographic Museum

Development of Bacterial Biofilms on Artificial Corals in Comparison to Surface-Associated Microbes of Hard Corals

Numerous studies have demonstrated the differences in bacterial communities associated with corals versus those in their surrounding environment. However, these environmental samples often represent vastly different microbial micro-environments with few studies having looked at the settlement and growth of bacteria on surfaces similar to corals. As a result, it is difficult to determine which bacteria are associated specifically with coral tissue surfaces. In this study, early stages of passive settlement from the water column to artificial coral surfaces (formation of a biofilm) were assessed. Changes in bacterial diversity (16S rRNA gene), were studied on artificially created resin nubbins that were modelled from the skeleton of the reef building coral Acropora muricata. These models were dip-coated in sterile agar, mounted in situ on the reef and followed over time to monitor bacterial community succession. The bacterial community forming the biofilms remained significantly different (R = 0.864 p<0.05) from that of the water column and from the surface mucus layer (SML) of the coral at all times from 30 min to 96 h. The water column was dominated by members of the α-proteobacteria, the developed community on the biofilms dominated by γ-proteobacteria, whereas that within the SML was composed of a more diverse array of groups. Bacterial communities present within the SML do not appear to arise from passive settlement from the water column, but instead appear to have become established through a selection process. This selection process was shown to be dependent on some aspects of the physico-chemical structure of the settlement surface, since agar-coated slides showed distinct communities to coral-shaped surfaces. However, no significant differences were found between different surface coatings, including plain agar and agar enhanced with coral mucus exudates. Therefore future work should consider physico-chemical surface properties as factors governing change in microbial diversity

Atomic structures of TDP-43 LCD segments and insights into reversible or pathogenic aggregation.

The normally soluble TAR DNA-binding protein 43 (TDP-43) is found aggregated both in reversible stress granules and in irreversible pathogenic amyloid. In TDP-43, the low-complexity domain (LCD) is believed to be involved in both types of aggregation. To uncover the structural origins of these two modes of β-sheet-rich aggregation, we have determined ten structures of segments of the LCD of human TDP-43. Six of these segments form steric zippers characteristic of the spines of pathogenic amyloid fibrils; four others form LARKS, the labile amyloid-like interactions characteristic of protein hydrogels and proteins found in membraneless organelles, including stress granules. Supporting a hypothetical pathway from reversible to irreversible amyloid aggregation, we found that familial ALS variants of TDP-43 convert LARKS to irreversible aggregates. Our structures suggest how TDP-43 adopts both reversible and irreversible β-sheet aggregates and the role of mutation in the possible transition of reversible to irreversible pathogenic aggregation

The Action Mechanism of the Myc Inhibitor Termed Omomyc May Give Clues on How to Target Myc for Cancer Therapy

Recent evidence points to Myc – a multifaceted bHLHZip transcription factor deregulated in the majority of human cancers – as a priority target for therapy. How to target Myc is less clear, given its involvement in a variety of key functions in healthy cells. Here we report on the action mechanism of the Myc interfering molecule termed Omomyc, which demonstrated astounding therapeutic efficacy in transgenic mouse cancer models in vivo. Omomyc action is different from the one that can be obtained by gene knockout or RNA interference, approaches designed to block all functions of a gene product. This molecule – instead – appears to cause an edge-specific perturbation that destroys some protein interactions of the Myc node and keeps others intact, with the result of reshaping the Myc transcriptome. Omomyc selectively targets Myc protein interactions: it binds c- and N-Myc, Max and Miz-1, but does not bind Mad or select HLH proteins. Specifically, it prevents Myc binding to promoter E-boxes and transactivation of target genes while retaining Miz-1 dependent binding to promoters and transrepression. This is accompanied by broad epigenetic changes such as decreased acetylation and increased methylation at H3 lysine 9. In the presence of Omomyc, the Myc interactome is channeled to repression and its activity appears to switch from a pro-oncogenic to a tumor suppressive one. Given the extraordinary therapeutic impact of Omomyc in animal models, these data suggest that successfully targeting Myc for cancer therapy might require a similar twofold action, in order to prevent Myc/Max binding to E-boxes and, at the same time, keep repressing genes that would be repressed by Myc

Attitudes About Sex and Marital Sexual Behavior in Hai Duong Province, Vietnam

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/74926/1/j.1728-4465.2005.00047.x.pd