nuQmm: Quantized MatMul for Efficient Inference of Large-Scale Generative Language Models

The recent advance of self-supervised learning associated with the Transformer architecture enables natural language processing (NLP) to exhibit extremely low perplexity. Such powerful models demand ever-increasing model size and, thus, large amounts of computations and memory footprints. In this paper, we propose an efficient inference framework for large-scale generative language models. As the key to reducing model size, we quantize weights by a non-uniform quantization method. Then, quantized matrix multiplications are accelerated by our proposed kernel, called nuQmm, which allows a wide trade-off between compression ratio and accuracy. Our proposed nuQmm reduces the latency of not only each GPU but also the entire inference of large LMs because a high compression ratio (by low-bit quantization) mitigates the minimum required number of GPUs. Assuming 2-bit quantization, we demonstrate that nuQmm can reduce latency to generate each token for OPT-175B (that requires 8 GPUs without nuQmm) by 47.3% using 8 GPUs or by 23.2% using only 2 GPUs.Comment: 15 pages (including 5 pages of References & Appendix), 14 figures, 7 table

The Howl - Spring 2017

The Howl is a magazine that is planned, researched, written, photographed and designed by Otterbein University\u27s ESL and international students. The magazine serves to give them a safe space in which to use their voice to share their cultures, experiences and lives. If you are interested in submitting to The Howl, please email your writing or photography to [email protected]://digitalcommons.otterbein.edu/the_howl/1002/thumbnail.jp

Genetic variation of aldolase from Korean isolates of Plasmodium vivax and its usefulness in serodiagnosis

Background: The malaria aldolase is widely used as rapid diagnostic test (RDT), but the efficacy in aspect of its serological effectiveness in diagnosis is not known. The genetic variation of Korean isolates was analysed and recombinant aldolase was evaluated as a serological antigen in Plasmodium vivax malaria. Methods: Genomic DNA was purified and the aldolase gene of P. vivax from 25 patients’ blood samples was amplified. The samples came from 5 epidemic areas; Bucheon-si, Gimpo-si, Paju-si of Gyeonggido, Gangwha-gun of Incheon metropolitan city, and Cheorwon of Gangwon-do, South Korea. The antigenicity of the recombinant aldolase was tested by western blot and enzyme-linked immunosorbent assay (ELISA). Results: Sequence analysis of 25 Korean isolates of P. vivax showed that the open reading frame (ORF) of 1,110 nucleotides encoded a deduced protein of 369 amino acids (aa). This ORF showed 100% homology with the P. vivax Sal I strain (XM_00165894) and P. vivax WDK strain (AF247063), 87.4% homology with Plasmodium falciparum (AF179421), 90.6% homology with Plasmodium chabaudi (AF247060), 89.5% homology with Plasmodium vinckei (AF247061), and 96.7% homology with Plasmodium knowlesi. A single nucleotide polymorphism (SNP) at nucleotide 180 (G to A, n = 5) was also observed in the isolates. The expressed recombinant protein had a molecular weight of approximately 31 kDa (monomeric form) and 62 kDa (dimeric form) as analysed by sodium dodecyl sulfate-polyacrylamide gel electrophoresis (SDS-PAGE) analysis. Among 109 P. vivax patients, 32 (29.4%) had positive in an enzyme-linked absorbance assay (ELISA). This result showed significant correlation between ELISA and an indirect fluorescent antibody test (IFAT) (P < 0.0001). Conclusions: The aldolase gene from Korean isolates of P. vivax showed one SNP at nucleotide position 180; this SNP mutant was discovered in only the western part of Han River, and included the regions of Ganghwa, Gimpo, and Bucheon. Based on the results, the relationship between antibody production against aldolase and the pattern of disease onset should be more investigated before using aldolase for serodiagnosis

Estimating the malaria transmission of Plasmodium vivax based on serodiagnosis

Background: Plasmodium vivax re-emerged in 1993 and has now become a major public health problem during the summer season in South Korea. The aim of this study was to interpret and understand the meaning of seroepidemiological studies for developing the best malaria control programme in South Korea. Methods: Blood samples were collected in Gimpo city, Paju city, Yeoncheon County, Cheorwon County and Goseong County of high risk area in South Korea. Microscopy was performed to identify patients infected with P. vivax. Antibody detection for P. vivax was performed using indirect fluorescent antibody test (IFAT). Results: A total of 1,574 blood samples was collected from participants in the study areas and evaluated against three parameters: IFAT positive rate, annual antibody positive index (AAPI), and annual parasite index (API). The IFAT positive rate was 7.24% (n = 114). Of the five study areas, Gimpo had the highest IFAT positive rate (13.68%) and AAPI (4.63). Yeongcheon had the highest API in 2005 (2.06) while Gimpo had the highest API in 2006 (5.00). No correlation was observed between any of the three parameters and study sites' distance from the demilitarized zone (DMZ). Conclusions: These results showed that P. vivax antibody levels could provide useful information about the prevalence of malaria in endemic areas. Furthermore, AAPI results for each year showed a closer relationship to API the following year than the API of the same year and thus could be helpful in predicting malaria transmission risks

High Doses of Bupleurum falcatum Partially Prevents Estrogen Deficiency-Induced Bone Loss With Anti-osteoclastogenic Activity Due to Enhanced iNOS/NO Signaling

Background and Objective:Bupleurum falcatum (BF) extract, a natural product with anti-inflammatory properties, has been traditionally used to treat menopausal symptoms, but its role in osteoporosis, another serious health concern of menopausal women, remains unknown. Here we investigated whether and how BF prevents estrogen deficiency-induced bone loss using both in vitro and in vivo models.Methods: Female Sprague-Dawley rats were ovariectomized (OVX) and subjected to oral BF treatment daily for 8 weeks. Additionally, pre-osteoclastic RAW 264.7 cells were employed to evaluate the effects of BF and its underlying mechanism on receptor activator of nuclear factor kappa-B ligand (RANKL)-induced osteoclast formation in vitro.Results: A high dose of BF partially prevented ovariectomy (OVX)-induced bone loss and reduced the levels of tartrate-resistant acid phosphatase (TRAP) in serum and osteoclast numbers in femurs of OVX rats. Furthermore, BF clearly inhibited RANKL-induced osteoclast differentiation and bone resorption activity in RAW 264.7 cells. BF also inhibited the osteoclastogenic transcription factors c-Fos and nuclear factor of activated T cells c1 (NFATc1) and, consequently, downregulated the expression of osteoclast marker genes. Moreover, BF upregulated interferon-β (IFN-β)/inducible nitric oxide synthase (iNOS)/nitric oxide (NO) signaling, even though it had no impact on mitogen-activated protein kinases (MAPK) or NF-κB. The inhibition of osteoclast formation by BF was abrogated by iNOS-specific inhibitors. Consistent with cellular studies, BF upregulated iNOS protein expression in femurs from OVX rats.Conclusion: Taken together, our results indicate that BF partially prevented estrogen deficiency-induced bone loss with anti-osteoclastogenic activity potentially due to enhanced iNOS/NO signaling

Estimating the malaria transmission of Plasmodium vivax based on serodiagnosis

Abstract Background: Plasmodium vivax re-emerged in 1993 and has now become a major public health problem during the summer season in South Korea. The aim of this study was to interpret and understand the meaning of seroepidemiological studies for developing the best malaria control programme in South Korea. Methods: Blood samples were collected in Gimpo city, Paju city, Yeoncheon County, Cheorwon County and Goseong County of high risk area in South Korea. Microscopy was performed to identify patients infected with P. vivax. Antibody detection for P. vivax was performed using indirect fluorescent antibody test (IFAT). Results: A total of 1,574 blood samples was collected from participants in the study areas and evaluated against three parameters: IFAT positive rate, annual antibody positive index (AAPI), and annual parasite index (API). The IFAT positive rate was 7.24% (n = 114). Of the five study areas, Gimpo had the highest IFAT positive rate (13.68%) and AAPI (4.63). Yeongcheon had the highest API in 2005 (2.06) while Gimpo had the highest API in 2006 (5.00). No correlation was observed between any of the three parameters and study sites&apos; distance from the demilitarized zone (DMZ). Conclusions: These results showed that P. vivax antibody levels could provide useful information about the prevalence of malaria in endemic areas. Furthermore, AAPI results for each year showed a closer relationship to API the following year than the API of the same year and thus could be helpful in predicting malaria transmission risks

Comparison of the antibody responses to Plasmodium vivax and Plasmodium falciparum antigens in residents of Mandalay, Myanmar

<p>Abstract</p> <p>Background</p> <p>The aim of this study was to investigate the profile of antibodies against several antigens of <it>Plasmodium vivax </it>and <it>Plasmodium falciparum </it>in Mandalay, Myanmar.</p> <p>Methods</p> <p>Malaria parasites were identified by microscopic examination. To test the antibodies against <it>P. vivax </it>and <it>P. falciparum </it>in sera, an indirect immunofluorescence antibody test (IFAT) was performed using asexual blood parasite antigens. An enzyme-linked immunosorbent assay (ELISA) was performed with circumsporozoite protein (CSP), Pvs25 and Pvs28 recombinant proteins of transmission-blocking vaccine candidates for <it>P. vivax</it>, and liver stage specific antigen-1 and -3 (PfLSA-1, PfLSA-3) for <it>P. falciparum</it>.</p> <p>Results</p> <p>Fourteen patients among 112 were found to be infected with <it>P. vivax </it>and 26 with <it>P. falciparum </it>by thick smear examination. Twenty-three patients were found to be infected with <it>P. vivax</it>, 19 with <it>P. falciparum </it>and five with both by thin smear examination. Blood samples were divided into two groups: Group I consisted of patients who were positive for infection by microscopic examination, and Group II consisted of those who showed symptoms, but were negative in microscopic examination. In <it>P. falciparum</it>, IgG against the blood stage antigen in Group I (80.8%) was higher than in Group II (70.0%). In <it>P. vivax</it>, IgG against the blood stage antigen in Group I (53.8%) was higher than in Group II (41.7%). However, the positivity rate of the PvCSP VK210 subtype in Group II (40.0%) was higher than in Group I (23.1%). Similarly for the PvCSP VK247 subtype, Group II (21.7%) was higher than that for Group I (9.6%). A similar pattern was observed in the ELISA using Pvs25 and Pvs28: positive rates of Group II were higher than those for Group I. However, those differences were not shown significant in statistics.</p> <p>Conclusions</p> <p>The positive rates for blood stage antigens of <it>P. falciparum </it>were higher in Group I than in Group II, but the positive rates for antigens of other stages (PfLSA-1 and -3) showed opposite results. Similar to <it>P. falciparum</it>, the positive rate of pre-blood stage (CSP VK210 and 247 subtype) and post-blood stage (Pvs25 and 28) antigens of <it>P. vivax </it>were higher in Group II than in Group I. Therefore, sero-diagnosis is not helpful to discriminate between malaria patients and symptomatic individuals during the epidemic season in Myanmar.</p