Platypus: Quick, Cheap, and Powerful Refinement of LLMs

We present $\textbf{Platypus}$, a family of fine-tuned and merged Large Language Models (LLMs) that achieves the strongest performance and currently stands at first place in HuggingFace's Open LLM Leaderboard as of the release date of this work. In this work we describe (1) our curated dataset $\textbf{Open-Platypus}$, that is a subset of other open datasets and which $\textit{we release to the public}$ (2) our process of fine-tuning and merging LoRA modules in order to conserve the strong prior of pretrained LLMs, while bringing specific domain knowledge to the surface (3) our efforts in checking for test data leaks and contamination in the training data, which can inform future research. Specifically, the Platypus family achieves strong performance in quantitative LLM metrics across model sizes, topping the global Open LLM leaderboard while using just a fraction of the fine-tuning data and overall compute that are required for other state-of-the-art fine-tuned LLMs. In particular, a 13B Platypus model can be trained on $\textit{a single}$ A100 GPU using 25k questions in 5 hours. This is a testament of the quality of our Open-Platypus dataset, and opens opportunities for more improvements in the field. Project page: https://platypus-llm.github.i

"Nonbaryonic" Dark Matter as Baryonic Color Superconductor

We discuss a novel cold dark matter candidate which is formed from the ordinary quarks during the QCD phase transition when the axion domain wall undergoes an unchecked collapse due to the tension in the wall. If a large number of quarks is trapped inside the bulk of a closed axion domain wall, the collapse stops due to the internal Fermi pressure. In this case the system in the bulk, may reach the critical density when it undergoes a phase transition to a color superconducting phase with the ground state being the quark condensate, similar to the Cooper pairs in BCS theory. If this happens, the new state of matter representing the diquark condensate with a large baryon number $B \sim 10^{32}$ becomes a stable soliton-like configuration. Consequently, it may serve as a novel cold dark matter candidate.Comment: Title changed. Two figures and Appendix added. Part on baryogenesis is removed and posted as a separate paper hep-ph/030908

The Ninth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the SDSS-III Baryon Oscillation Spectroscopic Survey

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.Comment: 9 figures; 2 tables. Submitted to ApJS. DR9 is available at http://www.sdss3.org/dr

The Baryon Oscillation Spectroscopic Survey of SDSS-III

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.Comment: 49 pages, 16 figures, accepted by A

The Eighth Data Release of the Sloan Digital Sky Survey: First Data from SDSS-III

The Sloan Digital Sky Survey (SDSS) started a new phase in August 2008, with new instrumentation and new surveys focused on Galactic structure and chemical evolution, measurements of the baryon oscillation feature in the clustering of galaxies and the quasar Ly alpha forest, and a radial velocity search for planets around ~8000 stars. This paper describes the first data release of SDSS-III (and the eighth counting from the beginning of the SDSS). The release includes five-band imaging of roughly 5200 deg^2 in the Southern Galactic Cap, bringing the total footprint of the SDSS imaging to 14,555 deg^2, or over a third of the Celestial Sphere. All the imaging data have been reprocessed with an improved sky-subtraction algorithm and a final, self-consistent photometric recalibration and flat-field determination. This release also includes all data from the second phase of the Sloan Extension for Galactic Understanding and Evolution (SEGUE-2), consisting of spectroscopy of approximately 118,000 stars at both high and low Galactic latitudes. All the more than half a million stellar spectra obtained with the SDSS spectrograph have been reprocessed through an improved stellar parameters pipeline, which has better determination of metallicity for high metallicity stars.Comment: Astrophysical Journal Supplements, in press (minor updates from submitted version

Accelerated Immunodeficiency by Anti-CCR5 Treatment in HIV Infection

In 50% of progressing HIV-1 patients, CXCR4-tropic (X4) virus emerges late in infection, often overtaking CCR5-tropic (R5) virus as the dominant viral strain. This “phenotypic switch” is strongly associated with rapidly declining CD4+ T cell counts and AIDS onset, yet its causes remain unknown. Here, we analyze a mathematical model for the mechanism of X4 emergence in late-stage HIV infection and use this analysis to evaluate the utility of a promising new class of antiretroviral drugs—CCR5 inhibitors—in dual R5, X4 infection. The model shows that the R5-to-X4 switch occurs as CD4+ T cell activation levels increase above a threshold and as CD4+ T cell counts decrease below a threshold during late-stage HIV infection. Importantly, the model also shows that highly active antiretroviral therapy (HAART) can inhibit X4 emergence but that monotherapy with CCR5 blockers can accelerate X4 onset and immunodeficiency if X4 infection of memory CD4+ T cells occurs at a high rate. Fortunately, when CXCR4 blockers or HAART are used in conjunction with CCR5 blockers, this risk of accelerated immunodeficiency is eliminated. The results suggest that CCR5 blockers will be more effective when used in combination with CXCR4 blockers and caution against CCR5 blockers in the absence of an effective HAART regimen or during HAART failure

The Arabidopsis thaliana Homeobox Gene ATHB12 Is Involved in Symptom Development Caused by Geminivirus Infection

BACKGROUND: Geminiviruses are single-stranded DNA viruses that infect a number of monocotyledonous and dicotyledonous plants. Arabidopsis is susceptible to infection with the Curtovirus, Beet severe curly top virus (BSCTV). Infection of Arabidopsis with BSCTV causes severe symptoms characterized by stunting, leaf curling, and the development of abnormal inflorescence and root structures. BSCTV-induced symptom development requires the virus-encoded C4 protein which is thought to interact with specific plant-host proteins and disrupt signaling pathways important for controlling cell division and development. Very little is known about the specific plant regulatory factors that participate in BSCTV-induced symptom development. This study was conducted to identify specific transcription factors that are induced by BSCTV infection. METHODOLOGY/PRINCIPAL FINDINGS: Arabidopsis plants were inoculated with BSCTV and the induction of specific transcription factors was monitored using quantitative real-time polymerase chain reaction assays. We found that the ATHB12 and ATHB7 genes, members of the homeodomain-leucine zipper family of transcription factors previously shown to be induced by abscisic acid and water stress, are induced in symptomatic tissues of Arabidopsis inoculated with BSCTV. ATHB12 expression is correlated with an array of morphological abnormalities including leaf curling, stunting, and callus-like structures in infected Arabidopsis. Inoculation of plants with a BSCTV mutant with a defective c4 gene failed to induce ATHB12. Transgenic plants expressing the BSCTV C4 gene exhibited increased ATHB12 expression whereas BSCTV-infected ATHB12 knock-down plants developed milder symptoms and had lower ATHB12 expression compared to the wild-type plants. Reporter gene studies demonstrated that the ATHB12 promoter was responsive to BSCTV infection and the highest expression levels were observed in symptomatic tissues where cell cycle genes also were induced. CONCLUSIONS/SIGNIFICANCE: These results suggest that ATHB7 and ATHB12 may play an important role in the activation of the abnormal cell division associated with symptom development during geminivirus infection

Characterization in vitro and in vivo of a pandemic H1N1 influenza virus from a fatal case

Pandemic 2009 H1N1 (pH1N1) influenza viruses caused mild symptoms in most infected patients. However, a greater rate of severe disease was observed in healthy young adults and children without co-morbid conditions. Here we tested whether influenza strains displaying differential virulence could be present among circulating pH1N1 viruses. The biological properties and the genotype of viruses isolated from a patient showing mild disease (M) or from a fatal case (F), both without known co-morbid conditions were compared in vitro and in vivo. The F virus presented faster growth kinetics and stronger induction of cytokines than M virus in human alveolar lung epithelial cells. In the murine model in vivo, the F virus showed a stronger morbidity and mortality than M virus. Remarkably, a higher proportion of mice presenting infectious virus in the hearts, was found in F virus-infected animals. Altogether, the data indicate that strains of pH1N1 virus with enhanced pathogenicity circulated during the 2009 pandemic. In addition, examination of chemokine receptor 5 (CCR5) genotype, recently reported as involved in severe influenza virus disease, revealed that the F virus-infected patient was homozygous for the deleted form of CCR5 receptor (CCR5Δ32).Funding Statement: This work was supported by Instituto de Salud Carlos III (Programa especial de investigación sobre la gripe pándemica GR09/0023, GR09/0040, GR09/0039) and Ciber de Enfermedades Respiratorias. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.S

The genomes of two key bumblebee species with primitive eusocial organization

Background: The shift from solitary to social behavior is one of the major evolutionary transitions. Primitively eusocial bumblebees are uniquely placed to illuminate the evolution of highly eusocial insect societies. Bumblebees are also invaluable natural and agricultural pollinators, and there is widespread concern over recent population declines in some species. High-quality genomic data will inform key aspects of bumblebee biology, including susceptibility to implicated population viability threats. Results: We report the high quality draft genome sequences of Bombus terrestris and Bombus impatiens, two ecologically dominant bumblebees and widely utilized study species. Comparing these new genomes to those of the highly eusocial honeybee Apis mellifera and other Hymenoptera, we identify deeply conserved similarities, as well as novelties key to the biology of these organisms. Some honeybee genome features thought to underpin advanced eusociality are also present in bumblebees, indicating an earlier evolution in the bee lineage. Xenobiotic detoxification and immune genes are similarly depauperate in bumblebees and honeybees, and multiple categories of genes linked to social organization, including development and behavior, show high conservation. Key differences identified include a bias in bumblebee chemoreception towards gustation from olfaction, and striking differences in microRNAs, potentially responsible for gene regulation underlying social and other traits. Conclusions: These two bumblebee genomes provide a foundation for post-genomic research on these key pollinators and insect societies. Overall, gene repertoires suggest that the route to advanced eusociality in bees was mediated by many small changes in many genes and processes, and not by notable expansion or depauperation