OpenAssistant Conversations -- Democratizing Large Language Model Alignment

Aligning large language models (LLMs) with human preferences has proven to drastically improve usability and has driven rapid adoption as demonstrated by ChatGPT. Alignment techniques such as supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) greatly reduce the required skill and domain knowledge to effectively harness the capabilities of LLMs, increasing their accessibility and utility across various domains. However, state-of-the-art alignment techniques like RLHF rely on high-quality human feedback data, which is expensive to create and often remains proprietary. In an effort to democratize research on large-scale alignment, we release OpenAssistant Conversations, a human-generated, human-annotated assistant-style conversation corpus consisting of 161,443 messages in 35 different languages, annotated with 461,292 quality ratings, resulting in over 10,000 complete and fully annotated conversation trees. The corpus is a product of a worldwide crowd-sourcing effort involving over 13,500 volunteers. Models trained on OpenAssistant Conversations show consistent improvements on standard benchmarks over respective base models. We release our code and data under a fully permissive licence.Comment: Published in NeurIPS 2023 Datasets and Benchmark

Validation of the SCID-hu Thy/Liv mouse model with four classes of licensed antiretrovirals.

BackgroundThe SCID-hu Thy/Liv mouse model of HIV-1 infection is a useful platform for the preclinical evaluation of antiviral efficacy in vivo. We performed this study to validate the model with representatives of all four classes of licensed antiretrovirals.Methodology/principal findingsEndpoint analyses for quantification of Thy/Liv implant viral load included ELISA for cell-associated p24, branched DNA assay for HIV-1 RNA, and detection of infected thymocytes by intracellular staining for Gag-p24. Antiviral protection from HIV-1-mediated thymocyte depletion was assessed by multicolor flow cytometric analysis of thymocyte subpopulations based on surface expression of CD3, CD4, and CD8. These mice can be productively infected with molecular clones of HIV-1 (e.g., the X4 clone NL4-3) as well as with primary R5 and R5X4 isolates. To determine whether results in this model are concordant with those found in humans, we performed direct comparisons of two drugs in the same class, each of which has known potency and dosing levels in humans. Here we show that second-generation antiretrovirals were, as expected, more potent than their first-generation predecessors: emtricitabine was more potent than lamivudine, efavirenz was more potent than nevirapine, and atazanavir was more potent than indinavir. After interspecies pharmacodynamic scaling, the dose ranges found to inhibit viral replication in the SCID-hu Thy/Liv mouse were similar to those used in humans. Moreover, HIV-1 replication in these mice was genetically stable; treatment of the mice with lamivudine did not result in the M184V substitution in reverse transcriptase, and the multidrug-resistant NY index case HIV-1 retained its drug-resistance substitutions.ConclusionGiven the fidelity of such comparisons, we conclude that this highly reproducible mouse model is likely to predict clinical antiviral efficacy in humans

Zinc intake, status and indices of cognitive function in adults and children: a systematic review and meta-analysis

In developing countries, deficiencies of micronutrients are thought to have a major impact on child development; however, a consensus on the specific relationship between dietary zinc intake and cognitive function remains elusive. The aim of this systematic review was to examine the relationship between zinc intake, status and indices of cognitive function in children and adults. A systematic literature search was conducted using EMBASE, MEDLINE and Cochrane Library databases from inception to March 2014. Included studies were those that supplied zinc as supplements or measured dietary zinc intake. A meta-analysis of the extracted data was performed where sufficient data were available. Of all of the potentially relevant papers, 18 studies met the inclusion criteria, 12 of which were randomised controlled trials (RCTs; 11 in children and 1 in adults) and 6 were observational studies (2 in children and 4 in adults). Nine of the 18 studies reported a positive association between zinc intake or status with one or more measure of cognitive function. Meta-analysis of data from the adult’s studies was not possible because of limited number of studies. A meta-analysis of data from the six RCTs conducted in children revealed that there was no significant overall effect of zinc intake on any indices of cognitive function: intelligence, standard mean difference of <0.001 (95% confidence interval (CI) –0.12, 0.13) P=0.95; executive function, standard mean difference of 0.08 (95% CI, –0.06, 022) P=0.26; and motor skills standard mean difference of 0.11 (95% CI –0.17, 0.39) P=0.43. Heterogeneity in the study designs was a major limitation, hence only a small number (n=6) of studies could be included in the meta-analyses. Meta-analysis failed to show a significant effect of zinc supplementation on cognitive functioning in children though, taken as a whole, there were some small indicators of improvement on aspects of executive function and motor development following supplementation but high-quality RCTs are necessary to investigate this further

Entrepreneurial sons, patriarchy and the Colonels' experiment in Thessaly, rural Greece

Existing studies within the field of institutional entrepreneurship explore how entrepreneurs influence change in economic institutions. This paper turns the attention of scholarly inquiry on the antecedents of deinstitutionalization and more specifically, the influence of entrepreneurship in shaping social institutions such as patriarchy. The paper draws from the findings of ethnographic work in two Greek lowland village communities during the military Dictatorship (1967–1974). Paradoxically this era associated with the spread of mechanization, cheap credit, revaluation of labour and clear means-ends relations, signalled entrepreneurial sons’ individuated dissent and activism who were now able to question the Patriarch’s authority, recognize opportunities and act as unintentional agents of deinstitutionalization. A ‘different’ model of institutional change is presented here, where politics intersects with entrepreneurs, in changing social institutions. This model discusses the external drivers of institutional atrophy and how handling dissensus (and its varieties over historical time) is instrumental in enabling institutional entrepreneurship

Renal Effects of the Novel Selective Adenosine A1 Receptor Blocker SLV329 in Experimental Liver Cirrhosis in Rats

Liver cirrhosis is often complicated by an impaired renal excretion of water and sodium. Diuretics tend to further deteriorate renal function. It is unknown whether chronic selective adenosine A1 receptor blockade, via inhibition of the hepatorenal reflex and the tubuloglomerular feedback, might exert diuretic and natriuretic effects without a reduction of the glomerular filtration rate. In healthy animals intravenous treatment with the novel A1 receptor antagonist SLV329 resulted in a strong dose-dependent diuretic (up to 3.4-fold) and natriuretic (up to 13.5-fold) effect without affecting creatinine clearance. Male Wistar rats with thioacetamide-induced liver cirrhosis received SLV329, vehicle or furosemide for 12 weeks. The creatinine clearance of cirrhotic animals decreased significantly (−36.5%, p<0.05), especially in those receiving furosemide (−41.9%, p<0.01). SLV329 was able to prevent this decline of creatinine clearance. Mortality was significantly lower in cirrhotic animals treated with SLV329 in comparison to animals treated with furosemide (17% vs. 54%, p<0.05). SLV329 did not relevantly influence the degree of liver fibrosis, kidney histology or expression of hepatic or renal adenosine receptors. In conclusion, chronic treatment with SLV329 prevented the decrease of creatinine clearance in a rat model of liver cirrhosis. Further studies will have to establish whether adenosine A1 receptor antagonists are clinically beneficial at different stages of liver cirrhosis

Men's values-based factors on prostate cancer risk genetic testing: A telephone survey

BACKGROUND: While a definitive genetic test for Hereditary Prostate Cancer (HPC) is not yet available, future HPC risk testing may become available. Past survey data have shown high interest in HPC testing, but without an in-depth analysis of its underlying rationale to those considering it. METHODS: Telephone computer-assisted interviews of 400 men were conducted in a large metropolitan East-coast city, with subsequent development of psychometric scales and their correlation with intention to receive testing. RESULTS: Approximately 82% of men interviewed expressed that they "probably" or "definitely" would get genetic testing for prostate cancer risk if offered now. Factor analysis revealed four distinct, meaningful factors for intention to receive genetic testing for prostate cancer risk. These factors reflected attitudes toward testing and were labeled "motivation to get testing," "consequences and actions after knowing the test result," "psychological distress," and "beliefs of favorable outcomes if tested" (α = 0.89, 0.73, 0.73, and 0.60, respectively). These factors accounted for 70% of the total variability. The domains of motivation (directly), consequences (inversely), distress (inversely), and positive expectations (directly) all correlated with intention to receive genetic testing (p < 0.001). CONCLUSIONS: Men have strong attitudes favoring genetic testing for prostate cancer risk. The factors most associated with testing intention include those noted in past cancer genetics studies, and also highlights the relevance in considering one's motivation and perception of positive outcomes in genetic decision-making

INSGFP/w human embryonic stem cells facilitate isolation of in vitro derived insulin-producing cells

AIMS/HYPOTHESIS: We aimed to generate human embryonic stem cell (hESC) reporter lines that would facilitate the characterisation of insulin-producing (INS⁺) cells derived in vitro. METHODS: Homologous recombination was used to insert sequences encoding green fluorescent protein (GFP) into the INS locus, to create reporter cell lines enabling the prospective isolation of viable INS⁺ cells. RESULTS: Differentiation of INS(GFP/w) hESCs using published protocols demonstrated that all GFP⁺ cells co-produced insulin, confirming the fidelity of the reporter gene. INS-GFP⁺ cells often co-produced glucagon and somatostatin, confirming conclusions from previous studies that early hESC-derived insulin-producing cells were polyhormonal. INS(GFP/w) hESCs were used to develop a 96-well format spin embryoid body (EB) differentiation protocol that used the recombinant protein-based, fully defined medium, APEL. Like INS-GFP⁺ cells generated with other methods, those derived using the spin EB protocol expressed a suite of pancreatic-related transcription factor genes including ISL1, PAX6 and NKX2.2. However, in contrast with previous methods, the spin EB protocol yielded INS-GFP⁺ cells that also co-expressed the beta cell transcription factor gene, NKX6.1, and comprised a substantial proportion of monohormonal INS⁺ cells. CONCLUSIONS/INTERPRETATION: INS(GFP/w) hESCs are a valuable tool for investigating the nature of early INS⁺ progenitors in beta cell ontogeny and will facilitate the development of novel protocols for generating INS⁺ cells from differentiating hESCs

Early Vegetation Development on an Exposed Reservoir: Implications for Dam Removal

The 4-year drawdown of Horsetooth Reservoir, Colorado, for dam maintenance, provides a case study analog of vegetation response on sediment that might be exposed from removal of a tall dam. Early vegetation recovery on the exposed reservoir bottom was a combination of (1) vegetation colonization on bare, moist substrates typical of riparian zones and reservoir sediment of shallow dams and (2) a shift in moisture status from mesic to the xeric conditions associated with the pre-impoundment upland position of most of the drawdown zone. Plant communities changed rapidly during the first four years of exposure, but were still substantially different from the background upland plant community. Predictions from the recruitment box model about the locations of Populus deltoides subsp. monilifera (plains cottonwood) seedlings relative to the water surface were qualitatively confirmed with respect to optimum locations. However, the extreme vertical range of water surface elevations produced cottonwood seed regeneration well outside the predicted limits of drawdown rate and height above late summer stage. The establishment and survival of cottonwood at high elevations and the differences between the upland plant community and the community that had developed after four years of exposure suggest that vegetation recovery following tall dam removal will follow a trajectory very different from a simple reversal of the response to dam construction, involving not only long time scales of establishment and growth of upland vegetation, but also possibly decades of persistence of legacy vegetation established during the reservoir to upland transition

Tiny Sea Anemone from the Lower Cambrian of China

Background Abundant fossils from the Ediacaran and Cambrian showing cnidarian grade grossly suggest that cnidarian diversification occurred earlier than that of other eumetazoans. However, fossils of possible soft-bodied polyps are scanty and modern corals are dated back only to the Middle Triassic, although molecular phylogenetic results support the idea that anthozoans represent the first major branch of the Cnidaria. Because of difficulties in taxonomic assignments owing to imperfect preservation of fossil cnidarian candidates, little is known about forms ancestral to those of living groups. Methods and Findings We have analyzed the soft-bodied polypoid microfossils Eolympia pediculata gen. et sp. nov. from the lowest Cambrian Kuanchuanpu Formation in southern China by scanning electron microscopy and computer-aided microtomography after isolating fossils from sedimentary rocks by acetic acid maceration. The fossils, about a half mm in body size, are preserved with 18 mesenteries including directives bilaterally arranged, 18 tentacles and a stalk-like pedicle. The pedicle suggests a sexual life cycle, while asexual reproduction by transverse fission also is inferred by circumferential grooves on the body column. Conclusions The features found in the present fossils fall within the morphological spectrum of modern Hexacorallia excluding Ceriantharia, and thus Eolympia pediculata could be a stem member for this group. The fossils also demonstrate that basic features characterizing modern hexacorallians such as bilateral symmetry and the reproductive system have deep roots in the Early Cambrian.Funding was provided by the National Science Foundation of China (http://www.nsfc.gov.cn/) grants 40830208, 40602003, 50702005 to J. Han and D. G. Shu, and by MOST Special Fund from the State Key Laboratory of Continental Dynamics, Northwest University, China (http://sklcd.nwu.edu.cn/) to J. Han and D. G. Shu. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.Peer reviewe