AceGPT, Localizing Large Language Models in Arabic

This paper explores the imperative need and methodology for developing a localized Large Language Model (LLM) tailored for Arabic, a language with unique cultural characteristics that are not adequately addressed by current mainstream models like ChatGPT. Key concerns additionally arise when considering cultural sensitivity and local values. To this end, the paper outlines a packaged solution, including further pre-training with Arabic texts, supervised fine-tuning (SFT) using native Arabic instructions and GPT-4 responses in Arabic, and reinforcement learning with AI feedback (RLAIF) using a reward model that is sensitive to local culture and values. The objective is to train culturally aware and value-aligned Arabic LLMs that can serve the diverse application-specific needs of Arabic-speaking communities. Extensive evaluations demonstrated that the resulting LLM called `AceGPT' is the SOTA open Arabic LLM in various benchmarks, including instruction-following benchmark (i.e., Arabic Vicuna-80 and Arabic AlpacaEval), knowledge benchmark (i.e., Arabic MMLU and EXAMs), as well as the newly-proposed Arabic cultural \& value alignment benchmark. Notably, AceGPT outperforms ChatGPT in the popular Vicuna-80 benchmark when evaluated with GPT-4, despite the benchmark's limited scale. % Natural Language Understanding (NLU) benchmark (i.e., ALUE) Codes, data, and models are in https://github.com/FreedomIntelligence/AceGPT.Comment: https://github.com/FreedomIntelligence/AceGP

Bidirectional cross-regulation between the eNOS and ß-catenin signalling pathways

AIMS: β-catenin has been shown to be regulated by inducible nitric oxide synthase (NOS) in endothelial cells. We investigated here whether β-catenin interacts with and regulates endothelial NOS (eNOS) and whether eNOS activation promotes β-catenin signalling. METHODS AND RESULTS: We identified β-catenin as a novel eNOS binding protein in human umbilical vein endothelial cells (HUVECs) by mass spectroscopy and western blot analyses of β-catenin and eNOS immunoprecipitates. This was confirmed by in situ proximity ligation assay. eNOS activity, assessed by cGMP production and eNOS phosphorylation (Ser1177), was enhanced in β-catenin(-/-) mouse pulmonary endothelial cells (MPECs) relative to wild-type MPECs. eNOS activation (using adenosine, salbutamol, thrombin, or histamine), or application of an NO donor (spermine NONOate) or cGMP-analogue (8-bromo-cGMP) caused nuclear translocation of β-catenin in HUVEC as shown by western blotting of nuclear extracts. Exposure to spermine NONOate, 8-bromo-cGMP, or sildenafil (a phosphodiesterase type 5 inhibitor) also increased the expression of β-catenin-dependent transcripts, IL-8, and cyclin D1. Stimulation of wild-type MPECs with basic fibroblast growth factor (bFGF), vascular endothelial growth factor (VEGF), spermine NONOate, 8-bromo-cGMP, or sildenafil increased tube length relative to controls in an angiogenesis assay. These responses were abrogated in β-catenin(-/-) MPECs, with the exception of that to bFGF which is NO-independent. In C57BL/6 mice, subcutaneous VEGF-supplemented Matrigel plugs containing β-catenin(-/-) MPECs exhibited reduced angiogenesis compared with plugs containing wild-type MPECs. Angiogenesis was not altered in bFGF-supplemented Matrigel. CONCLUSION: These data reveal bidirectional cross-talk and regulation between the NO-cGMP and β-catenin signalling pathways

Inducible nitric oxide synthase (iNOS) activity promotes ischaemic skin flap survival

1. We have examined the role of nitric oxide (NO) in a model of functional angiogenesis in which survival of a skin flap depends entirely on angiogenesis to provide an arterial blood supply to maintain tissue viability. 2. The different effects of nitric oxide synthase (NOS) inhibitors on rat skin flap survival appeared to be explained on the basis of their NOS isoform selectivity. Skin flap survival was decreased by iNOS-selective (inducible NOS) inhibitors, S-methyl-isothiourea, aminoguanidine and aminoethylthiorea; unaffected by the non-selective inhibitor nitro-imino-L-ornithine; and enhanced by the cNOS (constitutive NOS, that is endothelial NOS (eNOS) and neuronal NOS (nNOS)) inhibitor, nitro-L-arginine methyl ester. 3. Skin flap survival was reduced in mice with targeted disruption of the iNOS gene (iNOS knockout mice), and the administration of nitro-L-arginine methyl ester significantly increased flap survival in iNOS knockout mice (P<0.05). 4. iNOS immunoreactivity was identified in mast cells in the angiogenic region. Immunoreactive vascular endothelial growth factor (VEGF) and basic fibroblast growth factor were also localized to mast cells. 5. The combination of interferon-γ and tumour necrosis factor-α induced NO production and increased VEGF levels in mast cells cultured from bone marrow of wild-type, but not iNOS KO mice. 6. The increased tissue survival associated with the capacity for iNOS expression may be related to iNOS-dependent enhancement of VEGF levels and an ensuing angiogenic response. Our results provide both pharmacological and genetic evidence that iNOS activity promotes survival of ischaemic tissue

Nitric oxide synthase expression, enzyme activity and NO production during angiogenesis in the chick chorioallantoic membrane

1. In order to elucidate further the role of nitric oxide (NO) as an endogenous antiangiogenic mediator, mRNA expression of inducible nitric oxide synthase (iNOS), enzyme activity and production of NO were determined in the chick chorioallantoic membrane (CAM), an in vivo model of angiogenesis. In this model, maximum angiogenesis is reached between days 9–12 of chick embryo development. After that period, vascular density remains constant. 2. Inducible NO synthase (iNOS) mRNA expression, determined by reverse transcriptase polymerase chain reaction (RT–PCR), increased from the 8th day reaching a maximum (70% increase) at days 10–11. 3. NO synthase activity, determined as citrulline formation in the presence of calcium, also increased from day 8 reaching a maximum around day 10 (100% increase). Similar results were obtained in the absence of calcium suggesting that the NOS determined was the inducible form. 4. Nitric oxide production, determined as nitrites, increased from day 8 reaching a maximum around day 10 (64% increase) and remaining stable at day 13. 5. Finally, the bacterial lipopolysaccharide LPS (which activates transcriptionally iNOS), inhibited dose dependently angiogenesis in the CAM. These results in connection with previous findings from this laboratory, showing that NO inhibits angiogenesis in the CAM, suggest that increases in iNOS expression, enzyme activity and NO production closely parallel the progression of angiogenesis in the CAM, thus providing an endogenous brake to control this process

The effect of hydroxyapatite nanocrystals on microvascular endothelial cell viability and functions

To favor bone reconstitution with biomaterials endothelial cells should maintain proper functions to drive angiogenesis. To this aim nanocrystals of hydroxyapatite (HA) have been synthesized and characterized on endothelial cells. Microvascular endothelial cells have been exposed to stoichiometric HA nanocrystals. Cell morphology and organization of cytoskeletal proteins have been monitored by SEM analysis and immunofluorescence. Biochemical markers of physiological and pathological responses of endothelial cells, endothelial constitutive nitric oxide synthase, and cycloxygenase-2 (ecNOS and COX-2, respectively) have been measured by immunofluorescence. Crystallized HA sustained endothelial survival without any cytotoxic effect. At the observation with SEM, endothelial cell morphology was maintained in the presence of HA. The localization and organization of beta-actin documented the formation of stress fibers, indicating an activation of endothelial cells induced by HA nanocrystals. Immunohistochemistry for biochemical key signaling pathways in endothelium demonstrated that nanocrystals of HA maintained the expression of ecNOS and did not increase COX-2 expression. In conclusion, the present findings indicate that HA nanocrystals exhibit high biocompatibility for microvascular endothelium. In the presence of HA nanocrystals endothelial cells maintain biochemical markers of healthy endothelium. They do not acquire a proinflammatory or thrombogenic phenotype, but express markers of functioning endothelium that might contribute to angiogenesi