DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models

A few benchmarking datasets have been released to evaluate the factual knowledge of pretrained language models. These benchmarks (e.g., LAMA, and ParaRel) are mainly developed in English and later are translated to form new multilingual versions (e.g., mLAMA, and mParaRel). Results on these multilingual benchmarks suggest that using English prompts to recall the facts from multilingual models usually yields significantly better and more consistent performance than using non-English prompts. Our analysis shows that mLAMA is biased toward facts from Western countries, which might affect the fairness of probing models. We propose a new framework for curating factual triples from Wikidata that are culturally diverse. A new benchmark DLAMA-v1 is built of factual triples from three pairs of contrasting cultures having a total of 78,259 triples from 20 relation predicates. The three pairs comprise facts representing the (Arab and Western), (Asian and Western), and (South American and Western) countries respectively. Having a more balanced benchmark (DLAMA-v1) supports that mBERT performs better on Western facts than non-Western ones, while monolingual Arabic, English, and Korean models tend to perform better on their culturally proximate facts. Moreover, both monolingual and multilingual models tend to make a prediction that is culturally or geographically relevant to the correct label, even if the prediction is wrong.Comment: Accepted to ACL 2023 (Findings

ALDi: Quantifying the Arabic Level of Dialectness of Text

Transcribed speech and user-generated text in Arabic typically contain a mixture of Modern Standard Arabic (MSA), the standardized language taught in schools, and Dialectal Arabic (DA), used in daily communications. To handle this variation, previous work in Arabic NLP has focused on Dialect Identification (DI) on the sentence or the token level. However, DI treats the task as binary, whereas we argue that Arabic speakers perceive a spectrum of dialectness, which we operationalize at the sentence level as the Arabic Level of Dialectness (ALDi), a continuous linguistic variable. We introduce the AOC-ALDi dataset (derived from the AOC dataset), containing 127,835 sentences (17% from news articles and 83% from user comments on those articles) which are manually labeled with their level of dialectness. We provide a detailed analysis of AOC-ALDi and show that a model trained on it can effectively identify levels of dialectness on a range of other corpora (including dialects and genres not included in AOC-ALDi), providing a more nuanced picture than traditional DI systems. Through case studies, we illustrate how ALDi can reveal Arabic speakers' stylistic choices in different situations, a useful property for sociolinguistic analyses.Comment: Accepted to EMNLP 202

ALDi: Quantifying the Arabic Level of Dialectness of Text

Transcribed speech and user-generated text in Arabic typically contain a mixture of Modern Standard Arabic (MSA), the standardized language taught in schools, and Dialectal Arabic (DA), used in daily communications. To handle this variation, previous work in Arabic NLP has focused on Dialect Identification (DI) on the sentence or the token level. However, DI treats the task as binary, whereas we argue that Arabic speakers perceive a spectrum of dialectness, which we operationalize at the sentence level as the Arabic Level of Dialectness (ALDi), a continuous linguistic variable. We introduce the AOC-ALDi dataset (derived from the AOC dataset), containing 127,835 sentences (17% from news articles and 83% from user comments on those articles) which are manually labeled with their level of dialectness. We provide a detailed analysis of AOC-ALDi and show that a model trained on it can effectively identify levels of dialectness on a range of other corpora (including dialects and genres not included in AOC-ALDi), providing a more nuanced picture than traditional DI systems. Through case studies, we illustrate how ALDi can reveal Arabic speakers' stylistic choices in different situations, a useful property for sociolinguistic analyses

Public Perception of Environmental Change in Rapidly Growing Cities: the Case of Cairo, Egypt

Cities, especially in the global south, have expanded exponentially over the recent time. However, the pace of the required public acceptance of environmental change and the progression (invasion) into new ecosystems is not yet fully taking place at the same speed of the socio-cultural and natural identity changes and environmental awareness. Accordingly, scholars nowadays are calling for the pressing necessity of dealing with cities as socio-ecological realms, where social and ecological issues should be tackled and solved in an integrated manner. Future extensions of Cairo are promoted by the Egyptian government and the private sector promises unrealistic images of landscape futures through unsustainable landscape practices influencing the socio-cultural meanings and values of nature while disregarding the environmental context of the proposed new city extensions. Lush and vast open green spaces are being marketed on an everyday basis through billboards on main roads across the capital, TV advertisements, and newspapers. These aspirational landscape images are promoted in a desert climate, which manipulates the public expectations and masks the environmental change that is facing the new urban extensions. This paper argues that these acts affect the public attitudes and aspirations towards nature/landscapes of the future and hinder the required shift and awareness of environmental change as per the new ecosystem inputs. Environmentalism and pro- environmental behaviour require knowledge, awareness and most importantly frequent experiences of nature as advocated by scholars from different ecological and psychological disciplines. In this regard, the research paper shall investigate these propositions in the case of Cairo and its new administrative capital as an urban extension. The research deploys various methodological strands including visual data and sources to shed a light on the different daily images and messages of landscapes. The findings offer insights about the accompanying messages of landscape production dynamics as a mainstep towards understanding landscape futures and balancing between quality of life, environmentalism and economic prosperity in the new developments

Preliminary soil survey report for the Beni Magdoul and El Hammami areas

March 1979.CER78-79 EVR72.Includes bibliographical references.Prepared under support of United States Agency for International Development, Contract AID/NE-C-1351

Prognostic Significance of Erythropoietin in Pancreatic Adenocarcinoma

BACKGROUND: Erythropoietin (Epo) administration has been reported to have tumor-promoting effects in anemic cancer patients. We investigated the prognostic impact of endogenous Epo in patients with pancreatic ductal adenocarcinoma (PDAC). METHODOLOGY: The clinico-pathological relevance of hemoglobin (Hb, n = 150), serum Epo (sEpo, n = 87) and tissue expression of Epo/Epo receptor (EpoR, n = 104) was analyzed in patients with PDAC. Epo/EpoR expression, signaling, growth, invasion and chemoresistance were studied in Epo-exposed PDAC cell lines. RESULTS: Compared to donors, median preoperative Hb levels were reduced by 15% in both chronic pancreatitis (CP, p<0.05) and PDAC (p<0.001), reaching anemic grade in one third of patients. While inversely correlating to Hb (r = -0.46), 95% of sEPO values lay within the normal range. The individual levels of compensation were adequate in CP (observed to predicted ratio, O/P = 0.99) but not in PDAC (O/P = 0.85). Strikingly, lower sEPO values yielding inadequate Epo responses were prominent in non-metastatic M0-patients, whereas these parameters were restored in metastatic M1-group (8 vs. 13 mU/mL; O/P = 0.82 vs. 0.96; p<0.01)--although Hb levels and the prevalence of anemia were comparable. Higher sEpo values (upper quartile ≥ 16 mU/ml) were not significantly different in M0 (20%) and M1 (30%) groups, but were an independent prognostic factor for shorter survival (HR 2.20, 10 vs. 17 months, p<0.05). The pattern of Epo expression in pancreas and liver suggested ectopic release of Epo by capillaries/vasa vasorum and hepatocytes, regulated by but not emanating from tumor cells. Epo could initiate PI3K/Akt signaling via EpoR in PDAC cells but failed to alter their functions, probably due to co-expression of the soluble EpoR isoform, known to antagonize Epo. CONCLUSION/SIGNIFICANCE: Higher sEPO levels counteract anemia but worsen outcome in PDAC patients. Further trials are required to clarify how overcoming a sEPO threshold ≥16 mU/ml by endogenous or exogenous means may predispose to or promote metastatic progression

Corticosteroid co-treatment induces resistance to chemotherapy in surgical resections, xenografts and established cell lines of pancreatic cancer

BACKGROUND: Chemotherapy for pancreatic carcinoma often has severe side effects that limit its efficacy. The glucocorticoid (GC) dexamethasone (DEX) is frequently used as co-treatment to prevent side effects of chemotherapy such as nausea, for palliative purposes and to treat allergic reactions. While the potent pro-apoptotic properties and the supportive effects of GCs to tumour therapy in lymphoid cells are well studied, the impact of GCs to cytotoxic treatment of pancreatic carcinoma is unknown. METHODS: A prospective study of DEX-mediated resistance was performed using a pancreatic carcinoma xenografted to nude mice, 20 surgical resections and 10 established pancreatic carcinoma cell lines. Anti-apoptotic signaling in response to DEX was examined by Western blot analysis. RESULTS: In vitro, DEX inhibited drug-induced apoptosis and promoted the growth in all of 10 examined malignant cells. Ex vivo, DEX used in physiological concentrations significantly prevented the cytotoxic effect of gemcitabine and cisplatin in 18 of 20 freshly isolated cell lines from resected pancreatic tumours. No correlation with age, gender, histology, TNM and induction of therapy resistance by DEX co-treatment could be detected. In vivo, DEX totally prevented cytotoxicity of chemotherapy to pancreatic carcinoma cells xenografted to nude mice. Mechanistically, DEX upregulated pro-survival factors and anti-apoptotic genes in established pancreatic carcinoma cells. CONCLUSION: These data show that DEX induces therapy resistance in pancreatic carcinoma cells and raise the question whether GC-mediated protection of tumour cells from cancer therapy may be dangerous for patients

Down-Regulation of GEP100 Causes Increase in E-Cadherin Levels and Inhibits Pancreatic Cancer Cell Invasion

AIMS: Invasion and metastasis are major reasons for pancreatic cancer death and identifying signaling molecules that are specifically used in tumor invasion is of great significance. The purpose of this study was to elucidate the role of GEP100 in pancreatic cancer cell invasion and metastasis and the corresponding molecular mechanism. METHODS: Stable cell lines with GEP100 knocked-down were established by transfecting GEP100 shRNA vector into PaTu8988 cells and selected by puromycin. qRT-PCR and Western blot were performed to detect gene expression. Matrigel-invasion assay was used to detect cancer cell invasion in vitro. Liver metastasis in vivo was determined by splenic injection of indicated cell lines followed by spleen resection. Immunofluorescence study was used to detect the intracellular localization of E-cadherin. RESULTS: We found that the expression level of GEP100 protein was closely related to the invasive ability of a panel of 6 different human pancreatic cancer cell lines. Down-regulation of GEP100 in PaTu8988 cells significantly decreased invasive activity by Matrigel invasion assay, without affecting migration, invasion and viability. The inhibited invasive activity was rescued by over-expression of GEP100 cDNA. In vivo study showed that liver metastasis was significantly decreased in the PaTu8988 cells with GEP100 stably knocked-down. In addition, an epithelial-like morphological change, mimicking a mesenchymal to epithelial transition (MET) was induced by GEP100 down-regulation. The expression of E-cadherin protein was increased 2-3 folds accompanied by its redistribution to the cell-cell contacts, while no obvious changes were observed for E-cadherin mRNA. Unexpectedly, the mRNA of Slug was increased by GEP100 knock-down. CONCLUSION: These findings provided important evidence that GEP100 plays a significant role in pancreatic cancer invasion through regulating the expression of E-cadherin and the process of MET, indicating the possibility of it becoming a potential therapeutic target against pancreatic cancer

Aerosol Delivery of Small Hairpin Osteopontin Blocks Pulmonary Metastasis of Breast Cancer in Mice

Metastasis to the lung may be the final step in the breast cancer-related morbidity. Conventional therapies such as chemotherapy and surgery are somewhat successful, however, metastasis-related breast cancer morbidity remains high. Thus, a novel approach to prevent breast tumor metastasis is needed.Aerosol of lentivirus-based small hairpin osteopontin was delivered into mice with breast cancer twice a week for 1 or 2 months using a nose-only inhalation system. The effects of small hairpin osteopontin on breast cancer metastasis to the lung were evaluated using near infrared imaging as well as diverse molecular techniques. Aerosol-delivered small hairpin osteopontin significantly decreased the expression level of osteopontin and altered the expression of several important metastasis-related proteins in our murine breast cancer model.Aerosol-delivered small hairpin osteopontin blocked breast cancer metastasis. Our results showed that noninvasive targeting of pulmonary osteopontin or other specific genes responsible for cancer metastasis could be used as an effective therapeutic regimen for the treatment of metastatic epithelial tumors