Stream of Search (SoS): Learning to Search in Language

Language models are rarely shown fruitful mistakes while training. They then struggle to look beyond the next token, suffering from a snowballing of errors and struggling to predict the consequence of their actions several steps ahead. In this paper, we show how language models can be taught to search by representing the process of search in language, as a flattened string -- a stream of search (SoS). We propose a unified language for search that captures an array of different symbolic search strategies. We demonstrate our approach using the simple yet difficult game of Countdown, where the goal is to combine input numbers with arithmetic operations to reach a target number. We pretrain a transformer-based language model from scratch on a dataset of streams of search generated by heuristic solvers. We find that SoS pretraining increases search accuracy by 25% over models trained to predict only the optimal search trajectory. We further finetune this model with two policy improvement methods: Advantage-Induced Policy Alignment (APA) and Self-Taught Reasoner (STaR). The finetuned SoS models solve 36% of previously unsolved problems, including problems that cannot be solved by any of the heuristic solvers. Our results indicate that language models can learn to solve problems via search, self-improve to flexibly use different search strategies, and potentially discover new ones

Molecular Actions of Thyroid Hormone on Breast Cancer Cell Migration and Invasion via Cortactin/N-WASP

The thyroid hormone triiodothyronine (T3) plays a fundamental role in growth regulation, differentiation, metabolism and cellular movement. These processes are particularly important considering that deregulation of T3 levels could promote abnormal responsiveness of mammary epithelial cells, which may lead to the development and progression of breast cancer (BC). Once cells migrate and invade different tissues, BC metastasis is the main cause of cancer-related death because it is particularly difficult to revert this multistep process. Cell migration integrates several steps that induce changes in cell structure and morphology to promote BC cell invasion. These sequential steps include actin cytoskeleton remodeling, focal adhesion complex formation and, finally, the turnover of branched actin filament networks. In this article, we demonstrate that T3 has the ability to modify the Epithelial-Mesenchymal Transition process. In addition, we show that T3 induces actin cytoskeleton reorganization, triggers focal adhesion formation and, as a consequence, promotes actin nucleation via non-genomic pathway. These events are specifically modulated by T3 via integrin αvβ3 to FAK/paxillin/cortactin/N-WASP/Arp2/3 complex signaling pathway, increasing cell adhesion, migration and invasion of T-47D BC cells. We suggest that T3 influences the progression of tumor metastasis by controlling signaling pathways that converge in cell motility. This knowledge is crucial for the development of novel therapeutic strategies for BC treatment

Hyaluronate Fragments Reverse Skin Atrophy by a CD44-Dependent Mechanism

BACKGROUND: Skin atrophy is a common manifestation of aging and is frequently accompanied by ulceration and delayed wound healing. With an increasingly aging patient population, management of skin atrophy is becoming a major challenge in the clinic, particularly in light of the fact that there are no effective therapeutic options at present. METHODS AND FINDINGS: Atrophic skin displays a decreased hyaluronate (HA) content and expression of the major cell-surface hyaluronate receptor, CD44. In an effort to develop a therapeutic strategy for skin atrophy, we addressed the effect of topical administration of defined-size HA fragments (HAF) on skin trophicity. Treatment of primary keratinocyte cultures with intermediate-size HAF (HAFi; 50,000–400,000 Da) but not with small-size HAF (HAFs; <50,000 Da) or large-size HAF (HAFl; >400,000 Da) induced wild-type (wt) but not CD44-deficient (CD44(−/−)) keratinocyte proliferation. Topical application of HAFi caused marked epidermal hyperplasia in wt but not in CD44(−/−) mice, and significant skin thickening in patients with age- or corticosteroid-related skin atrophy. The effect of HAFi on keratinocyte proliferation was abrogated by antibodies against heparin-binding epidermal growth factor (HB-EGF) and its receptor, erbB1, which form a complex with a particular isoform of CD44 (CD44v3), and by tissue inhibitor of metalloproteinase-3 (TIMP-3). CONCLUSIONS: Our observations provide a novel CD44-dependent mechanism for HA oligosaccharide-induced keratinocyte proliferation and suggest that topical HAFi application may provide an attractive therapeutic option in human skin atrophy

Synergistic Effect of Hyaluronate Fragments in Retinaldehyde-Induced Skin Hyperplasia Which Is a Cd44-Dependent Phenomenon

BACKGROUND: CD44 is a polymorphic proteoglycan and functions as the principal cell-surface receptor for hyaluronate (HA). Heparin-binding epidermal growth factor (HB-EGF) activation of keratinocyte erbB receptors has been proposed to mediate retinoid-induced epidermal hyperplasia. We have recently shown that intermediate size HA fragments (HAFi) reverse skin atrophy by a CD44-dependent mechanism. METHODOLOGY AND PRINCIPAL FINDINGS: Treatment of primary mouse keratinocyte cultures with retinaldehyde (RAL) resulted in the most significant increase in keratinocyte proliferation when compared with other retinoids, retinoic acid, retinol or retinoyl palmitate. RAL and HAFi showed a more significant increase in keratinocyte proliferation than RAL or HAFi alone. No proliferation with RAL was observed in CD44-/- keratinocytes. HA synthesis inhibitor, 4-methylumbelliferone inhibited the proliferative effect of RAL. HB-EGF, erbB1, and tissue inhibitor of MMP-3 blocking antibodies abrogated the RAL- or RAL- and HAFi-induced keratinocyte proliferation. Topical application of RAL or RAL and HAFi for 3 days caused a significant epidermal hyperplasia in the back skin of wild-type mice but not in CD44-/- mice. Topical RAL and HAFi increased epidermal CD44 expression, and the epidermal and dermal HA. RAL induced the expression of active HB-EGF and erbB1. However, treatment with RAL and HAFi showed a more significant increase in pro-HB-EGF when compared to RAL or HAFi treatments alone. We then topically applied RAL and HAFi twice a day to the forearm skin of elderly dermatoporosis patients. After 1 month of treatment, we observed a significant clinical improvement. CONCLUSIONS AND SIGNIFICANCE: Our results indicate that (i) RAL-induced in vitro and in vivo keratinocyte proliferation is a CD44-dependent phenomenon and requires the presence of HA, HB-EGF, erbB1 and MMPs, (ii) RAL and HAFi show a synergy in vitro and in vivo in mouse skin, and (iii) the combination of RAL and HAFi seems to have an important therapeutic effect in dermatoporosis

Fludarabine, cytarabine, granulocyte colony-stimulating factor, and idarubicin with gemtuzumab ozogamicin improves event-free survival in younger patients with newly diagnosed aml and overall survival in patients with npm1 and flt3 mutations

Purpose To determine the optimal induction chemotherapy regimen for younger adults with newly diagnosed AML without known adverse risk cytogenetics. Patients and Methods One thousand thirty-three patients were randomly assigned to intensified (fludarabine, cytarabine, granulocyte colony-stimulating factor, and idarubicin [FLAG-Ida]) or standard (daunorubicin and Ara-C [DA]) induction chemotherapy, with one or two doses of gemtuzumab ozogamicin (GO). The primary end point was overall survival (OS). Results There was no difference in remission rate after two courses between FLAG-Ida + GO and DA + GO (complete remission [CR] + CR with incomplete hematologic recovery 93% v 91%) or in day 60 mortality (4.3% v 4.6%). There was no difference in OS (66% v 63%; P = .41); however, the risk of relapse was lower with FLAG-Ida + GO (24% v 41%; P < .001) and 3-year event-free survival was higher (57% v 45%; P < .001). In patients with an NPM1 mutation (30%), 3-year OS was significantly higher with FLAG-Ida + GO (82% v 64%; P = .005). NPM1 measurable residual disease (MRD) clearance was also greater, with 88% versus 77% becoming MRD-negative in peripheral blood after cycle 2 (P = .02). Three-year OS was also higher in patients with a FLT3 mutation (64% v 54%; P = .047). Fewer transplants were performed in patients receiving FLAG-Ida + GO (238 v 278; P = .02). There was no difference in outcome according to the number of GO doses, although NPM1 MRD clearance was higher with two doses in the DA arm. Patients with core binding factor AML treated with DA and one dose of GO had a 3-year OS of 96% with no survival benefit from FLAG-Ida + GO. Conclusion Overall, FLAG-Ida + GO significantly reduced relapse without improving OS. However, exploratory analyses show that patients with NPM1 and FLT3 mutations had substantial improvements in OS. By contrast, in patients with core binding factor AML, outcomes were excellent with DA + GO with no FLAG-Ida benefit

Topical retinaldehyde increases skin content of retinoic acid and exerts biologic activity in mouse skin

Retinaldehyde, a natural metabolite of β-carotene and retinol, has been proposed recently for topical use in humans. Because retinaldehyde does not bind to retinoid nuclear receptors, its biologic activity should result from enzymatic transformation by epidermal keratinocytes into ligands for these receptors, such as all-trans retinoic acid and 9-cis-retinoic acid. In this study, we analyzed by high performance liquid chromatography the type and amounts of tissue retinoids as well as several biologic activities resulting from topical application of either retinaldehyde or all-trans retinoic acid on mouse tail skin. Biologic activities of all-trans retinoic acid and retinaldehyde were qualitatively identical in metaplastic parameters (induction of orthokeratosis, reduction of keratin 65-kDa mRNA, increase in filaggrin and loricrin 65-kDa mRNAs) and hyperplastic parameters (increase in epidermal thickness, increase in bromodeoxyuridine (BrdU)-positive cells, increase in keratin 50-kDa mRNA, and reduction in keratin 70-kDa mRNA). Some quantitative differences, not all in favor of all-trans retinoic acid, were found in several indices. Cellular retinoic acid-binding protein II and cellular retinol-binding protein I mRNAs were increased by both topical retinaldehyde and all-trans retinoic acid. Whereas all-trans retinoic acid, 9-cis-retinoic acid, and 13-cis-retinoic acid were not detectable (limit 5ng/g) in vehicle-treated skin, 0.05% retinaldehyde-treated skin contained 13 ± 6.9ng/g wet tissue of all-trans retinoic acid (mean ± SD), 12.6 ± 5.9ng/g 13-cis-retinoic acid, and no 9-cis-retinoic acid. In contrast, 9-cis-retinoic acid was detectable in 0.05% of all-trans retinoic acid-treated skin, which also contained 25-fold more all-trans retinoic acid and 5-fold more 13-cis-retinoic acid than retinaldehyde-treated skin. Our results show that topical retinaldehyde is transformed in vivo into all-trans retinoic acid by mouse epidermis. The small amounts of ligand for retinoic acid nuclear receptors thus produced are sufficient to induce biologic effects similar to those resulting from the topical application of the ligand itself in much higher concentration

UVA and UVB decrease the expression of CD44 and hyaluronate in mouse epidermis, which is counteracted by topical retinoids

The transmembrane glycoprotein CD44 is currently thought to be the main cell surface receptor for the glycosaminoglycan hyaluronate. We previously showed that (1) CD44 regulate keratinocyte proliferation; (2) topical retinoids dramatically increase the expression of CD44, hyaluronate and hyaluronate synthase (HAS)s in mouse epidermis; (3) topical retinaldehyde restores the epidermal thickness and CD44 expression which are correlated with clinical improvement in lichen sclerosus et atrophicus lesions; and (4) retinaldehyde-induced proliferative response of keratinocytes is a CD44-dependent phenomenon and requires the presence of HB-EGF, erbB1 and matrix metalloproteinases. In this study, we analyzed the effect of UV irradiation on the levels of epidermal hyaluronate and CD44 in mice, as well as its potential prevention by topical retinoids. UVA (10 J/cm(2)) or UVB (1 J/cm(2)) irradiation significantly decreased the expression of CD44 and hyaluronate in the epidermis of hairless mice after 2 h. Expression of both epidermal CD44 and hyaluronate was reconstituted within 24 h. Topical application of retinaldehyde for 3 days prior to UVA or UVB irradiation prevented the decrease of CD44 and hyaluronate expression. Topical retinol and retinoic acid also increased the basal levels of epidermal CD44 and hyaluronate, although their preventive effect on UV-induced decrease of these molecules was less pronounced as compared to topical retinaldehyde. These data confirm the relationships between retinoid and CD44 pathways, although the primary target(s) of UV leading to CD44 and hyaluronate degradation remain to be elucidated

Metabolism and biological activities of topical 4-oxoretinoids in mouse skin

Retinoic acid mediates most of the biological actions of vitamin A. It is oxidized by CYP26A1 to 4-oxoretinoic acid, considered as an inactive catabolite of retinoic acid. However, in the light of studies reporting the presence of 4-oxoretinal or 4-oxoretinol as the predominant retinoids during morphogenesis, we analyzed the retinoid-like biological activity of these oxoretinoids in mouse skin in vivo. Topical 4-oxoretinal and 4-oxoretinol promoted significant epidermal hyperplasia and metaplasia in mouse tail. They induced a moderate response for epidermal inflammation, compared with retinal, whereas neither 4-oxoretinal nor 4-oxoretinol prevented menadione-induced epidermal lipid peroxidation, unlike retinal and retinol. As analyzed by quantitative PCR, 4-oxoretinal and 4-oxoretinol did not reproduce the significant increased expression of genes coding for keratin 4, amphiregulin, heparin-EGF and CYP26A1, that did induce retinal and retinol. However, both retinal and 4-oxoretinal significantly inhibited the lipopolysaccharide-induced maturation of human dendritic cells in vitro. As analyzed in vivo and in vitro, 4-oxoretinal and 4-oxoretinol were not converted into retinoic acid. We conclude that 4-oxoretinal and 4-oxoretinol exert a moderate direct retinoid-like activity in vivo, thus confirming previous in vitro studies in amphibians showing 4-oxometabolites of vitamin A as bioactive agents rather than inactive catabolites