166 research outputs found

    A statistical learning strategy for closed-loop control of fluid flows

    Get PDF
    This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model is derived, approximating the complex system’s dynamics. A control strategy is then learned using reinforcement learning once rewards relevant with respect to the control objective are identified. This method is designed for experimental configurations, requiring no computations nor prior knowledge of the system, and enjoys intrinsic robustness. It is illustrated on two systems: the control of the transitions of a Lorenz’63 dynamical system, and the control of the drag of a cylinder flow. The method is shown to perform well

    Plakophilin3 Loss Leads to an Increase in PRL3 Levels Promoting K8 Dephosphorylation, Which Is Required for Transformation and Metastasis

    Get PDF
    The desmosome anchors keratin filaments in epithelial cells leading to the formation of a tissue wide IF network. Loss of the desmosomal plaque protein plakophilin3 (PKP3) in HCT116 cells, leads to an increase in neoplastic progression and metastasis, which was accompanied by an increase in K8 levels. The increase in levels was due to an increase in the protein levels of the Phosphatase of Regenerating Liver 3 (PRL3), which results in a decrease in phosphorylation on K8. The increase in PRL3 and K8 protein levels could be reversed by introduction of an shRNA resistant PKP3 cDNA. Inhibition of K8 expression in the PKP3 knockdown clone S10, led to a decrease in cell migration and lamellipodia formation. Further, the K8 PKP3 double knockdown clones showed a decrease in colony formation in soft agar and decreased tumorigenesis and metastasis in nude mice. These results suggest that a stabilisation of K8 filaments leading to an increase in migration and transformation may be one mechanism by which PKP3 loss leads to tumor progression and metastasis

    Approximate policy iteration: A survey and some new methods

    Get PDF
    We consider the classical policy iteration method of dynamic programming (DP), where approximations and simulation are used to deal with the curse of dimensionality. We survey a number of issues: convergence and rate of convergence of approximate policy evaluation methods, singularity and susceptibility to simulation noise of policy evaluation, exploration issues, constrained and enhanced policy iteration, policy oscillation and chattering, and optimistic and distributed policy iteration. Our discussion of policy evaluation is couched in general terms and aims to unify the available methods in the light of recent research developments and to compare the two main policy evaluation approaches: projected equations and temporal differences (TD), and aggregation. In the context of these approaches, we survey two different types of simulation-based algorithms: matrix inversion methods, such as least-squares temporal difference (LSTD), and iterative methods, such as least-squares policy evaluation (LSPE) and TD (λ), and their scaled variants. We discuss a recent method, based on regression and regularization, which rectifies the unreliability of LSTD for nearly singular projected Bellman equations. An iterative version of this method belongs to the LSPE class of methods and provides the connecting link between LSTD and LSPE. Our discussion of policy improvement focuses on the role of policy oscillation and its effect on performance guarantees. We illustrate that policy evaluation when done by the projected equation/TD approach may lead to policy oscillation, but when done by aggregation it does not. This implies better error bounds and more regular performance for aggregation, at the expense of some loss of generality in cost function representation capability. Hard aggregation provides the connecting link between projected equation/TD-based and aggregation-based policy evaluation, and is characterized by favorable error bounds.National Science Foundation (U.S.) (No.ECCS-0801549)Los Alamos National Laboratory. Information Science and Technology InstituteUnited States. Air Force (No.FA9550-10-1-0412

    The Comparative Economics of ICT, Environmental Degradation and Inclusive Human Development in Sub-Saharan Africa

    Get PDF
    This study examines how information and communication technology (ICT) could be employed to dampen the potentially damaging effects of environmental degradation in order to promote inclusive human development in a panel of 44 Sub-Saharan African countries. ICT is captured with internet and mobile phone penetration rates whereas environmental degradation is measured in terms of CO2 emissions per capita and CO2 intensity. The empirical evidence is based on Fixed Effects and Tobit regressions using data from 2000-2012. In order to increase the policy relevance of this study, the dataset is decomposed into fundamental characteristics of inclusive development and environmental degradation based on income levels (Low income versus (vs.) Middle income); legal origins (English Common law vs. French Civil law); religious domination (Christianity vs. Islam); openness to sea (Landlocked vs. Coastal); resource-wealth (Oil-rich vs. Oil-poor) and political stability (Stable vs. Unstable).Baseline findings broadly show that improvement in both of measures of ICT would significantly diminish the possibly harmful effect of CO2 emissions on inclusive human development. When the analysis is extended with the abovementioned fundamental characteristics, we observe that the moderating influence of both our ICT variables on CO2 emissions is higher in the group of English Common law, Middle income and Oil-wealthy countries than in the French Civil law, Low income countries and Oil-poor countries respectively. Theoretical and practical policy implications are discussed
    • …
    corecore