225 research outputs found

    InfSOCSol2: an updated MATLAB package for approximating the solution to a continuous-time infinite horizon stochastic optimal control problem

    Get PDF
    This paper describes a suite of MATLAB routines devised to provide an approximately optimal solution to an infinite-horizon stochastic optimal control problem. The suite is an updated version of that described in [Kra01b]. Its routines implement a policy improvement algorithm to optimise a Markov decision chain approximating the original control problem, as described in [Kra01c].Computational techniques; Economic software; Computational methods in stochastic optimal control; Computational economics; Approximating Markov decision chains

    Using a finite horizon numerical optimisation method for a periodic optimal control problem

    Get PDF
    Computing a numerical solution to a periodic optimal control problem is difficult. A method of approximating a solution to a given (stochastic) optimal control problem using Markov chains was developed in [3]. This paper describes an attempt at applying this method to a periodic optimal control problem introduced in [2].Computational techniques; Economic software; Computational methods in stochastic optimal control; Computational economics; Approximating Markov decision chains

    A report on using parallel MATLAB for solutions to stochastic optimal control problems

    Get PDF
    Parallel MATLAB is a recent MathWorks product enabling the use of parallel computing methods on multicore personal computers. SOCSol is the generic name of a suite of MATLAB routines that can be used to obtain optimal solutions to continuous-time stochastic optimal control problems. In this report, we compare the performance of a new version of SOCSol utilising parallel MATLAB with that of another version not using parallel computing methods.Computational techniques; Economic software; Computational methods in stochastic optimal control; Computational economics; Approximating Markov decision chains

    A parallel Matlab package for approximating the solution to a continuous-time stochastic optimal control problem

    Get PDF
    This article is a modified version of [AK06]. Both articles explain how a suite of MATLAB routines distributed under the generic name SOCSol can be used to obtain optimal solutions to continuous-time stochastic optimal control problems. The difference between the SOCSol suites described by the articles arises from the underlying computing platforms used. This article describes a beta version of SOCSol that utilises the MATLAB Parallel Computing Toolbox, while [AK06] describes a version of SOCSol that does not use parallel computing methods.Computational techniques; Economic software; Computational methods in stochastic optimal control; Computational economics; Approximating Markov decision chains

    InfSOCSol2 An updated MATLAB Package for Approximating the Solution to a Continuous-Time Infinite Horizon Stochastic Optimal Control Problem with Control and State Constraints

    Get PDF
    This paper is a successor of [AK08]. Both papers describe the same suite of MATLAB R° routines devised to provide an approximately optimal solution to an infinite horizon stochastic optimal control problem. The difference is that this paper explains how to allow for state and control constraints. The suite routines implement a policy improvement algorithm to optimise a Markov decision chain approximating the original control problem, as described in [Kra01c] and [Kra01b].Computational economics, Financial engineering, Approximating Markov decision chains

    InfSOCSol2: an Updated MATLAB (R) Package For Approximating the Solution to a Continuous-Time Infinite Horizon Stochastic Optimal Control Problem

    Get PDF
    This paper describes a suite of MATLAB (R) routines devised to provide an approximately optimal solution to an infinite-horizon stochastic optimal control problem. The suite is an updated version of that described in [Kra01b]. Its routines implement a policy improvement algorithm to optimise a Markov decision chain approximating the original control problem, as described in [Kra01c

    SOCSol4L: an Improved MATLAB (R) Package For Approximating the Solution to a Continuous-Time Stochastic Optimal Control Problem

    Get PDF
    Computing the solution to a stochastic optimal control problem is difficult. A method of approximating a solution to a given continuous-time stochastic optimal control problem using Markov chains was developed in [Kra01]. This paper describes a suite of MATLAB (R) routines implementing this method

    Parallel SOCSol: a Parallel MATLAB (R) Package For Approximating the Solution to a Continuous-Time Stochastic Optimal Control Problem

    Full text link
    This article is a modified version of [AK06]. Both articles explain how a suite of MATLAB (R) routines distributed under the generic name SOCSol can be used to obtain optimal solutions to continuous-time stochastic optimal control problems. The difference between the SOCSol suites described by the articles arises from the underlying computing platforms used. This article describes a beta version of SOCSol that utilises the MATLAB (R) Parallel Computing Toolbox (TM), while [AK06] describes a version of SOCSol that does not use parallel computing methods

    New pedagogical configurations for traditional learning tools: a proposal

    Full text link
    [EN] Digital technologies have changed the world dramatically and, as a consequence, higher education is undergoing significant teaching and learning transformations based on their use. The need to plan and produce disruptive innovations for traditional learning tools brings a challenge in this sense. One of these modern pedagogical perspectives is the use of transmedia storytelling in education, which has given a new configuration to instructional tools and have changed their forms and educational function. We present a proposal of specialized vocabulary in reproductive biology of plants using the principles of transmedia storytelling. The design of an educational transmedia artifact for the particular terminological entry of the term «polinizador» is shown to illustrate the proposed structure for the vocabulary. This artifact is constituted by diverse resources made with the use of different media and is based on the use of tags linked to each resource, which allow interactive navigation between them, structuring the storytelling about the selected term. Each resource adds particular information on the definition of the term, so that the student can obtain the answer he needs. Transmedia storytelling allows the students’ interaction with resources in a way consistent with their own interests, making them the center of their learning.Raimúndez-Urrutia, E.; Azzato Sordo, M. (2017). New pedagogical configurations for traditional learning tools: a proposal. En Proceedings of the 3rd International Conference on Higher Education Advances. Editorial Universitat Politècnica de València. 231-238. https://doi.org/10.4995/HEAD17.2017.5149OCS23123

    A Report on NISOCSol: an Algorithm For Approximating Markovian Equlibria in Dynamic Games with Coupled-Constraints

    Get PDF
    In this report, we outline a method for approximating a Markovian (or feedback-Nash) equilibrium of a dynamic game, possibly subject to coupled-constraints. We treat such a game as a "multiple" optimal control problem. A method for approximating a solution to a given optimal control problem via backward induction on Markov chains was developed in [Kra01]. A Markovian equilibrium may be obtained numerically by adapting this backward induction approach to a stage Nikaido-Isoda function (described in [KZ06])
    corecore