A bibliography of research on behavioral decision processes to 1968

Bibliography of research of human behavioral decision making processes to Jan. 196

Econometric Methods for Endogenously Sampled Time Series: The Case of Commodity Price Speculation in the Steel Market

This paper studies the econometric problems associated with estimation of a stochastic process that is endogenously sampled. Our interest is to infer the law of motion of a discrete-time stochastic process {pt} that is observed only at a subset of times {t1,..., tn} that depend on the outcome of a probabilistic sampling rule that depends on the history of the process as well as other observed covariates xt . We focus on a particular example where pt denotes the daily wholesale price of a standardized steel product. However there are no formal exchanges or centralized markets where steel is traded and pt can be observed. Instead nearly all steel transaction prices are a result of private bilateral negotiations between buyers and sellers, typically intermediated by middlemen known as steel service centers. Even though there is no central record of daily transactions prices in the steel market, we do observe transaction prices for a particular firm -- a steel service center that purchases large quantities of steel in the wholesale market for subsequent resale in the retail market. The endogenous sampling problem arises from the fact that the firm only records pt on the days that it purchases steel. We present a parametric analysis of this problem under the assumption that the timing of steel purchases is part of an optimal trading strategy that maximizes the firm's expected discounted trading profits. We derive a parametric partial information maximum likelihood (PIML) estimator that solves the endogenous sampling problem and efficiently estimates the unknown parameters of a Markov transition probability that determines the law of motion for the underlying {pt} process. The PIML estimator also yields estimates of the structural parameters that determine the optimal trading rule. We also introduce an alternative consistent, less efficient, but computationally simpler simulated minimum distance (SMD) estimator that avoids high dimensional numerical integrations required by the PIML estimator. Using the SMD estimator, we provide estimates of a truncated lognormal AR(1) model of the wholesale price processes for particular types of steel plate. We use this to infer the share of the middleman's discounted profits that are due to markups paid by its retail customers, and the share due to price speculation. The latter measures the firm's success in forecasting steel prices and in timing its purchases in order to buy low and sell high'. The more successful the firm is in speculation (i.e. in strategically timing its purchases), the more serious are the potential biases that would result from failing to account for the endogeneity of the sampling process.

Econometric Methods for Endogenously Sampled Time Series: The Case of Commodity Price Speculation in the Steel Market

This paper studies the econometric problems associated with estimation of a stochastic process that is endogenously sampled. Our interest is to infer the law of motion of a discrete-time stochastic process {p_t} that is observed only at a subset of times {t_1,...,t_n} that depend on the outcome of a probabilistic sampling rule that depends on the history of the process as well as other observed covariates x_t. We focus on a particular example where p_t denotes the daily wholesale price of a standardized steel product. However there are no formal exchanges or centralized markets where steel is traded and pt can be observed. Instead nearly all steel transaction prices are a result of private bilateral negotiations between buyers and sellers, typically intermediated by middlemen known as steel service centers. Even though there is no central record of daily transactions prices in the steel market, we do observe transaction prices for a particular firm -- a steel service center that purchases large quantities of steel in the wholesale market for subsequent resale in the retail market. The endogenous sampling problem arises from the fact that the firm only records p_t on the days that it purchases steel. We present a parametric analysis of this problem under the assumption that the timing of steel purchases is part of an optimal trading strategy that maximizes the firm's expected discounted trading profits. We derive a parametric partial information maximum likelihood (PIML) estimator that solves the endogenous sampling problem and efficiently estimates the unknown parameters of a Markov transition probability that determines the law of motion for the underlying {p_t} process. The PIML estimator also yields estimates of the structural parameters that determine the optimal trading rule. We also introduce an alternative consistent, less efficient, but computationally simpler simulated minimum distance (SMD) estimator that avoids high dimensional numerical integrations required by the PIML estimator. Using the SMD estimator, we provide estimates of a truncated lognormal AR(1) model of the wholesale price processes for particular types of steel plate. We use this to infer the share of the middleman's discounted profits that are due to markups paid by its retail customers, and the share due to price speculation. The latter measures the firm's success in forecasting steel prices and in timing its purchases in order to "buy low and sell high'." The more successful the firm is in speculation (i.e., in strategically timing its purchases), the more serious are the potential biases that would result from failing to account for the endogeneity of the sampling process.Endogenous sampling, Markov processes, Maximum likelihood, Simulation estimation

Simulation methods for reliability-based design optimization and model updating of civil engineering structures and systems

This thesis presents a collection of original contributions pertaining to the subjects of reliability-based design optimization (RBDO) and model updating of civil engineering structures and systems. In this regard, probability theory concepts and tools are instrumental in the formulation of the herein reported developments. Firstly, two approaches are devised for the RBDO of structural dynamical systems under stochastic excitation. Namely, a stochastic search technique is proposed for constrained and unconstrained RBDO problems involving continuous, discrete and mixed discrete-continuous design spaces, whereas an efficient sensitivity assessment framework for linear stochastic structures is implemented to identify optimal designs and evaluate their sensitivities. Moreover, two classes of model updating problems are considered. In this context, the Bayesian interpretation of probability theory plays a key role in the proposed solution schemes. Specifically, contaminant source detection in water distribution networks is addressed by resorting to a sampling-based Bayesian model class selection framework. Furthermore, an effective strategy for Bayesian model updating with structural reliability methods is presented to treat identification problems involving structural dynamical systems, measured response data, and high-dimensional parameter spaces. The approaches proposed in this thesis integrate stochastic simulation techniques as an essential part of their formulation, which allows obtaining non-trivial information about the systems of interest as a byproduct of the solution processes. Overall, the findings presented in this thesis suggest that the reported methods can be potentially adopted as supportive tools for a number of practical decision-making processes in civil engineering.Diese Arbeit stellt eine Sammlung von Beiträgen vor, die sich mit der Reliability-based-Design-Optimization (RBDO) und dem Model updating von Strukturen und Systemen im Bauwesen befassen. In diesem Zusammenhang sind wahrscheinlichkeitstheoretische Konzepte für die Formulierung der hier vorgestellten Entwicklungen von entscheidender Bedeutung. Zunächst werden zwei Ansätze für eine RBDO von strukturdynamischen Systemen unter stochastischer Anregung entwickelt. Es wird eine stochastische Suchtechnik für beschränkte und unbeschränkte RBDO-Probleme vorgeschlagen. Diese beziehen kontinuierliche, diskrete und gemischt diskret-kontinuierliche Designräume ein. Gleichzeitig wird ein effizientes Framework zur Bewertung der Sensitivität lineare stochastische Strukturen implementiert, um optimale Designs zu identifizieren und ihre Sensitivitäten zu bewerten. Darüber hinaus werden zwei Klassen von Problem aus dem Model updating betrachtet. Der Fokus wird hierbei auf die Erkennung von Kontaminationsquellen in Wasserverteilungsnetzen mithilfe eines auf Stichproben basierenden Bayesian-Model-Class-selection-Framework gelegt. Ferner wird eine effektive Strategie zur Bearbeitung von Problemen des Bayesian-Model-updating, die strukturdynamischen Systeme, gemessene Systemantwortdaten und hochdimensionale Parameterräume umfassen, vorgestellt. Die beschriebenen Ansätze verwenden stochastische Simulationstechniken als wesentlicher Bestandteil ihrer Formulierung, wodurch nicht-triviale Informationen über betrachtete Systeme als Nebenprodukt der Lösungsprozesse gewonnen werden können. Insgesamt deuten die vorgestellten Ergebnisse dieser Arbeit darauf hin, dass die beschriebenen Methoden potenziell als unterstützende Elemente in praktischen Entscheidungsproblemen im Zusammenhang mit Strukturen und Systemen im Bauwesen eingesetzt werden können

Advancements in Safe Deep Reinforcement Learning for Real-Time Strategy Games and Industry Applications

publishedVersio

Whole brain Probabilistic Generative Model toward Realizing Cognitive Architecture for Developmental Robots

Building a humanlike integrative artificial cognitive system, that is, an artificial general intelligence, is one of the goals in artificial intelligence and developmental robotics. Furthermore, a computational model that enables an artificial cognitive system to achieve cognitive development will be an excellent reference for brain and cognitive science. This paper describes the development of a cognitive architecture using probabilistic generative models (PGMs) to fully mirror the human cognitive system. The integrative model is called a whole-brain PGM (WB-PGM). It is both brain-inspired and PGMbased. In this paper, the process of building the WB-PGM and learning from the human brain to build cognitive architectures is described.Comment: 55 pages, 8 figures, submitted to Neural Network

Optimal Decision-Making under Uncertainty - Application to Power Transmission Investments

Economists define investment as the act of incurring immediate costs with the expectation of future returns. An investment project, as every asset has a value. For successfully investing in and managing these assets is crucial not only recognizing what the value is but also the sources of this value. Most investment decisions share three characteristics in different degrees. First, investments are partially or totally irreversible. Roughly speaking, the initial investment cost is at least partially sunk; i.e. it is impossible to recover all the expenditures if the decision-maker changes his mind. Second, there is uncertainty in the revenues from the investment, and therefore, risk associated with this. Third, all decision-making has some leeway about the timing of the investment. It is possible to defer the decision making to get more information about the future. These three features interact to determine the optimal decisions of investors on a given investment project. Transmission utilities are faced with investment projects, which hold these three characteristics: irreversibility, uncertainty and the choice of timing. In this context, an efficient decision making process is, therefore, based on managing the uncertainties and understanding the relationships between risks and opportunities in order to achieve a well-timed investment execution. Therefore, strategic flexibility for seizing opportunities and cutting losses contingent upon the market evolution is of huge value. Strategic flexibility is a risk management method that is gaining ongoing research attention as it enables properly managing major uncertainties, which are unsolved at the time of making decisions. Hence, valuing added flexibility in transmission investment portfolios, for instance, by investing in power electronic-based controller meanwhile transmission line projects are deferred, is necessary to make optimal network upgrading. Nevertheless, expressing the value of flexibility in economic terms is not a trivial task and requires new, sophisticated valuing tools, since the traditional investment theory has not recognized the important implications of the interaction between the three aforementioned investment features. Any attempt to quantify investment flexibility almost naturally leads to the concept of Real Options (RO). The RO technique provides a well-founded framework –based on the theory of financial options, and consequently, stochastic dynamic programming- to assess strategic investments under uncertainty. In the first RO applications, valuation was normally confined to the investment options that can be easily assimilated to financial options, for which solutions are well-known and readily available. Nevertheless, an investor confront with a diverse set of opportunities. From this point of view, investment projects can be seen as a portfolio of options, where its value is driven by several stochastic variables. The introduction of multiple interacting options into real options models highly increases the problem complexity, making traditional numerical approaches impracticable. However in the recent years, simulation procedures for solving multiple American options have been successfully proposed. One of the most promising approaches is the Least Square Monte Carlo (LSM) method proposed by Longstaff and Schwartz in 2001. LSM method is based on stochastic chronological simulation and uses least squares linear regression to determine the optimal stopping time (optimal path) in the decision making process. This chapter lays out a general background about key concepts -uncertainty and risk- and the most usual risk management techniques in transmission investment are provided. Then, the concept of strategic flexibility is introduced in order to set its ability for dealing with the uncertainties involved in the investment problem. In addition, new criteria and advantages of ROV approach compared with classical probabilistic choice are presented, by exposing a LSM-based method for decomposing and evaluating the complex real option problem involved in flexible transmission investments under uncertainties. The proposed methodology is applied in a study case which evaluates an interconnection reinforcement on the European interconnected power system, by showing how the valuation of flexibility is a key task for making efficient and well-timed investments in the transmission network. The impact of two network upgrades on the system-wide welfare is analyzed. These upgrades are the development of a new interconnected line and the installation of a power electronic-based controller. Both upgrades represent measures to strengthen the German-Dutch interconnections due to the fact that these are among the most important corridors within the Central Western European (CWE) region. Hence, an interconnection project, which is currently under study, is compared to flexible investment in order to shed some light on the influence of the strategic flexibility on the optimal decision-making process. The research is focused on assessing the impact of different wind power in-feed scenarios in detail as well as the uncertainty of the demand growth, generation cost evolution and the installed wind capacity on the decision-making process. The presented approach might serve as a basis for a decision-making tool for regulatory agencies in order to quantify the necessity for network upgrades.Fil: Blanco, Gerardo. Universidad Nacional de Asunción; ParaguayFil: Olsina, Fernando Gabriel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan; Argentina. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Energía Eléctrica; Argentin

Dynamic Programming and Bayesian Inference

Dynamic programming and Bayesian inference have been both intensively and extensively developed during recent years. Because of these developments, interest in dynamic programming and Bayesian inference and their applications has greatly increased at all mathematical levels. The purpose of this book is to provide some applications of Bayesian optimization and dynamic programming