47,932 research outputs found
Self-Modification of Policy and Utility Function in Rational Agents
Any agent that is part of the environment it interacts with and has versatile
actuators (such as arms and fingers), will in principle have the ability to
self-modify -- for example by changing its own source code. As we continue to
create more and more intelligent agents, chances increase that they will learn
about this ability. The question is: will they want to use it? For example,
highly intelligent systems may find ways to change their goals to something
more easily achievable, thereby `escaping' the control of their designers. In
an important paper, Omohundro (2008) argued that goal preservation is a
fundamental drive of any intelligent system, since a goal is more likely to be
achieved if future versions of the agent strive towards the same goal. In this
paper, we formalise this argument in general reinforcement learning, and
explore situations where it fails. Our conclusion is that the self-modification
possibility is harmless if and only if the value function of the agent
anticipates the consequences of self-modifications and use the current utility
function when evaluating the future.Comment: Artificial General Intelligence (AGI) 201
Rational bidding using reinforcement learning: an application in automated resource allocation
The application of autonomous agents by the provisioning and usage of computational resources is an attractive research field. Various methods and technologies in the area of artificial intelligence, statistics and economics are playing together to achieve i) autonomic resource provisioning and usage of computational resources, to invent ii) competitive bidding strategies for widely used market mechanisms and to iii) incentivize consumers and providers to use such market-based systems.
The contributions of the paper are threefold. First, we present a framework for supporting consumers and providers in technical and economic preference elicitation and the generation of bids. Secondly, we introduce a consumer-side reinforcement learning bidding strategy which enables rational behavior by the generation and selection of bids. Thirdly, we evaluate and compare this bidding strategy against a truth-telling bidding strategy for two kinds of market mechanisms – one centralized and one decentralized
Learning in evolutionary environments
Not availabl
Adaptive forecasts, hysteresis, and endogenous fluctuations
This paper considers fluctuations and policy in an economic model with multiple steady states due to a production externality. In the absence of policy changes, the driving forces generating fluctuations are exogenous random productivity shocks. However, because there are multiple steady states, large productivity shocks can shift the economy between high-and low- level equilibria, providing an additional endogenous source of fluctuations. The scope for macroeconomic policy is large since changes in policy can also shift the economy between equilibria. In this setting macroeconomic policy exhibits hysteresis (irreversibilities) and threshold effects and can be used to eliminate endogenous fluctuations.Econometric models ; Business cycles
The Disutility of International Debt: Analytical Results and Methodological Implications
In dealing with the problematic relationship of morality to rational choice theory, neoclassical economists since Lionel Robbins have often argued that they can incorporate moral values into consumer theory by putting those values into the utility function. This paper tests the viability of such an approach in the context of international finance. The moral value at stake is autonomy, which may be lost when borrowers must submit to the edicts of international financial institutions. When such a value is inserted into the utility function of a small economy, the growth rate of consumption and the level of investment change. Furthermore, potential borrowers may lose their ability to credibly commit to paying back loans, resulting in a complete absence of borrowing where it might otherwise take place. The author argues that while this model illustrates the possibility of analyzing a noneconomic value (sovereignty) through rational choice theory, it also shows that standard methods of empirical inference, policy evaluation, and welfare analysis may fail in such a situation. To answer questions that mix morality and economics, economists must seek tools other than conventional rational choice theory.: Values, Lionel Robbins, international debt, methodology
- …