Artikel
Equilibrium in misspecified Markov decision processes
We provide an equilibrium framework for modeling the behavior of an agent who holds a simplified view of a dynamic optimization problem. The agent faces a Markov Decision Process, where a transition probability function determines the evolution of a state variable as a function of the previous state and the agent's action. The agent is uncertain about the true transition function and has a prior over a set of possible transition functions; this set reflects the agent's (possibly simplified) view of her environment and may not contain the true function. We define an equilibrium concept and provide conditions under which it characterizes steady-state behavior when the agent updates her beliefs using Bayes' rule.
- Sprache
-
Englisch
- Erschienen in
-
Journal: Theoretical Economics ; ISSN: 1555-7561 ; Volume: 16 ; Year: 2021 ; Issue: 2 ; Pages: 717-757 ; New Haven, CT: The Econometric Society
- Klassifikation
-
Wirtschaft
Optimization Techniques; Programming Models; Dynamic Analysis
Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
- Thema
-
Misspecified model
Markov decision process
equilibrium
- Ereignis
-
Geistige Schöpfung
- (wer)
-
Esponda, Ignacio
Pouzo, Demian
- Ereignis
-
Veröffentlichung
- (wer)
-
The Econometric Society
- (wo)
-
New Haven, CT
- (wann)
-
2021
- DOI
-
doi:10.3982/TE3843
- Handle
- Letzte Aktualisierung
-
10.03.2025, 11:44 MEZ
Datenpartner
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Objekttyp
- Artikel
Beteiligte
- Esponda, Ignacio
- Pouzo, Demian
- The Econometric Society
Entstanden
- 2021
Ähnliche Objekte (12)
Accelerated decomposition techniques for large discounted Markov decision processes
Minimizing spectral risk measures applied to Markov decision processes
Competitive Markov decision processes
Risk-sensitive Markov decision processes
Markov decision processes with uncertain parameters
Entropic Regularization of Markov Decision Processes
Ergodic Markov equilibrium with incomplete markets and short sales
Verification of Discrete-Time Markov Decision Processes
Dynamic risk management with Markov decision processes
A limit theorem for Markov decision processes
Dynamic risk management with Markov decision processes
Target Value Criterion in Markov Decision Processes
Accelerated decomposition techniques for large discounted Markov decision processes
Minimizing spectral risk measures applied to Markov decision processes
Competitive Markov decision processes
Risk-sensitive Markov decision processes
Markov decision processes with uncertain parameters
Entropic Regularization of Markov Decision Processes
Ergodic Markov equilibrium with incomplete markets and short sales
Verification of Discrete-Time Markov Decision Processes
Dynamic risk management with Markov decision processes
A limit theorem for Markov decision processes
Dynamic risk management with Markov decision processes
Target Value Criterion in Markov Decision Processes
Accelerated decomposition techniques for large discounted Markov decision processes
Minimizing spectral risk measures applied to Markov decision processes
Competitive Markov decision processes
Risk-sensitive Markov decision processes
Markov decision processes with uncertain parameters
Entropic Regularization of Markov Decision Processes
Ergodic Markov equilibrium with incomplete markets and short sales
Verification of Discrete-Time Markov Decision Processes
Dynamic risk management with Markov decision processes
A limit theorem for Markov decision processes
Dynamic risk management with Markov decision processes