IMF Working Papers

AI and Macroeconomic Modeling: Deep Reinforcement Learning in an RBC model

ByTohid Atashbar, Rui Aruhan Shi

February 24, 2023

Preview Citation

Format: Chicago

Tohid Atashbar, and Rui Aruhan Shi. "AI and Macroeconomic Modeling: Deep Reinforcement Learning in an RBC model", IMF Working Papers 2023, 040 (2023), accessed 12/14/2025, https://doi.org/10.5089/9798400235252.001

Export Citation

  • ProCite
  • RefWorks
  • Reference Manager
  • BibTex
  • Zotero
  • EndNote

Disclaimer: IMF Working Papers describe research in progress by the author(s) and are published to elicit comments and to encourage debate. The views expressed in IMF Working Papers are those of the author(s) and do not necessarily represent the views of the IMF, its Executive Board, or IMF management.

Summary

This study seeks to construct a basic reinforcement learning-based AI-macroeconomic simulator. We use a deep RL (DRL) approach (DDPG) in an RBC macroeconomic model. We set up two learning scenarios, one of which is deterministic without the technological shock and the other is stochastic. The objective of the deterministic environment is to compare the learning agent's behavior to a deterministic steady-state scenario. We demonstrate that in both deterministic and stochastic scenarios, the agent's choices are close to their optimal value. We also present cases of unstable learning behaviours. This AI-macro model may be enhanced in future research by adding additional variables or sectors to the model or by incorporating different DRL algorithms.

Subject: Artificial intelligence, Asset and liability management, Debt relief, Economic theory, Labor, Machine learning, Rational expectations, Technology

Keywords: Actor-critic algorithms, AI experiment, AI-macroeconomic simulator, Artificial intelligence, DDPG, Debt relief, Deep deterministic policy gradient, Deep reinforcement learning, DRL, Global, learning algorithm, Learning algorithms, Machine learning, Macro modeling, Rational expectations, RBC, RBC model, Real business cycles, Reinforcement learning, RL