Reinforcement Learning: An Introduction (2nd Edition) [Sutton and Barto, 2018]

My solutions to the programming exercises in "Reinforcement Learning: An Introduction" (2nd Edition) [Sutton & Barto, 2018]

Solved exercises

• Chapter 2: Multi-armed Bandits

  • Exercise 5
  • Exercise 11

• Chapter 4: Dynamic Programming

  • Exercise 7: Policy-iteration implementation¹
  • Exercise 7: Value-iteration implementation¹
  • Exercise 9

• Chapter 5: Monte Carlo Methods

  • Exercise 12: Racetrack

• Chapter 6: Temporal-Difference Learning

  • Exercises 9 & 10: Windy Gridworld with King's Moves & Stochastic Wind

• Chapter 8: Planning and Learning with Tabular Methods

  • Exercise 4
  • Exercise 8

¹ Original code by Sutton & Barto written in LISP

Any bug reports and suggestions are welcome! Please feel free to contact me at jugoslav.stojcheski<at>gmail.com