Skip to main content

> ML_LITERATURE // SCHAUL-2016-PRIORITIZED-EXPERIENCE-REPLAY-PER_v1.0

Prioritized Experience Replay (PER)

Tom Schaul, John Quan, Ioannis Antonoglou, David Silver · International Conference on Learning Representations (ICLR) (2016)

algorithm2016foundationalthirdPartyReproduced

Principal Contribution

Prioritized transitions in the replay buffer based on TD error magnitude with importance sampling correction, drastically speeding up learning on sparse reward tasks.

Operational Relevance

Serves as qualified theoretical and systems foundation for task-reinforcement-learning.

Assumptions

  • Markovian state dynamics and stationary reward functions hold in target evaluation environments

Limitations

  • Sample efficiency, exploration stability, and real-world sim-to-real transfer gaps require specialized tuning

Connected Algorithms, Architectures & Tools

Related Algorithms:
Related Architectures:
Implementing Libraries: