> ML_LITERATURE // SCHAUL-2016-PRIORITIZED-EXPERIENCE-REPLAY-PER_v1.0
Prioritized Experience Replay (PER)
Tom Schaul, John Quan, Ioannis Antonoglou, David Silver · International Conference on Learning Representations (ICLR) (2016)
algorithm2016foundationalthirdPartyReproduced
Principal Contribution
Prioritized transitions in the replay buffer based on TD error magnitude with importance sampling correction, drastically speeding up learning on sparse reward tasks.
Operational Relevance
Serves as qualified theoretical and systems foundation for task-reinforcement-learning.
Assumptions
- Markovian state dynamics and stationary reward functions hold in target evaluation environments
Limitations
- Sample efficiency, exploration stability, and real-world sim-to-real transfer gaps require specialized tuning
