Add advantage filtering support for PPO - #405

Open

daphne-cornelisse wants to merge 5 commits into

mainfrom

feat/adv_filtering

Commits on Apr 5, 2025

Implement advantage filtering - zero-out transitions below threshold
daphne-cornelisse
committed
8fd7903
Store config with checkpoint
daphne-cornelisse
committed
773c6f3

Commits on Apr 7, 2025

Logging stats
daphne-cornelisse
committed
d2f67a5
Take in the number of minibatches instead of enforcing a fixed minibatch_size
daphne-cornelisse
committed
c2c457b
Filter out transitions associated with low advantages by making the mb size dynamic
daphne-cornelisse
committed
5a93bca