[Feature] Add flat replay writes to collectors#4020

vmoens wants to merge 3 commits into

mainpytorch/rl:mainfrom

codex/ray-flatten-replay-datapytorch/rl:codex/ray-flatten-replay-dataCopy head branch name to clipboard