feat: route NeMo-Gym rollout rows across sharded actors#3372

ananthsub wants to merge 1 commit into

ansubramania/gym-shards/multi-actorNVIDIA-NeMo/RL:ansubramania/gym-shards/multi-actorfrom

ansubramania/gym-shards/routerNVIDIA-NeMo/RL:ansubramania/gym-shards/routerCopy head branch name to clipboard