This repository provides an extended data generator for:
Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion (CoHFF)
in Connected Automated Vehicles (CAVs), based on OpenCOOD.
📄 Project Page: https://rruisong.github.io/publications/CoHFF/
git clone https://github.com/DerrickXuNu/OpenCOODgit clone https://github.com/chrisyan/opv2v_datagenerator_CoHFF.gitYou can generate data for different multi-agent LiDAR setups. Choose one of the following:
- Copy configuration and sensor files:
cp opv2v_datagenerator_CoHFF/logreplay/hypes_yaml/replay_4.yaml OpenCOOD/logreplay/hypes_yaml/
cp opv2v_datagenerator_CoHFF/logreplay/sensors/semantic_4/semantic_lidar.py OpenCOOD/logreplay/sensors/
cp opv2v_datagenerator_CoHFF/logreplay/sensors/semantic_4/sensor_manager.py OpenCOOD/logreplay/sensors/- Modify config path in
scenarios_manager.py:
Open the file:
OpenCOOD/logreplay/scenario/scenarios_manager.py
Change line 73 from:
scene_params = load_yaml('../hypes_yaml/replay.yaml')to:
scene_params = load_yaml('../hypes_yaml/replay_4.yaml')- Copy configuration and sensor files:
cp opv2v_datagenerator_CoHFF/logreplay/hypes_yaml/replay_18.yaml OpenCOOD/logreplay/hypes_yaml/
cp opv2v_datagenerator_CoHFF/logreplay/sensors/semantic_18/semantic_lidar.py OpenCOOD/logreplay/sensors/
cp opv2v_datagenerator_CoHFF/logreplay/sensors/semantic_18/sensor_manager.py OpenCOOD/logreplay/sensors/- Modify config path in
scenarios_manager.py:
Open the file:
OpenCOOD/logreplay/scenario/scenarios_manager.py
Change line 73 from:
scene_params = load_yaml('../hypes_yaml/replay.yaml')to:
scene_params = load_yaml('../hypes_yaml/replay_18.yaml')cd OpenCOOD/logreplay/scenario
python3 scenarios_manager.pyThis will collect the replayed semantic LiDAR data in a format usable for CoHFF training and evaluation.
- Ensure OpenCOOD is correctly installed. Follow their installation guide.
- You can customize the number of agents or sensor configurations by creating your own YAML and sensor manager classes.
If you find this data generator useful, please cite:
@INPROCEEDINGS{10658094,
author={Song, Rui and Liang, Chenwei and Cao, Hu and Yan, Zhiran and Zimmer, Walter and Gross, Markus and Festag, Andreas and Knoll, Alois},
booktitle={2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
title={Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehicles},
year={2024},
volume={},
number={},
pages={17996-18006},
keywords={Visualization;Solid modeling;Three-dimensional displays;Roads;Semantics;Collaboration;Object detection;Collaborative Perception;Cooperative Perception;Semantic Occupancy Prediction;Semantic Scene Completion;Autonomous Driving;Multi-agent Systems;Robotics},
doi={10.1109/CVPR52733.2024.01704}}