| FazBrowse GitHub Viewer | Trending | | Home |
| Tools: [Download Repo ZIP] [Original HTTPS Page] |
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Haochen Tian, Tianyu Li, Haochen Liu, Jiazhi Yang, Yihang Qiu, Guang Li, Junli Wang, Yinfeng Gao, Zhang Zhang, Liang Wang, Hangjun Ye, Tieniu Tan, Long Chen, Hongyang Li
- 📧 Primary Contact: Haochen Tian (tianhaochen2023@ia.ac.cn)
- 📜 Materials: 🌐 𝕏 | 📰 Media | 🗂️ Slides | 🪧 Poster | 🎬 CVPR Oral Pre / Talk (in Chinese)
- 🖊️ Joint effort by CASIA, OpenDriveLab at HKU, and Xiaomi EV.
| Model | Backbone | Sim-Real Config | NAVSIM v2 navhard | NAVSIM v2 navtest | ||
|---|---|---|---|---|---|---|
| EPDMS | CKPT | EPDMS | CKPT | |||
| LTF | ResNet34 | w/ pseudo-expert | 30.3 | +6.9 | HF / MS | 84.4 | +2.9 | HF / MS |
| DiffusionDrive | ResNet34 | w/ pseudo-expert | 32.6 | +5.1 | HF / MS | 85.9 | +1.7 | HF / MS |
| GTRS-Dense | ResNet34 | w/ pseudo-expert | 46.1 | +7.8 | HF / MS | 84.0 | +1.7 | HF / MS |
| rewards only | 46.9 | +8.6 | HF / MS | 84.6 | +2.3 | HF / MS | ||
| V2-99 | w/ pseudo-expert | 47.7 | +5.8 | HF / MS | 84.5 | +0.5 | HF / MS | |
| rewards only | 48.0 | +6.1 | HF / MS | 84.8 | +0.8 | HF / MS | ||
Note
We fixed a minor error in the simulation process without changing the method, resulting in better performance than the numbers reported in the early arXiv version v2. We have updated the arXiv version v2.
git clone https://github.com/OpenDriveLab/SimScale.git
cd SimScaleconda env create --name simscale -f environment.yml
conda activate simscale
pip install -e .Our released simulation data is based on nuPlan and NAVSIM. We recommend first preparing the real-world data by following the instructions in Download NAVSIM. If you plan to use GTRS, please directly refer Download NAVSIM.
We provide 🤗 Script (Hugging Face) and 👾 Script (ModelScope) (users in China) for downloading the simulation data .
Our simulation data format follows that of OpenScene, with each clip/log has a fixed temporal horizon of 6 seconds at 2 Hz (2 s history + 4 s future), which are stored separately in sensor_blobs_hist and sensor_blobs_fut, respectively. For policy training, sensor_blobs_hist alone is sufficient.
| Split / Sim. Round | # Tokens | Logs | Sensors_Hist | Sensors_Fut | Link |
|---|---|---|---|---|---|
| Planner-based Pseudo-Expert | |||||
| reaction_pdm_v1.0-0 | 65K | 9.9GB | 569GB | 1.2T | HF+ HF_Fut / MS |
| reaction_pdm_v1.0-1 | 55K | 8.5GB | 448GB | 964GB | HF+ HF_Fut / MS |
| reaction_pdm_v1.0-2 | 46K | 6.9GB | 402GB | 801GB | HF+ HF_Fut / MS |
| reaction_pdm_v1.0-3 | 38K | 5.6GB | 333GB | 663GB | HF+ HF_Fut / MS |
| reaction_pdm_v1.0-4 | 32K | 4.7GB | 279GB | 554GB | HF+ HF_Fut / MS |
| Recovery-based Pseudo-Expert | |||||
| reaction_recovery_v1.0-0 | 45K | 6.8GB | 395GB | 789GB | HF+ HF_Fut / MS |
| reaction_recovery_v1.0-1 | 36K | 5.5GB | 316GB | 631GB | HF+ HF_Fut / MS |
| reaction_recovery_v1.0-2 | 28K | 4.3GB | 244GB | 488GB | HF+ HF_Fut / MS |
| reaction_recovery_v1.0-3 | 22K | 3.3GB | 189GB | 378GB | HF+ HF_Fut / MS |
| reaction_recovery_v1.0-4 | 17K | 2.7GB | 148GB | 296GB | HF+ HF_Fut / MS |
Tip
Before downloading, we recommend checking the table above to select the appropriate split and sensor_blobs.
|
5c9694f15f9c5537
|
367cfa28901257ee
|
d37c49db3dcd59fa
|
|
Sim. 1 ![]() Sim. 2 ![]() Sim. 3
|
Sim. 1 ![]() Sim. 2 ![]() Sim. 3
|
Sim. 1 ![]() Sim. 2 ![]() Sim. 3
|
We provide a Script for moving the download simulation data to create the following structure.
navsim_workspace/
├── simscale/
├── exp/
└── dataset/
├── maps/
├── navsim_logs/
│ ├── test/
│ ├── trainval/
│ ├── synthetic_reaction_pdm_v1.0-*/
│ │ ├── [log]-00*.pkl
│ │ └── ...
│ └── synthetic_reaction_recovery_v1.0-*/
├── sensor_blobs/
│ ├── test/
│ ├── trainval/
│ ├── synthetic_reaction_pdm_v1.0-*/
│ │ └── [token]-00*/
│ │ ├── CAM_B0/
│ │ └── ...
│ └── synthetic_reaction_recovery_v1.0-*/
└── navhard_two_stage/
We provide Scripts for sim–real co-training, e.g., run_diffusiondrive_training_syn.sh.
The main configuration options are as follows:
export SYN_IDX=0 # 0, 1, 2, 3, 4
export SYN_GT=pdm # pdm, recoverySimulation feature and target caches are loaded from ${NAVSIM_EXP_ROOT}/cache/synthetic_reaction_${SYN_GT}_v1.0-${idx}_cache in dataset.py#136, where idx ranges from 0 through SYN_IDX. Generate these caches with run_dataset_cache.sh, setting TRAIN_TEST_SPLIT to the corresponding synthetic_reaction_* split. If you already have caches under the old split names, rename those cache directories to match this convention before training.
We provide a Script to train LTF with 8 GPUs for 100 epochs.
We provide a Script to train DiffusionDrive with 8 GPUs for 100 epochs.
We provide a Script to train GTRS_Dense on 4 nodes, each with 8 GPUs, for 50 epochs.
We also provide 🤗 Reward Files (Hugging Face) and 👾 Reward Files (ModelScope) (users in China) for rewards in simulation data. Please download correspending files first and move them to NAVSIM_TRAJPDM_ROOT/sim. The reward files path is hard-coded in gtrs_agent.py#223. Check it before training.
It uses the same training Script, to train GTRS_Dense on 4 nodes, each with 8 GPUs, for 50 epochs.
The main configuration option is as follows:
syn_imi=false # true, falseRefer the Script to cache metric first.
We provide Scripts to evaluate three policies on navhard using GPU inference.
We provide Scripts to evaluate three policies on navtest using GPU inference.
We acknowledge all the open-source contributors for the following projects to make this work possible:
The SimScale community continues to grow, with projects building on and extending its real-world simulation and sim-real co-training framework for end-to-end autonomous driving. Here are some awesome community projects:
All content in this repository is under the Apache-2.0 license. The released data is based on nuPlan and is under the CC-BY-NC-SA 4.0 license.
If any parts of our paper and code help your research, please consider citing us and giving a star to our repository.
@inproceedings{tian2026simscale,
title={SimScale: Learning to Drive via Real-World Simulation at Scale},
author={Tian, Haochen and Li, Tianyu and Liu, Haochen and Yang, Jiazhi and Qiu, Yihang and Li, Guang and Wang, Junli and Gao, Yinfeng and Zhang, Zhang and Wang, Liang and Ye, Hangjun and Chen, Long and Li, Hongyang},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
year={2026}| Back | FazBrowse Home | New Git URL |