📄️ Supported VQAs
All qids and corresponding supported questions. (Ones with \* is originally supported by DriveLM-CARLA open-source annotation script)
📄️ Graph Configurations
Take this config as an example:
📄️ Inference Configurations
Inference configurations of open-loop and closed-loop methods.
📄️ Evaluation Configurations
Evaluation module's configurations.
📄️ Adapt New VLMs
You can add your new vlms to B2DVL. Before doing that, please check out our supported list first.
📄️ Evaluation Details
Our evaluation of VQA primarily focuses on the correctness of the answers. Since rule-based methods are not well-suited for evaluating natural language, Bench2Drive-VL introduces an additional large language model as an evaluator to assess the natural language answers.
📄️ Baselines
Data Analysis