About Me

I am an incoming PhD student at NTU, where I will be supervised by Prof. Ziwei Liu. I completed my Master's degree in computer science at UCSD. Before that, I obtained my B.S. degree in Electric and Computer Engineering from Shanghai Jiao Tong University in 2022.

I am interested in computer vision and autonomous driving. My current work focuses on multi-modal learning.

Experience

Research Intern | New York University
Time: Jun 2023 - Jun 2024.
Advisor: Prof. Saining Xie

Research Intern | OpenDriveLab, Shanghai AI Lab
Time: Sept 2021 - Dec 2022.
Mentor: Dr. Hongyang Li

Selected Publications [Google Scholar]

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs
Shengbang Tong*, Ellis Brown*, Penghao Wu*, Sanghyun Woo, Manoj Middepogu, Sai Charitha Akula, Jihan Yang, Shusheng Yang, Adithya Iyer, Xichen Pan, Austin Wang, Rob Fergus, Yann LeCun, Saining Xie
Neural Information Processing Systems, NeurIPS 2024 (Oral)
[Paper] [Code] [Project Page]

V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs
Penghao Wu, Saining Xie
Computer Vision and Pattern Recognition Conference, CVPR 2024
[Paper] [Code] [Project Page]

End-to-end autonomous driving: Challenges and frontiers
Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger, Hongyang Li
arXiv preprint, 2023
[Paper] [Code]

Policy Pre-training for Autonomous Driving via Self-supervised Geometric Modeling
Penghao Wu, Li Chen, Xiaosong Jia, Hongyang Li, Junchi Yan, Yu Qiao
International Conference on Representation Learning, ICLR 2023
[Paper] [Code]

Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline
Penghao Wu*, Xiaosong Jia*, Li Chen*, Junchi Yan, Hongyang Li, Yu Qiao
Neural Information Processing Systems, NeurIPS 2022
[Paper] [Code]

Services

Conference Reviewer
  • CVPR 2023, 2024
  • ICCV 2023
  • NeurIPS 2023
  • ICLR 2024, 2025
  • ICML 2024
  • ECCV 2024