Guangkai Xu

Advisors: Prof. Chunhua Shen and Dr. Hao Chen
Lab: CAD&CG State Key Laboratory, Zhejiang University
Research: Embodied AI, Generalizable 3D Reconstruction, and Visual Perception
Guangkai Xu
302Google Scholar Citations
12Accepted Papers
5First-Author Papers
4International and National Awards

Education

2023.09 - 2027.03
Zhejiang University (Computer Science and Technology)
Ph.D.
2020.09 - 2023.06
University of Science and Technology of China (Control Science and Engineering)
M.S.
2016.09 - 2020.06
University of Electronic Science and Technology of China (Automation)
B.S.

Internship ExperienceDJIHuaweiHithink

2025.12 - 2026.06
Hithink (NLP Bot Department)
Algorithm Intern
2023.12 - 2024.06
Tencent (Platform and Content Group)
Algorithm Intern
2022.12 - 2023.04
DJI (Automotive Local Mapping Group)
Algorithm Intern
2021.04 - 2022.03
Huawei Noah's Ark Lab
Algorithm Intern

Academic Activities

CVPRICLRICCVAAAIICRAICMLSIGGRAPHICCVNeurIPS

Awards

Intelligent carCompetition field

Publications

* denotes equal contribution; † denotes corresponding author.

♠ First-Author / Co-First-Author / Corresponding-Author Papers

CVPR 2026
Unlocking the Power of Critical Factors for 3D Visual Geometry Estimation
Guangkai Xu*, Hua Geng*, Huanyi Zheng, Songyi Yin, Yanlong Sun, Hao Chen, Chunhua Shen
CVPR, 2026
Systematically analyzes key factors in 3D visual geometry estimation, including data, supervision, losses, and resolution, and proposes unified training and modeling strategies for reliable depth/normal prediction.
ICLR 2025
What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?
Guangkai Xu, Yongtao Ge, Mingyu Liu, Chengxiang Fan, Kangyang Xie, Zhiyue Zhao, Hao Chen, Chunhua Shen
ICLR, 2025
Repurposes pretrained text-to-image diffusion models for general dense perception and introduces deterministic single-step prediction for efficient, generalizable depth, normal, segmentation, and matting tasks.
ICCV 2023
FrozenRecon: Pose-free 3D Scene Reconstruction with Frozen Depth Models
Guangkai Xu*, Wei Yin*, Hao Chen, Chunhua Shen, Kai Cheng, Feng Zhao
ICCV, 2023
Uses a frozen robust monocular depth model as a geometric prior for pose-free RGB video reconstruction, jointly calibrating camera poses, intrinsics, and depth scale-shift through test-time optimization.
MIR 2024
Towards Domain-Agnostic Depth Completion
Guangkai Xu*, Wei Yin*, Jianming Zhang, Oliver Wang, Simon Niklaus, Simon Chen, Jia-Wang Bian
Machine Intelligence Research (MIR), 2024
Uses monocular depth as a cross-domain geometric prior to complete sparse, noisy, and low-resolution depth inputs, improving generalization across sensors and scenes.
JUSTC 2024
Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depth
Guangkai Xu, Feng Zhao
Journal of University of Science and Technology (JUSTC), 2024
Trains a robust monocular depth model on large-scale cross-domain RGB-D data and converts frame-wise relative depth into consistent metric geometry through sparse-anchor local scale alignment.
AAAI 2025
DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-based Dense Incident Map Generation
Xiankang He*, Guangkai Xu*, Bo Zhang, Hao Chen, Ying Cui, Dongyan Guo
AAAI, 2025 (Oral)
Reformulates monocular camera calibration as dense incident-map generation, using diffusion models to predict pixel-level imaging rays and recover camera intrinsics through geometric solving.
ICRA 2024
Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraints
Xinyi Yu, Liqin Lu, Jintao Rong, Guangkai Xu, Linlin Ou
ICRA, 2024
Improves complex indoor neural surface reconstruction by selecting reliable geometric consistency constraints with adaptive masks, reducing the negative impact of erroneous depth priors.

♠ Collaborative Papers

NeurIPS 2026
Binding Voices to Characters: Disentangled Cross-Modal Alignment for Multi-Speaker Perception
Haoliang Liu, Jingzheng Li, Jiong Yin, Zhaotian Cai, Guangkai Xu, Rongjunchen Zhang
Submitted to NeurIPS 2026
Studies multi-speaker video understanding by disentangling cross-modal alignment among character appearance, voice, and identity, improving the stability and interpretability of voice-character binding.
EMNLP 2026
ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing
Jiakang Yu, Yixuan Chai, Tianci Wang, Rihui Jin, Guangkai Xu, Hongtao Deng, Zhu Xun, Wang Gao, Xinrun Guo, Haipang Wu
Submitted to EMNLP 2026
Introduces a visuo-logical cascading chart-editing benchmark to evaluate synchronized chart editing under content, structure, semantic, and numerical-logic constraints.
ICML 2026
CG-MLLM: Captioning and Generating 3D content via Multi-modal Large Language Models
Junming Huang, Chi Wang, Letian Li, Guangkai Xu, Donglin Huang, Hao Chen, Qiang Dai, Weiwei Xu
ICML, 2026
Represents 3D objects as structured inputs processable by multimodal large language models, enabling unified 3D captioning and 3D content generation.
SIGGRAPH 2025
Generative Video Matting
Yongtao Ge, Kangyang Xie, Guangkai Xu, Li Ke, Mingyu Liu, Longtao Huang, Hui Xue, Hao Chen, Chunhua Shen
SIGGRAPH, 2025
Formulates video matting as conditional video generation, leveraging video diffusion priors to recover fine structures such as hair while improving temporal consistency.
ICCV 2025
POMATO: Marrying Pointmap Matching with Temporal Motion for Dynamic 3D Reconstruction
Songyan Zhang*, Yongtao Ge*, Jinyuan Tian*, Guangkai Xu, Hao Chen, Chen Lv, Chunhua Shen
ICCV, 2025
Combines pointmap matching with temporal motion modeling to jointly estimate dynamic 3D structure, video depth, and point trajectories with improved reconstruction consistency.
NeurIPS 2024
Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation
Muzhi Zhu*, Yang Liu*, Zekai Luo*, Chenchen Jing, Hao Chen, Guangkai Xu, Xinlong Wang, Chunhua Shen
NeurIPS, 2024
Transfers generative diffusion priors to few-shot semantic segmentation and improves novel-class segmentation through support-query interaction and mask supervision.
CVPR Workshop 2023
The Second Monocular Depth Estimation Challenge
CVPR Workshop, 2023
Won 1st place in the 2nd Monocular Depth Estimation Challenge at CVPR 2023.
arXiv 2024
GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Models
Yongtao Ge, Guangkai Xu, Zhiyue Zhao, Libo Sun, Zheng Huang, Yanlong Sun, Hao Chen, Chunhua Shen
arXiv, 2024
Builds a unified benchmark for monocular geometry estimation, comparing depth/normal models and analyzing the effects of data quality, model paradigms, and training settings.
arXiv 2022
Exploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation
Kai Cheng, Hao Chen, Wei Yin, Guangkai Xu, Xuejin Chen
arXiv, 2022
Models multi-view image correspondences with all-pairs correlations and improves multi-view depth estimation through optical-flow initialization and iterative refinement.