Shengqu Cai 「蔡盛曲」
I'm a second-year CS PhD student at Stanford University,
advised by Prof. Gordon Wetzstein and Prof. Leonidas Guibas,
affliated with Computational Imaging Lab and Geometric Computing Lab.
I am partly supported by a Stanford School of Engineering Fellowship.
Before Stanford, I was a CS master student at ETH Zürich
supervised by Prof. Luc Van Gool.
I obtained my Bachelor degree in Computer Science with first honour from King's College London in United Kingdom, where I spent some time working on information theory.
In 2022, I spent a few wonderful months working on diffusion with Eric Chan and Songyou Peng.
I started my research career back in 2021 working on NeRFs and GANs with Anton Obukhov. I consider them as mentors coming into research and who I try to learn from.
I am interested in solving graphics or inverse graphics tasks that are fundamentally ill-posed via traditional methods, slay the unslayable.
I have been working primarily around neural rendering and generative models, including but not limited to
diffusion models, inverse rendering, unsupervised learning methods,
scene representations, etc. I like making cool theories, videos, demos and applications.
Email  / 
CV  / 
Google Scholar  / 
Semantic Scholar  / 
Github  / 
Twitter  / 
Linkedin
|
* This is me prior-COVID. Since then I gained >40 pounds and lost my cool ;(
|
News
-
2024-09: CVD is accepted to NeurIPS 2024, see you in Vancouver!
-
2024-02: Generative Rendering is accepted to CVPR 2024, see you in Seattle!
-
2023-09: I joined Stanford University for PhD in Computer Science!
-
2023-07: DiffDreamer is accepted by ICCV 2023, looking forward to Paris!
-
2023-05: I graduated from ETH Zürich!
-
2023-01: I will be working as a research intern at Adobe this summer!
-
2022-03: Pix2NeRF is accepted by CVPR 2022. First submission first accept!
|
Publications
* indicates equal contribution
|
|
Diffusion Self-Distillation for Zero-Shot Customized Image Generation
Shengqu Cai,
Eric Ryan Chan,
Yunzhi Zhang,
Leonidas Guibas,
Jiajun Wu,
Gordon Wetzstein
In arXiv, 2024
[Project Page][Paper]
Training-free customized image generation model that scales to any instance and any context.
|
|
Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control
Zhengfei Kuang*,
Shengqu Cai*,
Hao He,
Yinghao Xu,
Hongsheng Li,
Leonidas Guibas,
Gordon Wetzstein
In NeurIPS, 2024
[Project Page][Paper]
Multi-view/multi-trajectory generation of videos sharing the same underlying content and dynamics.
|
|
Robust Symmetry Detection via Riemannian Langevin Dynamics
Jihyeon Je*,
Jiayi Liu*,
Guandao Yang*,
Boyang Deng*,
Shengqu Cai,
Gordon Wetzstein,
Or Litany,
Leonidas Guibas
In SIGGRAPH Asia, 2024
[Project Page][Paper]
Render low fidelity animated mesh directly into animation using pre-trained 2D diffusion models, without the need of any further training/distillation.
|
|
Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models
Shengqu Cai,
Duygu Ceylan*,
Matheus Gadelha*,
Chun-Hao Paul Huang,
Tuanfeng Y. Wang,
Gordon Wetzstein
In CVPR, 2024
[Project Page][Paper]
Render low fidelity animated mesh directly into animation using pre-trained 2D diffusion models, without the need of any further training/distillation.
|
|
DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Models
Shengqu Cai,
Eric Ryan Chan,
Songyou Peng,
Mohamad Shahbazi,
Anton Obukhov,
Luc Van Gool,
Gordon Wetzstein
In ICCV, 2023
[Project Page][Paper][Code]
A diffusion-model based unsupervised framework capable of synthesizing novel views depicting a long camera trajectory flying into an input image.
|
|
Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translation
Shengqu Cai,
Anton Obukhov,
Dengxin Dai,
Luc Van Gool
In CVPR, 2022
[Paper][Code]
3D-free unsupervised Single view NeRF-based novel view synthesis via conditional NeRF-GAN training and inversion.
|
Misc
Conference Review: CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, Eurographics, SIGGRAPH
Journal Review: IJCV, Computing Surveys
|
|