Shengqu Cai 「蔡盛曲」

I'm a second-year CS PhD student at Stanford University, advised by Prof. Gordon Wetzstein and Prof. Leonidas Guibas, affliated with Computational Imaging Lab and Geometric Computing Lab. I am partly supported by a Stanford School of Engineering Fellowship.

Before Stanford, I was a CS master student at ETH Zürich supervised by Prof. Luc Van Gool. I obtained my Bachelor degree in Computer Science with first honour from King's College London in United Kingdom, where I spent some time working on information theory.

In 2022, I spent a few wonderful months working on diffusion with Eric Chan and Songyou Peng. I started my research career back in 2021 working on NeRFs and GANs with Anton Obukhov. I consider them as mentors coming into research and who I try to learn from.

I am interested in solving graphics or inverse graphics tasks that are fundamentally ill-posed via traditional methods, slay the unslayable. I have been working primarily around neural rendering and generative models, including but not limited to diffusion models, inverse rendering, unsupervised learning methods, scene representations, etc. I like making cool theories, videos, demos and applications.

Email  /  CV  /  Google Scholar  /  Semantic Scholar  /  Github  /  Twitter  /  Linkedin

profile photo
* This is me prior-COVID. Since then I gained >40 pounds and lost my cool
;(
News
  • 2024-09: CVD is accepted to NeurIPS 2024, see you in Vancouver!
  • 2024-02: Generative Rendering is accepted to CVPR 2024, see you in Seattle!
  • 2023-09: I joined Stanford University for PhD in Computer Science!
  • 2023-07: DiffDreamer is accepted by ICCV 2023, looking forward to Paris!
  • 2023-05: I graduated from ETH Zürich!
  • 2023-01: I will be working as a research intern at Adobe this summer!
  • 2022-03: Pix2NeRF is accepted by CVPR 2022. First submission first accept!
Publications

* indicates equal contribution

dise Diffusion Self-Distillation for Zero-Shot Customized Image Generation
Shengqu Cai, Eric Ryan Chan, Yunzhi Zhang, Leonidas Guibas, Jiajun Wu, Gordon Wetzstein
In arXiv, 2024
[Project Page][Paper]

Training-free customized image generation model that scales to any instance and any context.

dise Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control
Zhengfei Kuang*, Shengqu Cai*, Hao He, Yinghao Xu, Hongsheng Li, Leonidas Guibas, Gordon Wetzstein
In NeurIPS, 2024
[Project Page][Paper]

Multi-view/multi-trajectory generation of videos sharing the same underlying content and dynamics.

dise Robust Symmetry Detection via Riemannian Langevin Dynamics
Jihyeon Je*, Jiayi Liu*, Guandao Yang*, Boyang Deng*, Shengqu Cai, Gordon Wetzstein, Or Litany, Leonidas Guibas
In SIGGRAPH Asia, 2024
[Project Page][Paper]

Render low fidelity animated mesh directly into animation using pre-trained 2D diffusion models, without the need of any further training/distillation.

dise Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models
Shengqu Cai, Duygu Ceylan*, Matheus Gadelha*, Chun-Hao Paul Huang, Tuanfeng Y. Wang, Gordon Wetzstein
In CVPR, 2024
[Project Page][Paper]

Render low fidelity animated mesh directly into animation using pre-trained 2D diffusion models, without the need of any further training/distillation.

dise DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Models
Shengqu Cai, Eric Ryan Chan, Songyou Peng, Mohamad Shahbazi, Anton Obukhov, Luc Van Gool, Gordon Wetzstein
In ICCV, 2023
[Project Page][Paper][Code]

A diffusion-model based unsupervised framework capable of synthesizing novel views depicting a long camera trajectory flying into an input image.

dise Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translation
Shengqu Cai, Anton Obukhov, Dengxin Dai, Luc Van Gool
In CVPR, 2022
[Paper][Code]

3D-free unsupervised Single view NeRF-based novel view synthesis via conditional NeRF-GAN training and inversion.

Misc

  • Conference Review: CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, Eurographics, SIGGRAPH
  • Journal Review: IJCV, Computing Surveys

  • © Shengqu Cai | Last updated: September 25th, 2024 | Website Template