Hengkai (Gary) Pan

I’m a first-year MSR student at CMU RI, advised by Prof. Deepak Pathak.

Previously, I did my undergraduate at NYU, where I worked with Jeff Cui and Gaoyue Zhou under the supervision of Prof. Lerrel Pinto. I also had the opportunity to work on multi-modal AI for healthcare with Prof. Artie Shen and I work closely with Prof. Aran Nayebi on artificial curiosity and world models.

Email  /  Scholar  /  Twitter  /  Github

profile photo

Research

My research interests include robotics and computer vision, with a current focus on world models and imitation from observations.

DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
Gaoyue Zhou, Hengkai Pan, Yann LeCun, Lerrel Pinto,
Under Review
project page / arXiv
DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control
Zichen Jeff Cui, Hengkai Pan, Aadhithya Iyer, Siddhant Haldar, Lerrel Pinto,
NeurIPS, 2024  
project page / arXiv / code
BURExtract-Llama: An LLM for Clinical Concept Extraction in Breast Ultrasound Reports
Yuxuan Chen, Haoyan Yang, Hengkai Pan Fardeen Siddiqui, Antonio Verdone, Qingyang Zhang, Sumit Chopra, Chen Zhao, Yiqiu Shen,
ACM Multimedia Computing for Health and Medicine, 2024
arXiv

Template From Jon Barron.
Last updated October 2024.