About Me

I'm a Ph.D. student (2017-) at Robotics Institute, Carnegie Mellon University, advised by Prof. Kris Kitani. I also earned my M.S. in computer science at CMU in 2016, where I worked with Prof. Stelian Coros. I obtained my B.E. in computer science and technology from Zhejiang University in 2015. I'm a recipient of 2020 Qualcomm Innovation Fellowship.

My research lies at the intersection of computer vision, machine learning and robotics. I'm particularly interested in the following topics:

  • Humanoid control for pose estimation and forecasting.
  • Multi-agent trajectory forecasting.
  • Generative models and diversity sampling.
  • Reinforcement learning and imitation learning.


Excited to share our NeurIPS 2020 work on learning humanoid control policies and synthesizing infinite-horizon human motions.



Joint 3D Tracking and Forecasting with Graph Neural Network and Diversity Sampling
Xinshuo Weng*, Ye Yuan*, Kris Kitani (*Equal Contribution)
arXiv:2003.07847, 2020
project paper


Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesis
Ye Yuan, Kris Kitani
NeurIPS 2020
project paper video code
DLow: Diversifying Latent Flows for Diverse Human Motion Prediction
Ye Yuan, Kris Kitani
ECCV 2020
talk project paper summary demo code
Efficient Non-Line-of-Sight Imaging from Transient Sinograms
Mariko Isogawa, Dorian Yao Chan, Ye Yuan, Kris Kitani, Matthew O'Toole
ECCV 2020
project paper video summary
Diverse Trajectory Forecasting with Determinantal Point Processes
Ye Yuan, Kris Kitani
ICLR 2020
talk paper video
Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation
Mariko Isogawa, Ye Yuan, Matthew O’Toole, Kris Kitani
CVPR 2020
project paper video code
Generative Hybrid Representations for Activity Forecasting with No-Regret Learning
Jiaqi Guan, Ye Yuan, Kris Kitani, Nick Rhinehart
CVPR 2020 (Oral Presentation)
paper data
Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network
Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, Kris Kitani
ACM Symposium on User Interface Software and Technology (UIST), 2020
paper video
MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera
Dong-Hyun Hwang, Kohei Aso, Ye Yuan, Kris Kitani, Hideki Koike
ACM Symposium on User Interface Software and Technology (UIST), 2020
paper video
Ego-Pose Estimation and Forecasting as Real-Time PD Control
Ye Yuan, Kris Kitani
ICCV 2019
project paper video code data poster
3D Ego-Pose Estimation via Imitation Learning
Ye Yuan, Kris Kitani
ECCV 2018
paper video poster
Computational Design of Transformables
Ye Yuan, Changxi Zheng, Stelian Coros
ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 2018
paper video slides
Computational Abstractions for Interactive Design of Robotic Devices
Ruta Desai, Ye Yuan, Stelian Coros
ICRA 2017
paper video
Continuous Optimization of Interior Carving in 3D Fabrication
Yue Xie, Ye Yuan, Xiang Chen, Changxi Zheng, Kun Zhou
Frontiers of Computer Science, 2017