About Me

I'm a Ph.D. student (2017-) at Robotics Institute, Carnegie Mellon University, advised by Prof. Kris Kitani. I also earned my M.S. in computer science at CMU in 2016, where I worked with Prof. Stelian Coros. I obtained my B.E. in computer science and technology from Zhejiang University in 2015. I'm a recipient of 2020 Qualcomm Innovation Fellowship.

My research lies at the intersection of computer vision, machine learning and computer graphics. I'm particularly interested in the following topics:

  • Humanoid control for pose estimation and forecasting.
  • Multi-agent trajectory forecasting.
  • Generative models and diversity sampling.
  • Reinforcement learning and imitation learning.

Highlights

Check out our new work on learning humanoid control policies and synthesizing infinite-horizon human motions.

News

Preprints

Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesis
Ye Yuan, Kris Kitani
arXiv:2006.07364, 2020
paper video
Joint 3D Tracking and Forecasting with Graph Neural Network and Diversity Sampling
Xinshuo Weng*, Ye Yuan*, Kris Kitani (*Equal Contribution)
arXiv:2003.07847, 2020
project paper

Publications

DLow: Diversifying Latent Flows for Diverse Human Motion Prediction
Ye Yuan, Kris Kitani
European Conference on Computer Vision (ECCV), 2020
talk project paper summary demo code
Efficient Non-Line-of-Sight Imaging from Transient Sinograms
Mariko Isogawa, Dorian Yao Chan, Ye Yuan, Kris Kitani, Matthew O'Toole
European Conference on Computer Vision (ECCV), 2020
project paper video summary
Diverse Trajectory Forecasting with Determinantal Point Processes
Ye Yuan, Kris Kitani
International Conference on Learning Representations (ICLR), 2020
talk paper video
Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation
Mariko Isogawa, Ye Yuan, Matthew O’Toole, Kris Kitani
Conference on Computer Vision and Pattern Recognition (CVPR), 2020
project paper video code
Generative Hybrid Representations for Activity Forecasting with No-Regret Learning
Jiaqi Guan, Ye Yuan, Kris Kitani, Nick Rhinehart
Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Oral Presentation
paper data
Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network
Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, Kris Kitani
ACM Symposium on User Interface Software and Technology (UIST), 2020
paper video
MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera
Dong-Hyun Hwang, Kohei Aso, Ye Yuan, Kris Kitani, Hideki Koike
ACM Symposium on User Interface Software and Technology (UIST), 2020
paper video
Ego-Pose Estimation and Forecasting as Real-Time PD Control
Ye Yuan, Kris Kitani
International Conference on Computer Vision (ICCV), 2019
project paper video code data poster
3D Ego-Pose Estimation via Imitation Learning
Ye Yuan, Kris Kitani
European Conference on Computer Vision (ECCV), 2018
paper video poster
Computational Design of Transformables
Ye Yuan, Changxi Zheng, Stelian Coros
ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 2018
paper video slides
Computational Abstractions for Interactive Design of Robotic Devices
Ruta Desai, Ye Yuan, Stelian Coros
IEEE International Conference on Robotics and Automation (ICRA), 2017
paper video
Continuous Optimization of Interior Carving in 3D Fabrication
Yue Xie, Ye Yuan, Xiang Chen, Changxi Zheng, Kun Zhou
Frontiers of Computer Science, 2017
paper