Invent the Future

Welcome! I am a Research Scientist at Google and I work on creating novel interactive technologies for VR and AR. I hold a Ph.D. in Computer Science from University of Maryland, College Park, , advised by Prof. Varshney. My research covers a wide range of topics in VR and AR, spanning mixed-reality social platforms (Geollery and Social Street View), 4D video-based rendering (Montage4D and VideoFields), foveated rendering (KFR), and deep learning in graphics (SketchyScenes and LUCSS). During my Ph.D., I interned at Microsoft Research on Holoportation (4D reconstruction) and worked at Makeability Lab on real-time OCR (HandSight) advised by Prof. Froehlich. I am passionate about inventing future interactive technologies with computer graphics, 3D vision, and HCI. Feel free to visit my YouTube and ShaderToy for fun demos!


Prior to UMD, I received my B.S. degree from ACM Class, Computer Science at Shanghai Jiao Tong University (SJTU). I served as the vice president of the ACM Class and a undergraduate research assistant in BCMI Lab. From Jul. 2012 to Feb. 2013, I worked as a full-time intern at Microsoft Research Asia working on 3DVAR: From 3D reconstruction To Virtual and Augmented Reality while serving as the Chief Technology Officer at the ARD Intern Community of Microsoft Asia-Pacific Research & Development Group.

Selected Publications

Selected Projects

Interactive Poisson Blending on GPU (ShaderToy)

Ruofei Du

DuEngine: An Efficient Interactive C++ Renderer

Ruofei Du

DuCrawler: Mining Datasets from Google and Bing

Ruofei Du

AngryBirds: Deliberately Planning and Acting for Angry Birds with Refinement Methods

Ruofei Du, Zebao Gao, Zheng Xu

C-Flow: Visualizing Foot Traffic and Profit Data to Make Informative Decisions

Tiffany Chao, Ruofei Du, Jonathan Gluck, Hitesh Maidasani, Kent Wills, Ben Shneiderman

57aMP: Create physical stamps using the thermal power of touch.

Tiffany Chao, Ruofei Du, Jon Froehlich

Cubot: An In-hand or Wearable Input Device Attached onto Everyday Object

Ruofei Du, Fan Du, Jon Froehlich

57fire: Create live fire illusion in holographic display using heat

Ruofei Du, Tiffany Chao, Jon Froehlich

Technical Reports


Ph.D. Committee Members

  • Prof. Amitabh Varshney
  • Prof. Matthias Zwicker
  • Prof. Furong Huang

  • Friends





    Previous Advisors

  • Prof. Jon E. Froehlich (HCI, and Academic Advisor)
  • Prof. Bao-Liang Lu (Neural Network, Machine Learning - SJTU BCMI Lab)
  • Dr. Zhiwei Li (Computer Vision, Segmentation, 3D Reconstruction - MSRA)
  • Dr. Rui Cai (Computer Vision, Tracking - MSRA)
  • Prof. Lei Zhang (Academic Advisor, Computer Vision - MSRA)
  • Prof. Yong Yu (Academic Advisor, Data Mining - ACM Class)

  • Industry

    Graduate Courses

    Professional Services

    Stay In Touch