Publications

I devote to inventing future interactive technologies in 3D graphics, fusing the information from the physical and virtual worlds, and making it interactive, accessible, and useful in VR, AR, and MR.

Peer-reviewed Publications

Geollery: A Mixed Reality Social Media Platform Teaser Image.

Geollery: A Mixed Reality Social Media Platform

Ruofei Du, David Li, and Amitabh Varshney
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI), 2019.
Keywords: virtual reality, augmented reality, social media, GIS, street view, visualization, 3D user interface, 3D reconstruction
Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures Teaser Image.

Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures

Journal of Computer Graphics Techniques (JCGT), 2019.
Keywords: texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields
Social Street View: Blending Immersive Street Views With Geo-Tagged Social Media Teaser Image.

Social Street View: Blending Immersive Street Views With Geo-Tagged Social Media

Ruofei Du and Amitabh Varshney
Proceedings of the 21st International Conference on Web3D Technology (Web3D), 2016.
Keywords: spatial-temporal virtual reality; social media; street view; geographical information systems; mixed reality; WebGL
Fusing Multimedia Data Into Dynamic Virtual Environments Teaser Image.

Fusing Multimedia Data Into Dynamic Virtual Environments

Ruofei Du
Ph.D. Dissertation, Computer Science Department., University of Maryland, College Park., 2018.
Keywords: social street view, geollery, spherical harmonics, 360 video, multiview video, montage4d, haptics, cryptography
3D-Kernel Foveated Rendering for Light Fields Teaser Image.

3D-Kernel Foveated Rendering for Light Fields

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2020.
Keywords: light field, foveated rendering, microscopic light field, eye tracking, visualization
MeteoVis: Visualizing Meteorological Events in Virtual Reality Teaser Image.

MeteoVis: Visualizing Meteorological Events in Virtual Reality

Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA), 2020.
Keywords: scientific visualization, virtual reality, meteorological data, immersion, interactive visualization, vector field
Eye-Dominance-Guided Foveated Rendering Teaser Image.

Eye-Dominance-Guided Foveated Rendering

IEEE Transactions on Visualization and Computer Graphics (TVCG, Special Issue of IEEE Conference on Virtual Reality and 3D User Interfaces), 2020.
Keywords: virtual reality, foveated rendering, perception, gaze-contingent rendering, ocular dominance, eye tracking
Language-Based Colorization of Scene Sketches Teaser Image.

Language-Based Colorization of Scene Sketches

ACM Transactions on Graphics (SIGGRAPH Asia), 2019.
Keywords: deep neural networks; image segmentation; language-based editing; scene sketch; sketch colorization
ORC Layout: Adaptive GUI Layout With OR-Constraints Teaser Image.

ORC Layout: Adaptive GUI Layout With OR-Constraints

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI), 2019.
Keywords: GUI builder, layout manager, constraint-based layout, visual interface design, visual programming
Kernel Foveated Rendering Teaser Image.

Kernel Foveated Rendering

Proceedings of the ACM on Computer Graphics and Interactive Techniques (I3D), 2018.
Keywords: foveated rendering, perception, log-polar mapping, eye-tracking, virtual reality, head-mounted displays
Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Social Media Teaser Image.

Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Social Media

Ruofei Du, David Li, and Amitabh Varshney
Proceedings of the 24th International Conference on Web3D Technology (Web3D), 2019.
Keywords: virtual reality, mixed reality, 360° image, GIS, 3D reconstruction, projection mapping, mirrored world, social media, WebGL
Montage4D: Interactive Seamless Fusion of Multiview Video Textures Teaser Image.

Montage4D: Interactive Seamless Fusion of Multiview Video Textures

Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), 2018.
Keywords: texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields
SketchyScene: Richly-Annotated Scene Sketches Teaser Image.

SketchyScene: Richly-Annotated Scene Sketches

European Conference on Computer Vision (ECCV), 2018.
Keywords: sketch dataset, scene sketch, sketch segmentation
Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras Teaser Image.

Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras

ACM Transactions on Accessible Computing (TACCESS), 2016.
Keywords: accessibility, real-time OCR, visual impairments, wearables
Video Fields: Fusing Multiple Surveillance Videos Into a Dynamic Virtual Environment Teaser Image.

Video Fields: Fusing Multiple Surveillance Videos Into a Dynamic Virtual Environment

Ruofei Du, Sujal Bista, and Amitabh Varshney
Proceedings of the 21st International Conference on Web3D Technology (Web3D), 2016.
Keywords: virtual reality; mixed-reality; video-based rendering; projection mapping; surveillance video; WebGL; WebVR
Experiencing a Mirrored World With Geotagged Social Media in Geollery Teaser Image.

Experiencing a Mirrored World With Geotagged Social Media in Geollery

Ruofei Du, David Li, and Amitabh Varshney
Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA), 2019.
Keywords: virtual reality, augmented reality, social media, GIS, street view, visualization, 3D user interface, 3D reconstruction
Interactive Fusion of 360° Images for a Mirrored World Teaser Image.

Interactive Fusion of 360° Images for a Mirrored World

Ruofei Du, David Li, and Amitabh Varshney
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
Keywords: virtual reality, 360° image, 3D reconstruction, mixed reality, projection mapping, mirrored world
Tracking-Tolerent Visual Cryptography Teaser Image.

Tracking-Tolerent Visual Cryptography

Ruofei Du, Eric Lee, and Amitabh Varshney
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
Keywords: visual cryptography, augmented reality (AR), tracking
VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality Teaser Image.

VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality

Ruofei Du and Liang He
Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA), 2016.
Keywords: Virtual Reality; Tangible User Interface; Haptics; Gesture Recognition; Head-Mounted Display
AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden Teaser Image.

AtmoSPHERE: Representing Space and Movement Using Sand Traces in an Interactive Zen Garden

Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA), 2015.
Keywords: Visualization; Tangible Interactive Art; Machine Aesthetics; Calm Technology; XY Servo Table; Kinect
The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind Teaser Image.

The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

Computer Vision - ECCV 2014 Workshops (ECCVW), 2014.
Keywords: Accessibility, Wearables, Real-time OCR, Text Reading for Blind
Supporting Everyday Activities for Persons With Visual Impairments Through Computer Vision Teaser Image.

Supporting Everyday Activities for Persons With Visual Impairments Through Computer Vision

Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS), 2015.
Keywords: Blind; visually impaired; wearable computing; computer vision; vision-augmented touch
Online Vigilance Analysis Combining Video and Electrooculography Features Teaser Image.

Online Vigilance Analysis Combining Video and Electrooculography Features

Neural Information Processing - 19th International Conference (ICONIP), 2012.
Keywords: Vigilance Analysis Fatigue Detection Active Shape Model Electrooculography Support Vector Machine
Facial Expression Recognition by Combining Texture and Geometrical Features Teaser Image.

Facial Expression Recognition by Combining Texture and Geometrical Features

Renjie Liu, Ruofei Du, and Bao-Liang Lu
Proccedings of International Conference on Data Science and Engineering, 2012.

Technical Reports

C-Flow: Visualizing Foot Traffic and Profit Data to Make Informative Decisions Teaser Image.

C-Flow: Visualizing Foot Traffic and Profit Data to Make Informative Decisions

University of Maryland, College Park. Department of Computer Science, 2012.
Keywords: Information Visualization; Data Mapping; Indoor Visualization; Business; Usability Testing
Statistics for K-Mer Based Splicing Analysis Teaser Image.

Statistics for K-Mer Based Splicing Analysis

Ruofei Du, Hao Li, Hui Miao, and Shangfu Peng
University of Maryland, College Park. Department of Computer Science, 2014.
UistViz: 26 Years of UIST Coauthor Network Visualization Teaser Image.

UistViz: 26 Years of UIST Coauthor Network Visualization

Ruofei Du
University of Maryland, College Park. Department of Computer Science, 2013.
Keywords: Information Visualization; UIST; Coauthor Network; DBLP; NodeXL
Learning Depression Patterns From MyPersonality and Reddit Teaser Image.

Learning Depression Patterns From MyPersonality and Reddit

Weiwei Yang, Xuetong Sun, and Ruofei Du
University of Maryland, College Park. Department of Computer Science, 2015.
Zero-Shot Learning Based Pedestrian Parsing Teaser Image.

Zero-Shot Learning Based Pedestrian Parsing

Xiyang Dai, Ruofei Du, and Hao Zhou
University of Maryland, College Park. Department of Computer Science, 2015.
Keywords: pedestrian parsing, zero-shot learning, segmentation
Deliberately Planning and Acting for Angry Birds With Refinement Methods Teaser Image.

Deliberately Planning and Acting for Angry Birds With Refinement Methods

Ruofei Du, Zebao Gao, and Zheng Xu
University of Maryland, College Park. Department of Computer Science, 2015.

Stay In Touch