Home
Home

About Me

My name is Ruolin Ye. I am a fourth-year Ph.D. student at Cornell University supervised by Prof. Tapomayukh Bhattacharjee. I worked with Prof. Cewu Lu, in MVIG Lab during my undergrad at Shanghai Jiao Tong University.

My broad research interest is robotic caregiving, and I am especially interested in robot-assisted transferring. I study how to coordinate multiple instrumented assistive devices to complete this task. I am also interested in simulation. I am leading the RCareWorld simulation project.

I volunteer at Wonderful Wheelchairs, a local non-profit organization that repairs and sells assistive devices to people with a low cost. I manage the website and IT-related stuff while also leading outreach efforts.

🥷 Experiences

Cornell University, Ithaca, NY
Ph.D. Student in Computer Science
Aug 2022 - Present

Shanghai Jiao Tong University, Shanghai, China
Bachelor of Engineering in Information Engineering
Sep 2018 - Aug 2022

📄 Publications

IROS'26|Website
OpenRoboCare: A Multi-Modal Multi-Task Expert Demonstration Dataset for Robot Caregiving
Xiaoyu Liang, Ziang Liu, Kelvin Lin*, Edward Gu*, Ruolin Ye, Tam Nguyen, Cynthia Hsu, Zhanxin Wu, Xiaoman Yang, Christy Sum Yu Cheung, Harold Soh, Katherine Dimitropoulou, Tapomayukh Bhattacharjee 
International Conference on Intelligent Robots and Systems
HRI'25|Paper
RCareGen: An Interface for Scene and Task Generation in RCareWorld
Shuaixing Chen, Ruolin Ye, Saurabh Dingwani, Pooyan Fazli, Hasti Seifi, Tapomayukh Bhattacharjee 
ACM/IEEE International Conference on Human-Robot Interaction
CART-MPC: Coordinating Assistive Devices for Robot-Assisted Transferring with Multi-Agent Model Predictive Control
Ruolin Ye*, Shuaixing Chen*, Yunting Yan*, Joyce Yang, Christina Ge, Jose Barreiros, Kate Tsui, Tom Silver, Tapomayukh Bhattacharjee 
ACM/IEEE International Conference on Human-Robot Interaction
IROS'24|PaperWebsite
REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feeding
Nayoung Ha*, Ruolin Ye*, Ziang Liu, Shubhangi Sinha, Tapomayukh Bhattacharjee 
International Conference on Intelligent Robots and Systems
ICRA'24|PaperWebsite
MORPHeus: a Multimodal One-armed Robot-assisted Peeling system with Human Users in-the-loop
Ruolin Ye, Yifei Hu, Yuhan (Anjelica) Bian, Luke Kulm, Tapomayukh Bhattacharjee 
IEEE International Conference on Robotics and Automation
ICCV (Oral)'23|Paper
ClothPose: A Real-world Benchmark for Visual Analysis of Garment Pose via An Indirect Recording Solution
Wenqiang Xu, Wenxin Du, Han Xue, Yutong Li, Ruolin Ye, Yan-feng Wang, Cewu Lu 
International Conference on Computer Vision
Visual-Tactile Sensing for In-Hand Object Reconstruction
Wenqiang Xu*, Zhenjun Yu*, Han Xue, Ruolin Ye, Siqiong Yao, Cewu Lu 
The IEEE/CVF Conference on Computer Vision and Pattern Recognition
GarmentTracking: Category-Level Garment Pose Tracking
Han Xue*, Wenqiang Xu*, Jieyi Zhang, Tutian Tang, Yutong Li, Wenxin Du, Ruolin Ye, Cewu Lu 
The IEEE/CVF Conference on Computer Vision and Pattern Recognition
RCareWorld: A Human-centric Simulation World for Caregiving Robots
Ruolin Ye*, Wenqiang Xu*, Haoyuan Fu, Rajat Kumar Jenamani, Vy Nguyen, Cewu Lu, Katherine Dimitropoulou, Tapomayukh Bhattacharjee 
IEEE/RSJ International Conference on Intelligent Robots and Systems
Best RoboCup paper (Winner). Best paper/best student paper (Finalist).
RFUniverse: A Multiphysics Simulation Platform for Embodied AI
Haoyuan Fu*, Wenqiang Xu*, Ruolin Ye*, Han Xue, Tutian Tang, Yutong Li, Wenxin Du, Zhenjun Yu, Jieyi Zhang, Yongxi Huang, Cewu Lu 
Robotics Science and Systems
ICCV'21|PaperWebsite
H2O: A Benchmark for Visual Human-human Object Handover Analysis
Ruolin Ye*, Wenqiang Xu*, Zhendong Xue, Tutian Tang, Yanfeng Wang, Cewu Lu 
International Conference on Computer Vision
arXiv'20|PaperCode
Learning Universal Shape Dictionary for Realtime Instance Segmentation
Tutian Tang*, Wenqiang Xu*, Ruolin Ye, Lixin Yang, Cewu Lu 
Preprint
arXiv'21|Paper
ContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Pass
Tutian Tang*, Wenqiang Xu*, Ruolin Ye, Yan-feng Wang, Cewu Lu 
Preprint

❤️ Services and Awards

Academic services

  • Reviewer
    • Conferences: ICCV 2023, CVPR 2022&2023, ECCV 2022, IROS 2022-2024, ICRA 2023-2024, HRI 2025
    • Jornals: Frontiers in Robotics and AI, Frontiers in Neurorobotics, T-RO

Awards

  • Outstading teaching assistant, Cornell 2024
  • IROS-SDC Travel Award, IROS 2022
  • RoboCup Best Paper Award, IROS 2022
  • Best Paper/Student Paper Finalist, IROS 2022
  • Bosch AIoT Scholarship, 2022
  • Queer in AI Grad Admissions Fee Aid, 2022
  • Honorable Mention, MCM/ICM Mathematical Contest 2020&2021

📧 Contacts

EmailGitHubTwitterWechat