Publications

KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation

Zixian Liu*, Mingtong Zhang*, Yunzhu Li

Best Paper Finalist at CoRL LangRob Workshop, 2024 [Project]

KUDA is an open-vocabulary manipulation system that unifies the visual prompting of vision language models (VLMs) and dynamics modeling with keypoints.