Tong Zhang

I am a Ph.D. student at Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University, advised by Prof. Yang Gao. Previously, I received my bachelor degree from Department of Electronic Engineering in Tsinghua University.

My primary research interest lies at the intersection of computer vision and robotics. I am particularly focused on the application of 3D vision in robotic perception and am committed to developing universal and real-world effective perception modules for robots.

Email  /  Google Scholar  /  Github

Publications

We build a 3D flow prediction model directly from large-scale RGBD human video datasets. Based on this model, we achieve stable zero-shot human-to-robot skill transfer in the real world.

We introduce ViLa, a novel approach for long-horizon robotic planning that leverages GPT-4V to generate a sequence of actionable steps. ViLa empowers robots to execute complex tasks with a profound understanding of the visual world.

We present Semantic-Geometric Representation (SGR), a universal perception module for robotics that leverages the rich semantic information of large-scale pre-trained 2D models and inherits the merits of 3D spatial reasoning.