Topic 05 of 17

Egocentric & human data in robotics

Egocentric human data is first-person video and sensor capture of people doing everyday tasks, used as training signal for robots. It matters because teleoperated robot demonstrations are the main cost bottleneck in robot learning, and humans wearing cameras or smart glasses generate task demonstrations orders of magnitude faster. The open problem is the embodiment gap: human hands and robot grippers act differently.

arXiv query: cat:cs.RO AND (abs:"egocentric" OR abs:"human video" OR abs:"human demonstrations")