Topic

Video & generative modeling

The upstream stack robotics borrows: video generation, diffusion and autoregressive models of pixels, and the representations they learn.

85papers in 2026-07

7.29%of all cs.RO that month

+0.73ppshare change, last 6 vs prior 12 months

24-month volume

arXiv query: cat:cs.RO AND (abs:"video generation" OR abs:"video diffusion" OR abs:"vision-language model")

Presented at reading clubs

These already have a slide kit, so they are the fastest ones to pick up and present.

2026-01-07

Diffusion-DRF: Free, Rich, and Differentiable Reward for Video Diffusion Fine-Tuning

Yifan Wang, Yanyu Li, Gordon Guocheng Qian +3 · 2 citations

clubReinforcement learning & control Video & generative modeling

2025-12-31

Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flow

Karthik Dharmarajan, Wenlong Huang, Jiajun Wu +2 · 30 citations

clubReinforcement learning & control Hardware & morphology co-design

2024-06-11

An Image is Worth 32 Tokens for Reconstruction and Generation

Qihang Yu, Mark Weber, Xueqing Deng +3 · 312 citations

clubNeurIPSVideo & generative modeling

Recent work

2026-08-27

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

Chuan Fang, Lingteng Qiu, Yixun Liang +8

World models 3D & spatial reasoning

2026-08-27

4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation

Zehao Qi, Haochen Luo, Jia-Wang Bian +2

Simulation, sim-to-real & benchmarks Navigation & mobility

2026-08-27

Decoupling Planning and Control for Instructable Agents

Zineng Tang, Kelsey R. Allen, Sjoerd van Steenkiste +2

World models Vision-language-action

2026-08-26

VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning

Junxiang Xu, Ruisi Wang, Fanyi Pu +49

Reinforcement learning & control Video & generative modeling

2026-08-26

Leveraging Inter-object Affordances for Efficient Planning in Contact-rich Tasks

Pouya P. Niaz, Justus Piater, Alejandro Agostini

Dexterous manipulation Tactile & force sensing

2026-08-26

Beyond Pairwise Feedback: Listwise Vision-Language Supervision for Preference-Based Reward Learning

Srivalli Katkuri, Maxwell Kawada, Juan Wachs

Reinforcement learning & control Video & generative modeling

2026-08-25

GaussVLA: Geometry-Aware Spatial Reasoning for Vision-Language-Action Model

Md Selim Sarowar, Md Tanvir Islam, Sungho Kim +1

Vision-language-action 3D & spatial reasoning

2026-08-25

Latent Action as Intention Enables Efficient Future Imagination for World Action Models

Xiang Li, Yupeng Zheng, Songen Gu +10

Foundation models & pretraining Video & generative modeling

2026-08-25

Gripper-aware Vision Language Action Models

Hanyi Zhang, Zihong Luo, Tianyu Li +16

Vision-language-action Dexterous manipulation

2026-08-25

X-MULTI: VLM-based Imaging Factor Disentanglement for Factor-Aware Image Synthesis

Sonali Godavarthy, Matthias Neuwirth-Trapp, Tim-Felix Faasch +4

ECCV 2026Video & generative modeling

2026-08-25

SIREN-Bench: Behavior-Driven Generation and Evaluation of Emergency-Vehicle Interactions

Yicheng Zhu, Tianmu Zhao, Haoxin Leng +3

Simulation, sim-to-real & benchmarks Data collection & teleoperation

2026-08-24

OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation

Alperen Avan, Jordi Sanchez-Riera

Navigation & mobility Video & generative modeling

2026-08-24

MIVIFI: Bridging Perspective and Fisheye Domains for Training Multi-View Fisheye Image Generation Models

Matthias Neuwirth-Trapp, Begüm Altunbas, Jiayi Wang +4

3D & spatial reasoning Data collection & teleoperation

2026-08-24

SuperMap: A Spatio-Temporal SLAM System for Visual-Language Navigation

Shibo Zhao, Guofei Chen, Honghao Zhu +7 · 1 citation

3D & spatial reasoning Navigation & mobility

2026-08-23

LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models

Zhenhao Shen, Jiaqi Liang, Jasper Lu +11

World models Dexterous manipulation

2026-08-22

DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation

Fenghao Lei, Zhixiong Huang, Long Yang +5

World models Video & generative modeling

2026-08-22

Ludi${}_{\scriptscriptstyle 0.1}$: An Agentic System for Socially Intelligent Robots

Wooseong Chung, William Cong, Jakub Dworakowski +14

Navigation & mobility Foundation models & pretraining

2026-08-22

GuardianBench: A Same-Scene Instruction-Contrastive Benchmark for Latent Contextual Risk in Embodied AI

Zhesheng Zhang, Jiahao Lu, Wei Liu +8

Video & generative modeling Safety & evaluation

2026-08-21

ViTacPhys: Physical Property-Aware Grasping from Human Visual-Tactile Demonstrations

Yiwen Liu, Yujun Zhu, Kui Jia +3

Dexterous manipulation Egocentric & human data

2026-08-21

Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models

Zhuoyuan Li, Rui Zhao, Jin Wang +5

Vision-language-action Foundation models & pretraining

2026-08-21

Roadside-Cooperative Autonomous Driving: From Data Platform to Vision-Language End-to-End Reasoning

Yitao Xu, Tong Wu, Yiyan Wu +7

Navigation & mobility Video & generative modeling

2026-08-20

Evidence-Gated Task and Motion Planning with Vision-Language Models

Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar +1

Video & generative modeling

2026-08-20

What Matters for Latent Actions in Robot Learning

Xizhou Bu, Qingda Hu, Lei Zhou +13

Video & generative modeling

2026-08-18

OVIP-SG: Open-Vocabulary Instance-Preserving Scene Graphs for Mapping and Retrieval of Small, Fine-Grained Objects

Tianjing Hao, Haiyu Lan, Angsong Li +6

Simulation, sim-to-real & benchmarks Navigation & mobility

2026-08-18

Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation

Hongyan Feng, Sunlai Chen, Xuanyu Liu +9

Reinforcement learning & control 3D & spatial reasoning

2026-08-17

PDDL-ART: Autonomous Symbolic Abstraction From Demonstration For Long-Horizon Robotic Manipulation Using Vision-Language Models

Disha Kamale, Dmitry Berenson

Video & generative modeling

2026-08-17

PROBE: Manipulation-Grounded Visual Question Answering with VLM Agents

Vineet Bhat, Siyi Chen, Alex Zook +4

Dexterous manipulation Simulation, sim-to-real & benchmarks

2026-08-17

VLCP: Vision Language Control Policy Closed-Loop Code Replanning for Robot Manipulation

Dhia Naouali, Minghan Wu, Claudia Wong +2

Dexterous manipulation Foundation models & pretraining

2026-08-17

Neurosymbolic Embodied Agents

Mohammad Albinhassan, Yuming Feng, Alessandra Russo +1

Egocentric & human data Navigation & mobility

2026-08-17

Arm-Aware Guided Dexterous Grasp Generation with Arm-Agnostic Grasp Models

Yongyi Jia, Yongpeng Jiang, Kangchen Lv +3 · 1 citation

RA-LDexterous manipulation Data collection & teleoperation

2026-08-15

FloodReasonBench: Benchmarking VLM Reasoning Segmentation for Embodied Flood Response at the Edge

Rajat Bhattacharjya, Yoomee Jung, Minwoo Kim +4

Video & generative modeling

2026-08-13

H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models

Dingyi Rong, Yue Shi, Chaofan Ma +6 · 1 citation

World models Egocentric & human data

2026-08-13

RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction

Tianyu Sun, Zhoujie Fu, Zihui Gao +2

Simulation, sim-to-real & benchmarks Hardware & morphology co-design

2026-08-12

Can Vision-Language Models Assess Proxemic Risk from Egocentric Robot Images?

Vladyslava Rudas, Dmytro Kuzmenko

ECCV 2026Egocentric & human data Navigation & mobility

2026-08-12

G0.5: One Autoregressive Stream for Robot Reasoning and Action

Yicheng Liu, Zibin Dong, Baijun Ye +24

Vision-language-action Navigation & mobility

2026-08-12

Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems

Mengjie Tian, Xinrui Zhang, Tianyu Li +6 · 1 citation

Video & generative modeling Safety & evaluation

2026-08-11

Lost in Reconstruction: Aligning Action Representations with Language in Vision-Language-Action Models

Li Wenjie, Yash Jangir, Ignacy Stepka +3

Vision-language-action Video & generative modeling

2026-08-11

Hidden in Plain Sight: Diffusion-Based Unrestricted Robotic Attacks on Vision-Language-Action Models

Jiahui Han, Yuhui Yao, Xin Wang +6

Vision-language-action Video & generative modeling

2026-08-10

Hierarchical Fast-Slow ReAct Agent for Zero-Shot Object-Goal Navigation

Zhaochen Lan, Zhi Yang, Yuxiang Fu +1

Egocentric & human data Navigation & mobility

2026-08-10

Graph-Guided Safe Diffuser: Topological Graph Guidance for Safe Diffusion Planning

Nakgyu Yang, KwangBin Lee, SooJean Han

Humanoids & locomotion Navigation & mobility

354 papers in this corpus carry the video & generative modeling tag. How tagging works.