Waypoint-1.5:面向消费级硬件的实时视频世界模型
Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware
原文给出了从数据管线到运行时的完整技术拆解,读者可以据此理解实时交互视频世界模型在消费级硬件上的实现路径。
We present Waypoint 1.5, a real-time diffusion world model for interactive video generation on consumer-grade hardware. Unlike general video diffusion models, interactive world models (iWMs) must respond to dense user controls under strict latency and throughput constraints. Waypoint 1.5 is pre-trained on 100,000 hours of diverse, control-aligned video game data across hundreds of games, and generates playable video conditioned on full keyboard and mouse input. The model includes two resolution variants that run across a wide spectrum of consumer hardware. To characterize this unique setting, we distinguish rendered FPS, latent FPS, and control rate. We describe the data pipeline, architecture, training methodology, and runtime system behind Waypoint 1.5. We evaluate interactivity through latency and throughput. Finally, we discuss the safety and ethics considerations unique to iWMs.
来源:arXiv · AI游戏论文 · arxiv.org