Meet ‘Code-as-World’: An Agentic Loop That Rewrites Real Videos Into Executable MuJoCo Physics Programs

Researchers have developed a system called Code-as-World that converts footage of real-world physical events into functional MuJoCo simulation code. By using these generated virtual environments to train AI models in physical reasoning, the framework aims to improve how machines interpret and predict the behavior of objects in three-dimensional space.