Embodied AI 101

Why does a table-tennis robot that succeeds in simulation miss the ball on hardware? This episode explains how PEAOM models the measurement process that turns a physical trajectory into a controller's estimated state. We cover three questions: how calibration-derived distortions enter before trajectory fitting, why systematic camera bias differs from independent Gaussian jitter, and what the reported improvement in physical return success actually measures. The authors report an increase from 56.4% to 86.0% without real-world policy fine-tuning. ([link.springer.com](https://link.springer.com/article/10.1007/s12555-026-00269-2)) The method combines simulated robot-arm striking with a calibrated observation model and a...

Should a vision-language-action robot receive tactile measurements as continuous features or as discrete labels? This episode explains the architectural choices behind that question and the evidence needed to interpret an avocado-sorting comparison. The discussion covers three approaches: semantic directives that guide a manipulation policy, tactile representations integrated into action generation, and numerical physical-property estimates used for interpretation. Verified examples include Octopi's real-robot avocado reasoning and TAP-VLA's tactile annotations for contact-rich manipulation, with Franka Panda robots and GelSight sensing providing concrete experimental context. The central methodological question is whether a comparison isolates representation format or also changes how much information reaches...

Can an encoder-free vision-language-action model make robot foundation models more accessible? This episode explains NEO-VLA's architecture, its strongest experimental findings, and what its public release enables other laboratories to reproduce. We cover three findings: why early backbone layers matter for action prediction, how multimodal co-training supports robustness, and what the released implementation offers practitioners. NEO-VLA combines native vision-language processing with a continuous flow-matching action expert, drawing on a training mixture that includes real robot demonstrations and simulation. Its evaluations span LIBERO, distribution-shift benchmarks, and physical manipulation on the Pika robot. ([arxiv.org](https://arxiv.org/pdf/2611.06918)) The episode follows the...

Can a robot policy learn better three-dimensional control without running a geometric model every time it acts? This episode of *Embodied AI 101* examines how SLA uses spatial supervision during continual pretraining and downstream adaptation. We cover three questions: how OmniVGGT features become training targets for a VLA; why the alignment-on versus alignment-off scaling experiment matters; and what the RoboDojo-Real leaderboard establishes about the resulting system. The discussion spans simulated bimanual manipulation in RoboTwin, perturbation testing in LIBERO-Plus, and physical evaluation across ARX X5, Piper, and Piper X robots. ([arxiv.org](https://arxiv.org/abs/2511.10560)) We connect SLA to its predecessor...

Can a robot learn better 3D manipulation without running an additional perception model at deployment? This episode examines how SLA extends π0.5 through spatially supervised continual pretraining and downstream adaptation. We cover three questions: how a frozen OmniVGGT teacher shapes intermediate visual features; why adaptive layer selection and state dropout belong in the training recipe; and what the moving-target experiment measures. The headline result is a rise from 42% to 76% success on a real-world bimanual Piper fruit-manipulation condition requiring grasping, handover, and placement. We connect that experiment to simulation-based robustness evaluation in RoboTwin and explain why applying alignment at both training stages m...

Can a robot world model use imagined collisions to choose safer actions? This episode examines Noetic's reported safety-aware rollout loop and explains how it relates to latent planning, safe reinforcement learning, and learned safety filters. We cover three questions: what the reported three-or-more-step imagination horizon describes; how an explicit safety program can influence candidate actions; and what experiment would establish a benefit in executed behavior. Technical context comes from PlaNet, Dreamer, SafeDreamer, and Latent Safety Filters, spanning simulated navigation and physical Franka manipulation. The latter provides a measured example of using latent safety reasoning to improve safe task completion and...

Can a vision-language-action model make clothing cleanup a useful autonomous household chore? This episode explains how Pi0.5 fits into a wheeled robot system combining SLAM, visual checking, collision detection, and motion replay. The builder reports 97% success on unfamiliar garments and an average end-to-end time of two minutes per item. We follow three threads: the division of labor inside the demonstration; the heterogeneous co-training behind Physical Intelligence's π0.5; and the evaluation needed to distinguish new garments from genuinely new environments. The underlying paper contributes real-robot household evaluations and controlled comparisons, while related work such as OK-Robot supplies context for modular mobile manipulation. T...

What makes a humanoid foundation model useful when its first attempt goes wrong? This episode examines how Delta-0 connects whole-body control, human-motion pretraining, and corrective learning—and what its experiments establish. We cover three questions: how its latent world-action model connects observations with motion commands; why relative end-effector corrections make human intervention easier; and what to make of the reported dishwasher success increase from 20% to 65% after targeted post-training. ([deltai.com](https://deltai.com/en/blog/delta-0)) The system runs on a Unitree G1 with WUJI hands, combining simulation-trained control with real-world household manipulation. ([robopapers.substack.com](https://robopapers.substack.com/p...

Can a geometry-aware correction layer improve robot manipulation without retraining the VLA policy? This episode explains PARMA's proposed execution layer and the evidence needed to assess its pose-awareness claim. We cover three questions: how gripper-local proxy points connect rotation to collision risk, why joint safe-success metrics matter, and how to distinguish geometric improvements from changes in intervention strength. The discussion places the proposal alongside classical quadratic-program safety filters, AEGIS, and recent route-guided action repair. The experimental domain spans SafeLIBERO Spatial manipulation in simulation and a two-scene SO101 hardware feasibility study. For practitioners, the episode focuses on the interface between a...

Can a robot keep learning manipulation tasks while making better use of skills it already has? This episode explains LiMoDE through the relationship between computational specialization, skill retrieval, and memory. We cover three questions: how motion can guide expert selection, why preserving a router differs from preserving expert weights, and what forward-transfer and retention measurements actually tell a roboticist. The discussion connects simulated LIBERO manipulation with the paper's physical-arm experiments involving tabletop activities such as stirring, sweeping, and stacking. We place the architecture alongside TAIL, Primitive Prompt Learning, adaptive mixtures of low-rank experts, and representation-distillation approaches to lifelong imitation learning...

Can handheld human demonstrations teach precise, long-horizon robot manipulation without collecting new robot trajectories? This episode explains AIRoA-0's learning pipeline, experimental evidence, and public release, separating its operational achievement from the stronger claim of human-only robot learning. We cover three questions: how YUBI's shared gripper interface supports transfer between people and robot arms; how visual gating, stage prediction, memory, and streaming action generation work together; and how to interpret the real-robot task evaluation. The system targets bimanual manipulation, with quantitative evaluation on Franka and transfer demonstrations on TX-G2, OpenArm, and UR platforms. The central limitation is inherited robot pre-training...

Can parallel vision-language decoding make robot plans faster and more useful at the same time? This episode explains what NVIDIA's VFlash changes inside the planning pipeline and how to interpret its manipulation results. We cover three questions: why whole geometric primitives are a useful prediction unit, how annotation-supervised drafting differs from reproducing an autoregressive model, and what the control ablations reveal about explicit trajectory guidance. The discussion connects VFlash to DFlash, LocateAnything, HAMSTER, and parallel action prediction in OpenVLA-OFT. It follows the evidence from trajectory prediction to simulated Franka manipulation in MolmoSpaces, alongside model-inference measurements on Jetson Thor and DGX...

Can a diffusion policy learn both how to move and when to advance to the next manipulation stage? This episode examines SADP and the case for preserving subgoal structure in foundation-model-generated demonstrations. We cover three questions: how language-guided planning becomes executable training data, how action generation and continuation prediction work together, and what the comparison with TARAD reveals about explicit stage conditioning. The discussion connects SADP to VoxPoser's spatial planning, DP3's point-cloud control, and completion-aware approaches such as SeqVLA. We examine RLBench simulations and physical UR5e manipulation, emphasizing the missing independent, closed-loop validation of stage reporting. For roboticists...

Can one navigation VLA serve robots with radically different movement capabilities? This episode explains how VAMOS separates image-space route generation from robot-specific feasibility scoring, and what that division contributes to real-world navigation. We follow three threads: how a common trajectory representation combines heterogeneous robot demonstrations; how simulation-trained affordance models influence route selection; and how the reported navigation results relate to the architecture's individual components. The discussion covers indoor and outdoor experiments, Boston Dynamics Spot, the wheeled UW Hound, and the distinction between navigation-only and language-steerable checkpoints. We also connect the method to SayCan's affordance grounding and HAMSTER's visual-path interface, then...

Can a vision-language model make useful spatial judgments without generating an answer sentence? This episode of *Embodied AI 101* explains how MJev-Spatial turns that question into a concrete model design and experimental comparison. We cover three connected ideas: reusing pretrained attention projections to score candidates, refining numerical and pointing outputs through successive choices, and evaluating accuracy alongside end-to-end inference latency. The discussion follows the Qwen3.5-based model's spatial-perception interface across choices, quantities, and image locations, including its crop-based pointing procedure and publicly released implementation. We also connect the work to Jev-style decision models, MolmoPoint's grounding-token approach, and the placement problems that...

Can a vision-language model improve spatial reasoning by changing the geometry of its hidden representations? This episode explains how Haoming Wang and Wei Gao turn object-level spatial structure into a fine-tuning signal, and what their experiments establish. We cover three findings: how cross-scene feature extraction separates appearance from layout; why Dirichlet-energy regularization encourages physical neighbors to remain neighbors in latent space; and where the reported benchmark gains occur. The overall Qwen improvement on VSI-Bench is 6.3 points, while the 12.1-percentage-point headline applies to easy relative-direction questions. The experiments adapt Qwen2.5-VL-7B and InternVL3-8B using synthetic object scenes, then...

Can action-free human video teach a robot more than visual recognition? This episode explains how NVIDIA and KAIST's ThinkWorld uses Chain-of-Dynamics reasoning and imagined future states to train vision-language-action policies. We cover three questions: how human wrist motion and robot end-effector trajectories become a shared token vocabulary; what real-world manipulation and human-guided skill composition demonstrate; and why the reasoning branch operates during training rather than deployment. The discussion follows the pipeline from supervised motion grounding through latent future prediction and reinforcement learning, with context from LAPA, EgoScale, VLA-JEPA, and MolmoAct2. Physical experiments use a bimanual YAM robot for color matching...

Can tiny camera images make sim-to-real reinforcement learning genuinely faster? This episode explains how Squint combines compact visual inputs with off-policy learning to accelerate robot-policy training. We cover three questions: why rendering first and downsampling later differs from directly rendering tiny images; how replay, distributional critics, and GPU execution fit together; and what the physical-robot evaluations establish. Squint trains separate manipulation policies in ManiSkill3 and deploys them on an SO-101 arm using a wrist camera and proprioception. Its task suite covers reaching, lifting, placing, and stacking cubes or cans. The paper reports 91.3 percent real-world success after 15 minutes of simulation training...

Can a feed-forward 3D reconstruction model discard most of its Gaussians and still preserve scene detail? This episode explains how BudSplat makes primitive allocation part of reconstruction, from visual-token importance estimation through voxel fusion and pruning. We cover three findings: roughly twentyfold fewer Gaussians while matching AnySplat's PSNR in the largest RealEstate10K setting; why removing the detail-estimation branch causes the strongest ablation degradation; and how local quotas distribute a fixed representation budget across image regions. BudSplat builds on an AnySplat-style pipeline with a VGGT geometry backbone, trains on RealEstate10K and DL3DV, and evaluates novel-view synthesis on captured...

Can a robot become more reliable by treating its vision-language-action policy as a tool rather than its entire controller? This episode explains how VoLo combines language-model orchestration, visual monitoring, and physical recovery to improve long-horizon manipulation. We cover three questions: how the agent interrupts and redirects a running policy; what the simulation ablations reveal about orchestration versus additional tools; and whether the hardware results establish an advantage for the complete hybrid architecture. The system combines π0.5 with perception and grasp/place capabilities, evaluated through RoboVoLo and physical Franka experiments. ([github.com](https://github.com/NVlabs/VoLoAgent)) We connect the design to M...

Can a mobile manipulation policy become dependable by learning from the moments when a human takes over? This episode explains how I3L combines whole-body correction with iterative imitation learning, and what its experiments establish. We examine three questions: how JoyLo+ transfers control of the arms, torso, and base; why corrective experience can outperform additional demonstrations; and what updating the policy between collection rounds contributes. The evaluation combines controlled simulation, contact-rich Franka manipulation, and real Galaxea R1 Pro household tasks, using diffusion policies and a pi-zero-point-five vision-language-action model. We place the approach alongside HG-DAgger, RoboCopilot, and SIRIUS to distinguish the...

Vitre Experiment #6 presents a real-time portal into an AI-reimagined hallway, and this episode unpacks the distinct roles of World Labs' Atlas, the Marble 2 beta workflow, and 3D Gaussian Splatting, separating environment generation from the calibration and rendering needed to make a monitor behave like a window. We examine what the published evidence does and does not establish, from the quality and freshness of reconstruction baselines to the difference between tracking frequency and motion-to-photon latency, while asking what practitioners would need to reproduce the experience and whether similar workflows could support mixed reality, teleoperation, or sim-to-real experiments without confusing visual fidelity...

Can a wheel-legged robot choose a safer outdoor route by rehearsing its actions before moving? This episode explains how DEEP Robotics' DR-WM-1.0 connects terrain estimation, physics simulation, and generated observations—and how the accompanying navigation research fits around it. We examine three questions: why spatially varying contact properties matter; what DR-VLA learns from human egocentric video through EgoLynx; and how LynxScenes evaluates perception, navigation, prediction, and reconstruction on shared real-robot recordings. The discussion covers the LYNX M20 outdoor platform, controller-aware physical rehearsal, structured future-scene representations, and the relationship between real-to-sim calibration and sim-to-real transfer. We also unpack the distinction between ev...

Can a robot turn pictures of its workspace into a world it can actually plan inside? This episode explains NeoWorld-3's approach to executable 3D programs and what its experiments reveal about their value for robotics. We cover three questions: why shared geometric parameters help preserve object structure, what the reconstruction and tooling comparisons measure, and how to interpret the real-to-sim-to-real demonstration. The method combines agentic program authoring, numerical refinement, and geometry inspection through NeoMCP and NeoSDK. We examine the reported shape-reconstruction improvement and place the approach alongside Real2Code, VIGA, Articraft, and RialTo. The episode spans simulated asset reconstruction...

Google DeepMind's Genie 4 announcement brings native audio and Gemini-guided scene generation into the conversation about world models for robotics, and this episode separates the appeal of an editable, lifelike environment from the evidence needed to use one as a dependable training or evaluation tool for a real robot operating under physical constraints. We explain how a guiding model steering generation differs from a controller acting inside a simulator, why the Apollo checkers demonstration does not establish sim-to-real transfer, and what separate work from the Gemini Robotics team, Runway, and WMEval contributes to a more useful evaluation standard, without treating those...

Can a differentiable world model make large-scale humanoid motion tracking a single-GPU experiment? This episode explains SuperMimic's training architecture, its comparison with SONIC, and what the experiments establish. We cover three questions: how reference motions and simulator transitions provide different kinds of supervision; why differentiating through predicted trajectories adds value beyond faster rollouts; and what a fair compute comparison should measure. The discussion follows simulation-based whole-body control using MuJoCo Warp and G1-retargeted BONES-SEED motions, alongside the authors' physical Unitree G1 demonstrations. We connect the design to SuperTrack, SuperDyno, and short-horizon actor–critic learning, then examine what the approach offers re...

Can imagined video help a robot plan and execute a multi-step task? This episode explains how RynnUnify connects scene understanding, video prediction, and robot control, and how to interpret the evidence behind that connection. We cover three questions: how memory supports successive visual-planning steps, how BCPO learns when to request generated visual context, and how a world-action model turns predictive representations into action chunks. The discussion spans visual planning, anticipatory reasoning, simulated household manipulation in RoboCasa365, and physical manipulation on Astribot S1. We also place the work alongside Cosmos 3 and RxBrain to distinguish inherited architecture from RynnUnify's approach to temporal...

Can natural language let one robot world model learn from incompatible control logs and ordinary video? This episode explains how LaLa-World unifies transition conditioning while keeping future prediction in visual feature space. ([june-page.github.io](https://june-page.github.io/lala-world/)) We unpack three findings: joint training improves average simulated planning success over JEPA-WMs; image and video co-training improves robustness to reworded actions; and predictive pretraining transfers into an action-generating policy. ([github.com](https://github.com/junha1125/LaLa-World)) The discussion follows the data pipeline from simulation trajectories and DROID's Franka manipulation recordings to captioned video and image-edit pairs, then separates goal-image...

Why do reinforcement-learned swarms coordinate in simulation and struggle after deployment? This episode explains SwarmACB's proposal to learn behavior selection instead of direct wheel control. We examine three questions: how behavioral modules change the learning problem, why attention and counterfactual credit assignment fit collective control, and what the reported physical evaluation establishes. The study evaluates controllers across five collective missions using 20 e-puck robots and 250 hardware runs, with the authors reporting stronger transfer from structured policies than from continuous-action control. We connect that result to AutoMoDe's modular design philosophy and earlier work on structured representations for swarm reinforcement learning. The discussion...

Can the machinery that generates robot actions also teach a better critic? This episode of *Embodied AI 101* explains Generative Value Classifier, or GVC, and separates its value-learning contribution from its proposed connection to pretrained robot policies. We unpack three questions: how return-conditioned action modeling becomes an implicit Q-function, why the Tool Hang comparison is compelling, and what the action-loss ablations reveal about the source of improvement. ([github.com](https://github.com/alexanderswerdlow/gvc)) The discussion follows simulated manipulation with a seven-degree-of-freedom arm, human demonstrations mixed with online replay, and offline learning on OGBench. ([arxiv.org](https://arxiv.org/pdf/2610.22497)) We...

This episode of Embodied AI 101 examines World Labs Atlas through the practical questions behind single-image 3D generation: how a photograph becomes posed views and depth, what camera-controlled synthesis adds to a robotics workflow, and why a convincing flythrough should not be confused with a measured reconstruction or a validated physical simulator. We assess the announcement's evidence alongside current beta documentation, runnable tooling, reconstruction baselines, and practitioner commentary, separating useful access from model reproducibility, interface advantages from fair benchmark comparisons, and the company's broader sim-to-real results from claims established for Atlas itself, while outlining where a robotics team could sensibly begin...

Can ordinary RGB human videos teach a robot to coordinate two dexterous hands? This episode explains how SpatialDex reconstructs spatial context from video and uses it to train bimanual manipulation policies. We cover three findings: why a shared video-level scale matters for aligning hands with their surroundings; how geometry enters both the policy's observations and its prediction targets; and what the matched pretraining experiment reveals beyond the headline baseline comparison. SpatialDex reports a 38.3-percentage-point real-robot improvement over its strongest tested baseline and a 14.2-point simulated improvement from geometry-rich versus motion-only pretraining. ([arxiv.org](https://arxiv.org/abs/2610.29716)) The evaluation includes...

Can a small vision-language model take over robot control from a frontier agent? This episode explains what Show-Harness actually compresses, how its semantic action interface works, and where its strongest results come from. We cover three central questions: why a compact movement vocabulary changes the learning problem, how GUMI turns browser-based demonstrations into policy-training examples, and what the real-robot evaluation establishes. The method combines supervised action imitation with LoRA adaptation of Qwen3.5-2B, using demonstrations from Franka and AgileX robots alongside a separate ManiSkill and RoboLab simulation corpus. ([huggingface.co](https://huggingface.co/showlab/Show-Harness-VLMs)) We examine the manipulation...

Can a robot learn useful manipulation without real-world robot demonstrations? This episode of Embodied AI 101 explains what MolmoBot's simulation-first training achieves, how its data engine works, and what its zero-shot claim covers. We examine three questions: how procedural scenes and expert planners generate training experience; what the real-world comparison with π₀.₅-DROID measures; and how far the evidence supports broader manipulation generalization. MolmoBot combines a Molmo2 vision-language backbone with a flow-matching action head, alongside alternative policy architectures trained through behavior cloning. Its released synthetic dataset covers tabletop and articulated-object tasks on Franka and Rainbow Robotics platforms. The episode separates the strong real...

Can a robot learn manipulation more reliably when training teaches it what should change in the world? This episode explains how VLA-Delta turns physical state transitions into supervision and examines what its experiments establish. We cover three connected questions: how difference text, structured slots, and optical flow shape a shared representation; why rich training targets can support an action-focused deployment path; and what the ablations reveal beyond additional action-only pretraining. The discussion spans LIBERO simulation, bimanual RoboTwin tasks, and real manipulation on an AgileX PiPER dual-arm platform, including the reported average advantage over π0.5. We also connect the design to ZR-0, W...

In this episode of Embodied AI 101, we investigate Axis Robotics' browser-based teleoperation platform and ask what it would take for distributed demonstration collection to improve manipulation policies on real hardware, unpacking the practical choices behind data capture, trajectory cleaning, simulation augmentation and the handoff from a contributor's keyboard to a roboticist's training pipeline. We distinguish the evidence for browser-collected data from the company's later sim-to-real experiments, examine why data selection matters as much as dataset size, assess whether the strongest comparisons are genuinely controlled, and explain the limits of small real-world demonstration budgets without confusing simulation benchmarks, selected successful executions...

Can a robot improve at manipulation by debugging code instead of updating neural-network weights? This episode explains how HexaShell turns robot experience into reusable tools, and what its RoboDojo score actually establishes. We cover three questions: how calibrated RGB observations become metric positions; why the reported 39.7% success rate uses category-balanced scoring; and how holding out layouts differs from holding out tasks. The experiments use a simulated dual-arm ARX X5 with head and wrist cameras, camera calibration, and proprioception. Along the way, we connect the design to Code as Policies and URAI, examine an inspectable geometric helper, and separate tool development...

Niantic Spatial's Places Library is the starting point for this episode of Embodied AI 101, which examines how Gaussian splatting, aligned collision meshes, and existing simulation tools fit together, why visual realism and physical correctness must be assessed separately, and what those differences mean for teams building robot navigation systems for real warehouses and other deployment sites. We unpack the evidence behind reconstruction quality and sim-to-real transfer, examine the reported office-navigation comparisons, and turn the technical details into a practitioner's checklist covering downloadable assets, licensing, reproducibility, simulator integration, mesh defects, lighting variation, and the engineering work required to turn a captured...

This episode of Embodied AI 101 examines Google's Gemini 4 Argon robotics announcement, separating the demonstrated workflows from the broader promise by tracing how a calibrated camera view becomes a numerical motion command, why an ERQA score is not a manipulation success rate, and where a hosted reasoning model might fit alongside an existing robot controller and its safety mechanisms. We examine the reported sim-to-real improvement in a downstream VLA, the difference between a visually convincing digital twin and a model that predicts contact, the evidence practitioners can inspect or rerun, and independent Robocurve measurements that put latency and partial-credit scoring at...

Can a robot foundation model learn a reusable connection between body motion and the scenes that motion creates? This episode examines GreenWAM's architecture, controlled experiments, and open benchmark release to clarify what joint world-and-action learning contributes to manipulation. We cover three questions: how anatomical coordinates organize experience from different robots; why retaining extra prediction objectives improved randomized RoboTwin success; and what the LIBERO-plus result says about robustness to changed observations and task conditions. The discussion connects GreenWAM to Cosmos 3, Unified World Models, and RDT-1B, separating the inherited ideas from Sber's robotics-specific training recipe. The evaluation spans simulated manipulation benchmarks...