Podcast·2024
Jim Fan on Nvidia's Embodied AI Lab and Jensen Huang's Prediction that All Robots will be Autonomous
About this source
Single-subject Training Data interview — Jim Fan on the GEAR Lab dual mandate (physical robots + virtual game agents), data-as-bottleneck, sim-to-real, the foundation agent thesis, Eureka/DrEureka, Voyager.
Frameworks extracted
6 totalSTRongoing
Data Is the Bottleneck, Not the Architecture
Robotics doesn't need a new model — it needs a three-source data engine: internet-scale + simulation + real-robot.
INNongoing
LLM-Authored Reward Functions
Stop hand-engineering reward functions — have an LLM write them in the simulator's API and iterate.
INNongoing
The 10,001st World
Train across 10,000 randomized simulations and reality becomes just the 10,001st — sim-to-real by distribution, not fine-tuning.
STRongoing
Specialized Generalists
Build the generalist first, then distill it down — a specialized generalist beats a native specialist almost every time.
INNongoing
Code as Action
Let the agent write code as its action space — then save what works to a skill library it authors itself.
INNongoing
The Foundation Agent
One model that generalizes across three axes — the skills it can do, the bodies it can control, and the realities it can master.