Robotic learning has quickly become of automation’s most vibrant categories — and understandably so. Programming a robot has traditionally required a lot of technical know-how, but what if there was a simpler way for non-programmers/roboticists to teach these systems to do what we want?
Imitation and reinforcement learning are two of the most popular methods at the moment. The first involves taking control of the robot to teach it to perform a task, while the second entails training a system on millions of images.
A number of researchers are exploring an even more intuitive method that effectively trains a system by watching a human complete a task. A team at Carnegie Mellon University is demonstrating the in-the-Wild Human Imitating Robot Learning, or WHIRL, an algorithm that can train a system by watching a video.
In their demos, an off-the-shelf mobile robotic arm learns to complete 20+ household chores, including opening and closing drawers and appliances and taking out the trash.
“Imitation is a great way to learn,” Robotics Institute PhD student Shikhar Bahl said in a release. “Having robots actually learn from directly watching humans remains an unsolved problem in the field, but this work takes a significant step in enabling that ability.”
Join 10k+ tech and VC leaders for growth and connections at Disrupt 2025
Netflix, Box, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, Vinod Khosla — just some of the 250+ heavy hitters leading 200+ sessions designed to deliver the insights that fuel startup growth and sharpen your edge. Don’t miss the 20th anniversary of TechCrunch, and a chance to learn from the top voices in tech. Grab your ticket before doors open to save up to $444.
Join 10k+ tech and VC leaders for growth and connections at Disrupt 2025
Netflix, Box, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, Vinod Khosla — just some of the 250+ heavy hitters leading 200+ sessions designed to deliver the insights that fuel startup growth and sharpen your edge. Don’t miss a chance to learn from the top voices in tech. Grab your ticket before doors open to save up to $444.
It’s easy to see how a feature like this might prove particularly handy in a home setting, where roboticists anticipate these systems will one day be deployed to help elderly homeowners and other people with impaired movements.
In the case of WHIRL, no special adds-ons are required. The robot simply attempts to execute a certain task until it’s successful, even if it takes several times to fully master it. As CMU notes, its own approach may not be identical to the humans — instead, the system is looking to find the best method to complete the task based on its own hardware limitations.
Right now the system is trained by watching videos, and the team is looking to expand things out to include clips from services like YouTube.
