Goalkeeping Robot Dog Tends Its Net Like a Pro
The best professional football goalkeepers in the English Premiere League (we're talking about the sport called soccer in North America) are able to save almost, but not quite, 80 percent of shots taken on goal. This is very good. But it's not nearly as good as the 87.5 percent of shots that a 9-kilogram quadrupedal robot can block: In its tiny goal, and versus tiny children taking tiny shots, Mini Cheetah turns out to be an excellent goalie.
What's the point of this? Well, it's fun! Also, this is a challenging problem, because it involves highly dynamic locomotion with object manipulation-specifically, manipulating a fast-moving ball in any direction except for into the goal. Teaching the robot to move its body dynamically while also making sure that its feet (or face) end up where they need to be in time to block the ball is basically two problems combined into one. The trick here is combining the right locomotion controller with a planner for the end-effector trajectory that can find the best way to get Mini Cheetah in front of the ball for the save-all in the less than a second that it takes for the ball to travel to the goal.
The approach to solving this was to train Mini Cheetah on a set of useful goalkeeping skills: sidestepping for intercepts near the robot and close to the ground, diving to reach the lower corners of the goal, and jumping to cover the top of the goal and the upper corners. The idea (or hope?) is that all of these skills are recoverable and that the robot will end up making a safe landing on its feet afterward. But as with human goalies, that's a secondary concern behind making a successful save. A reference motion for each skill is manually programmed in, and then the system is trained up in simulation before being transferred directly to the robot. Intercepting the ball involves the system choosing which skill will get a piece of the robot to intersect the ball's trajectory in the most stable and energy-efficient way.
The goal that Mini Cheetah is defending is 1.5 meters wide and 0.9 meters high, and the ball (size 3) is kicked from about 4 meters away. The ball is tracked externally. The robot's performance here is pretty impressive for such a little robot, but we should keep it in context:
We show that our system can be used to directly transfer dynamic maneuvers and goalkeeping skills learned in simulation to a real quadrupedal robot, with an 87.5 [percent] successful interception rate of random shots in the real world. We note that human soccer goalkeepers average around a 69 [percent] save rate. Although this is against professional players shooting towards regulation sized goals, we hope this paper takes us one step closer to enabling robotic soccer players to compete with humans in the near future.
If you think about it, the sport of football is basically a bunch of discrete skills that can be chained together around the trajectory of a ball in support of a high-level goal. And the researchers say that the proposed framework can be extended to other scenarios, such as multiskill soccer-ball kicking." This group has already done some early work on shooting, and it'll be fun to see what they come up with next.
And also, watch your back, English Premiere League goalies: Mini Cheetah is coming for you.
Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning, by Xiaoyu Huang, Zhongyu Li, Yanzhen Xiang, Yiming Ni, Yufeng Chi, Yunhao Li, Lizhi Yang, Xue Bin Peng, and Koushil Sreenath from the University of California, Berkeley's Hybrid Robotics Lab, is available on arXiv.