Video Friday: ChatGPT for Robotics
by Evan Ackerman from IEEE Spectrum on (#69E0M)
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Enjoy today's videos!
Have you ever wanted to tell a robot what to do using just words? Our team at Microsoft is introducing a new paradigm for robotics based on language, powered by ChatGPT. Our recent paper ChatGPT for Robotics" describes a series of design principles that can be used to guide ChatGPT toward solving robotics tasks. In this video, we present a summary of our ideas, and experimental results from some of the many scenarios that ChatGPT enables in the domain of robotics, such as manipulation, aerial navigation, even full perception-action loops. Our goal is to empower even nontechnical users to harness the full potential of robotics using ChatGPT.
[ Microsoft ]
In which we see the moderate amount of progress that Tesla has made with its humanoid robot (including a questionably cut-together video of some manipulation), followed by Musk saying some stuff.
[ Tesla ]
It is very important to find out the dangerous situation at the rescue site in advance, so the emergency rescue robot came into being.
[ Unitree ]
The hairy caterpillar is a bug that poses a serious threat to everyday life in the Maldives, where it is devastating the local Indian almond trees, a critical species at the heart of the islands' ecosystem. DJI Agriculture's T30 spraying drones have been deployed in a series of groundbreaking entomological projects, and have been shown to be effective at protecting against hairy caterpillars, with minimal use of pesticide.
[ DJI ]
Never get tired of watching this.
[ JPL ]
Teleoperation creates a unique opportunity for experts to embody general-purpose robots and offer their services on a global scale.
[ Sanctuary ]
The qualification video for RoboCup 2023 in Bordeaux, France, of the Middle Size League team, Tech United Eindhoven.
[ Tech United ]
New year, new look for our test fleet! We're rolling out a new design of our test vehicles.
[ Zoox ]
TRI is using AI technology to augment and enhance human capabilities to advance its mission towards achieving carbon neutrality, driving future product innovations, and creating harmonious communities for Toyota's goal of happiness for all."
[ TRI ]
Pranali Desai and Jamie Barnes, software engineers at Torc Robotics, talk about their experiences navigating a male-dominated workplace.
[ Torc Robotics ]
Athena 3D is a leading additive-manufacturing-service bureau located in Tempe, AZ, that prints parts on demand. Printers run according to programmed specifications, and as jobs are completed (often at 3:00 am), the cobot removes the print bed, sets it on a storage rack, and places a clean print bed back into the printer. The application programming interface (API) then communicates to the printer to start the next job.
[ Fanuc ]
Robotic leg prostheses: the future of assistive technology or a step too far? Powered leg prostheses could make walking, climbing stairs, and navigating obstacles easier for users. But despite their promise, robotic legs have remained elusive. Have you got a winning design? Register now to take part in our CYBATHLON Challenges, which will take place in March 2023.
[ Cybathlon ]
A robotic work cell that can pack novel and irregular 3D objects densely, using vision and tactile sensing to adjust for errors encountered during packing. Ninety-nine out of 100 five-item packing attempts were successful in these trials.
[ IML ]
The work on the ANT guidance, navigation, and control system for a future planetary exploration walking system has finished. The final tests proved the system's capabilities on unconsolidated, unstructured, and inclined terrains. The visual foothold adaptation relies on a highly frequent and drift-free pose estimation and on an up-to-date map. Therefore, contact information is added to the map to incorporate changed surface structures. In addition, a load-bearing assessment can be performed to evaluate the stability of the next foothold before relying on it. This way, a stable recovery from collapsed rock formations is possible, which can increase the safety of future legged exploration missions.
[ DFKI ]
Hod Lipson is the James and Sally Scapa Professor of Innovation in the department of mechanical engineering at Columbia University. He is a roboticist who works in the areas of artificial intelligence and digital manufacturing. He and his students design and build robots that do what you'd least expect them to do: self-replicate, self-reflect, ask questions, and even be creative.
[ Columbia ]
Auro from Ridecell introduces the Empty Vehicle Automation feature for car sharing, in which an empty vehicle (with no passenger inside it) repositions itself autonomously at an easily accessible location for the next rider.
[ Auro ]
Founded in 2014, Verity delivers fully autonomous indoor dronesystemsthat are trusted in environments where failure is not an option. Based in Zurich, Switzerland, with global operations, Verity's system is used to complete thousands of fully autonomous inventory checks every day in warehouses everywhere.
We are happy to have been a part of Amazon Web Services (AWS) Swiss Cloud Day! Verity CEO Raffaello D'Andrea shared the stage with other featured speakers.
[ Verity ]
The ALMI project, funded by the Assuring Autonomy International Programme at the University of York and PAL Robotics, focuses on the development of adaptation methods that enable the assistive-care TIAGo robot to cope with the uncertainty and disruptions unavoidable in a home environment. In this solution, the TIAGo robot has used both its speech interaction and its object-manipulation capabilities to help a user with mild motor and cognitive impairments in the daily activity of preparing a meal, including reacting in emergency situations. To achieve this, we created an identical representation of the kitchen environment that the TIAGo robot operates in by using the Gazebo simulator.
[ PAL Robotics ]
This spring 2022 GRASP Industry Talk, from Mujin, is called We're All About Robotics."
Mujin started in 2011 in Tokyo, with founding members from the USA, Japan, and China. Since our humble beginnings from a bike garage (40 square meters), we've grown to become Tokyo's largest robotics lab (14,000 m2) through innovation and a focus on quality. Mujin helped China's e-commerce giant JD.com build the world's first fully automated logistics warehouse in 2017, and is now partnering with firms like Uniqlo, Accenture, and others to automate logistics and manufacturing around the world.
[ Mujin ]