Developers will have access to new NVIDIA NIM microservices for robot simulation in Isaac Lab and Isaac Sim, OSMO robot cloud computing orchestration services, teleoperated data capture workflows and more.
DENVER, July 29, 2024 (GLOBE NEWSWIRE) — SIGGRAPH — To accelerate humanoid development on a global scale, NVIDIA today announced it is offering the world’s leading robotics manufacturers, AI model developers and software makers a set of services, models and computing platforms for developing, training and building the next generation of humanoid robots.
Services offered include new NVIDIA NIM™ microservices and frameworks for robotic simulation and training, NVIDIA OSMO orchestration services for running multi-stage robotics workloads, and AI- and simulation-enabled teleoperation workflows that allow developers to train robots using small amounts of human demonstration data.
“The next wave of AI is robotics, and one of the most exciting developments is humanoid robots,” said Jensen Huang, founder and CEO of NVIDIA. “We’re advancing NVIDIA’s entire robotics stack to ensure humanoid developers and companies around the world have access to the platform, acceleration libraries and AI models that best suit their needs.”
Accelerate Development with NVIDIA NIM and OSMO
The NIM microservices provide pre-built containers with NVIDIA inference software, helping developers reduce deployment time from weeks to minutes. Two new AI microservices enable robotics engineers to enhance their generative physics AI simulation workflows with NVIDIA Isaac Sim™, a reference application for robot simulation built on the NVIDIA Omniverse™ platform.
The MimicGen NIM microservice generates synthetic motion data based on teleoperation data recorded from spatial computing devices such as the Apple Vision Pro, while the Robocasa NIM microservice generates robot tasks and simulation-enabled environments in OpenUSD, a universal framework for development and collaboration in 3D worlds.
Available now, NVIDIA OSMO is a cloud-native, managed service that can orchestrate and scale complex robotics development workflows across distributed computing resources, whether on-premise or in the cloud.
OSMO dramatically simplifies robot training and simulation workflows, reducing deployment and development cycle times from months to less than a week. Users can visualize and manage a wide range of tasks, including generating synthetic data for humanoids, autonomous mobile robots, and industrial manipulators, training models, conducting reinforcement learning, and implementing large-scale software-in-the-loop testing.
Evolving Data Capture Workflows for Humanoid Robot Developers
Training the underlying models of humanoid robots requires vast amounts of data, and one way to obtain human demonstration data is through teleoperation, but this is becoming an increasingly costly and time-consuming process.
Demonstrated at the SIGGRAPH Computer Graphics conference, the NVIDIA AI- and Omniverse-enabled teleoperation reference workflow enables researchers and AI developers to generate large amounts of synthetic motion and perception data from remotely captured, minimal-human demonstrations.
First, developers use Apple Vision Pro to capture a small number of remote control demonstrations, then simulate the recordings with NVIDIA Isaac Sim and generate a synthetic dataset from the recordings using the MimicGen NIM microservice.
Developers train the Project GR00T humanoid foundation model using real and synthetic data, saving time and cost, and then generate experiences to retrain the robot model using Isaac Lab’s Robocasa NIM microservices, a robotics learning framework. Throughout the workflow, NVIDIA OSMO seamlessly allocates computing jobs to different resources, saving developers weeks of administrative tasks.
General-purpose robotics platform company Fourier has seen the benefits of using simulation techniques to synthetically generate training data.
“Developing humanoid robots is extremely complex and requires vast amounts of real-world data painstakingly collected from the real world,” said Alex Gu, CEO of Fourier. “NVIDIA’s new simulation and generative AI developer tools will help launch and accelerate model development workflows.”
NVIDIA Expands Access to Technology for Humanoid Developers
NVIDIA offers three computing platforms to facilitate the development of humanoid robots: the NVIDIA AI supercomputer for training models, NVIDIA Isaac Sim built on Omniverse where robots can learn and hone their skills in simulated worlds, and the NVIDIA Jetson™ Thor humanoid robotics computer to run the models. Developers can access and use all or any part of the platform to meet their specific needs.
Through the new NVIDIA Humanoid Robot Developer Program, developers will have early access to new products and the latest releases of NVIDIA Isaac Sim, NVIDIA Isaac Lab, Jetson Thor and Project GR00T generic humanoid foundation models.
1x, Boston Dynamics, ByteDance Research, Field AI, Figure, Fourier, Galbot, LimX Dynamics, Mentee, Neura Robotics, RobotEra and Skild AI are among the first companies to join the early access program.
“Boston Dynamics and NVIDIA have worked closely for many years to push the boundaries of what’s possible in robotics,” said Aaron Sanders, chief technology officer at Boston Dynamics. “We’re excited to see the results of this work accelerate the entire industry, and the early access program is a great way to gain access to best-in-class technology.”
availability
Developers can join the NVIDIA Humanoid Robot Developer Program today to get access to NVIDIA OSMO, Isaac Lab, and soon to NVIDIA NIM microservices.
Tune in to Huang at SIGGRAPH, the world’s leading computer graphics conference, in Denver through August 1, to learn more about the latest in generative AI and accelerated computing.
About NVIDIA
NVIDIA (NASDAQ: NVDA) is the world leader in accelerated computing.
For further information, please contact:
David Pinto
Corporate Communications
NVIDIA Corporation
contact address
This press release contains statements including, but not limited to, statements regarding the benefits, impact, performance, capabilities and availability of NVIDIA’s products and technologies, including NVIDIA NIM Microservices, NVIDIA OSMO, NVIDIA Isaac Sim, NVIDIA Isaac Lab, MimicGen NIM, Robocasa NIM, NVIDIA Omniverse, Project GR00T humanoid foundation model, NVIDIA Jetson Thor, NVIDIA Humanoid Robot Developer Program, third parties using or adopting NVIDIA’s products, technologies and platforms, and the benefits and impact thereof, collaborations with third parties, and the benefits and impact thereof, robotics being the next wave of AI and one of the most exciting developments, humanoid robots, and NVIDIA evolving the entire NVIDIA robotics stack to enable humanoid developers and businesses worldwide to access and use the platform, acceleration libraries and AI models that best fit their needs. Additionally, statements regarding the timing, attendance, availability and impact of SIGGRAPH are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expected. Important factors that could cause actual results to differ materially include: global economic conditions; reliance on third parties to manufacture, assemble, package and test our products; the effects of technological developments and competition; developments of new products and technologies or enhancements to existing products and technologies; market acceptance of our products or our partners’ products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected degradation of performance of our products or technologies when integrated into a system; and other factors detailed from time to time in NVIDIA’s most recent reports filed with the Securities and Exchange Commission (SEC), including its Annual Report on Form 10-K and Quarterly Reports on Form 10-Q. Copies of reports filed with the SEC are posted on its website and may be obtained free of charge from NVIDIA. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances, except as required by law.
Many of the products and features described in this document are in various stages of availability and will be delivered on a as-is basis. Statements in this document are not intended to be, and should not be construed as, a commitment, promise, or legal obligation, and the development, release, and timing of any features or functionality described in our products may change and remain at NVIDIA’s sole discretion. NVIDIA will not be liable for any failure to deliver or delay in delivery of any products, features, or functionality described in this document.
© 2024 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, NVIDIA Isaac, NVIDIA Isaac Sim, NVIDIA NIM and NVIDIA Omniverse are trademarks and registered trademarks of NVIDIA Corporation in the U.S. and/or other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.
A photo accompanying this announcement is available at https://www.globenewswire.com/NewsRoom/AttachmentNg/d568c1c1-7b32-48de-922b-bfd22bd567fc
