# Source: https://developer.nvidia.com/industries/manufacturing/developer-resources-robotics-and-edge-ai-applications.md

# Developer Resources for Robotics and Edge AI Applications

**A hub of news, SDKs, technical resources, and more.**

## App Frameworks and SDKs

#### Robotics and Automation

[NVIDIA Isaac™ Sim](/isaac-sim) built on [NVIDIA Omniverse™](/nvidia-omniverse-platform) provides access to NVIDIA PhysX and RTX ray-tracing technologies for photo-realistic robotic simulations for training and testing in virtual industrial environments. It includes enhanced synthetic data generation capabilities and supports ROS/ROS2 applications.

[Get Started with  
 ISAAC SIM](/isaac-sim)

[NVIDIA Isaac SDK™](/isaac-sdk) enables you to build and deploy commercial-grade, AI-powered robots. The toolkit includes building blocks and tools that accelerate robot developments that require the increased perception, navigation, and manipulation features enabled by AI.

[Explore ISAAC SDK](/isaac-sdk)

#### Edge AI and IoT

NVIDIA JetPack™ SDK is a comprehensive solution for building Edge AI applications. All NVIDIA® Jetson™ hardware modules and developer kits are supported by JetPack SDK. Jetson is a complete System on Module (SOM), and comes with various power, performance, and form factors to help you build autonomous and intelligent machines according to your needs.

[Get Started with   
 JETPACK ](/embedded/jetpack)

[NVIDIA Fleet Command](https://www.nvidia.com/en-us/data-center/products/fleet-command/) is a hybrid-cloud platform for centralized management at scale at the edge. From one control plane, anyone with a browser and internet connection can deploy applications, update software over the air, and monitor location health.

[Learn About   
 Fleet Command ](https://www.nvidia.com/en-us/data-center/products/fleet-command/)

#### AI-Powered Computer Vision

Pre-trained models for computer vision and the [TAO Toolkit](deepstream-sdk) TAO Toolkit enable quick development and adaptation of highly accurate AI models for robotics and autonomous machine use cases.

[Access Pre-Trained Models](/transfer-learning-toolkit)

[NVIDIA DeepStream](/deepstream-sdk) lets you build and deploy AI-powered intelligent video analytics apps and services across a broad range of automation applications.

  
[Learn About the   
 DEEPSTREAM SDK ](/deepstream-sdk)

#### TensorRT

NVIDIA® TensorRT™ is an open-source platform for high-performance deep learning inference, which includes an inference optimizer and runtime that delivers low latency and high throughput for your healthcare applications.

[Learn About TensorRT](/tensorrt)

#### High-Performance Computing
  

The[NVIDIA HPC Software Development Kit](https://developer.nvidia.com/hpc-sdk) NVIDIA HPC Software Development Kit (SDK) includes the proven compilers, libraries, and software tools essential to maximizing developer productivity and the performance and portability of HPC applications.

[Learn About The HPC SDK](/hpc-sdk)

#### NVIDIA® Triton Inference Server

Simplifies the deployment of AI models at scale in production. It is an open source inference serving software that lets teams deploy trained AI models from any framework on any GPU- or CPU-based infrastructure (cloud, data center, or edge).

[Learn More](/nvidia-triton-inference-server)

#### Real-Time Collaboration
  

[NVIDIA Omniverse™](/nvidia-omniverse-platform) powers real-time collaboration in a single, interactive, simulated environment and instant photorealistic output to ultra-high-fidelity, ray-traced, and path-traced rendering with one click.

[Get Started with OMNIVERSE](/nvidia-omniverse-platform)

#### Conversational AI, Pose and Gaze Estimation

NVIDIA Riva is an SDK for building and deploying AI applications that fuse vision, speech, and other sensors. It offers a complete workflow to build, train, and deploy GPU-accelerated AI systems that can use visual cues, such as gestures and gaze, with speech in context.   
 Pre-trained models and scripts used in Riva are freely available in the[NVIDIA® NGC™ catalog.](https://ngc.nvidia.com/catalog)

[Apply For Eearly Access](/riva)

* * *
  

## On Demand Talks

#### Sim-to-Real in Isaac Sim
  

Train and test robots in virtual environments with Isaac Sim on Omniverse, then transfer to a physical Jetson-powered robot. This webinar, presented at GTC 2021, will review the latest features offered in Isaac Sim.

[Watch Now](https://www.nvidia.com/en-us/on-demand/session/gtcspring21-s31824/?playlistId=playList-7415cf83-1f9c-4297-a90d-c821c4d2d478)

#### Building Robotics Applications Using NVIDIA Isaac SDK

This session covers the NVIDIA Isaac SDK robotics platform and its benefits for developers, including the engine, perception GEMS (packages with high-performance robotics algorithms), and workflows and what’s coming in the next release.

[Watch Now](https://www.nvidia.com/en-us/on-demand/session/gtcfall20-a21856/)

#### Create Gesture-Based Interactions with a Robot

Learn how to train your own gesture recognition deep learning pipeline. We’ll start with a pre-trained detection model, repurpose it for hand detection, and use it together with the purpose-built gesture recognition model.

[Watch Now](https://developer.nvidia.com/gtc/2020/video/s21690-vid)

#### Accelerating Vision AI Applications Using NVIDIA TAO Toolkit and Pre-trained Models

Learn how to make the process of creating vision AI models quicker and easier with NVIDIA TAO Toolkit and pre-trained models.

[Watch Now](https://www.nvidia.com/en-us/on-demand/session/gtcfall20-a21333/)

#### How to Train Your Robot: A Simulation-First Approach
  

This session covers BMW Group’s research and development in one of their most recent applications: the Smart Transport Robot (STR), focusing on the simulation environment and how it’s involved in the development process of the STR.

[Watch Now](https://www.nvidia.com/en-us/on-demand/session/gtcfall20-a21825/)

#### Optimizing for Edge AI on NVIDIA Jetson
  

Deepdive session on workflows optimizing deep learning models for inference at the edge with NVIDIA Jetson.

[Watch Now](https://www.nvidia.com/en-us/on-demand/session/gtcfall20-a22252/)

[View all GTC talks](https://www.nvidia.com/en-us/on-demand/playlist/playList-bf5494bd-c99d-449d-8a4d-9699c47c3c59/)
* * *

## NVIDIA Deep Learning Institute

 ![Nvidia DLI](https://d29g4g2dyqv443.cloudfront.net/sites/default/files/akamai/nvidia-dli.jpg)

[The NVIDIA Deep Learning Institute (DLI)](https://www.nvidia.com/en-us/deep-learning-ai/education/) offers hands-on training in AI and accelerated computing to solve real-world problems. Training is available as self-paced, online courses or in-person, instructor-led workshops.

* * *
  

#### Applications of AI for Predictive Maintenance

Learn how to identify anomalies and failures in time-series data, estimate the remaining useful life of the corresponding parts, and use this information to map anomalies to failure conditions, minimizing unplanned downtime.

[Learn More](https://www.nvidia.com/content/dam/en-zz/Solutions/deep-learning/deep-learning-education/DLI-Workshop-Applications-of-AI-for-Predictive-Maintenance-2.pdf)

#### Getting Started with DeepStream for Video Analytics on Jetson Nano

In this course, you’ll learn to extract meaningful insights from video streams through deep learning video analytics using JupyterLab notebooks on an NVIDIA Jetson Nano™.

[Learn More](https://courses.nvidia.com/courses/course-v1:DLI+C-IV-02+V1/about)

#### Deep Learning for Industrial Inspection

Explore how convolutional and recurrent neural networks can be combined to generate effective descriptions of content within images and video clips by combining computer vision and natural language processing. Solve deep learning problems that require multiple types of data inputs.

[Learn More](https://www.nvidia.com/content/dam/en-zz/Solutions/deep-learning/deep-learning-education/Deep-Learning-for-Industrial-Inspection.pdf)

#### Deep Learning for Robotics

Follow along to create robotics solutions on NVIDIA Jetson™ for embedded applications and train a robot to actuate the correct output based on the visual input.

[Learn More](https://www.nvidia.com/content/dam/en-zz/Solutions/deep-learning/deep-learning-education/Deep-Learning-for-Robotics.pdf)

* * *
  

## NVIDIA Robotics News

 ![](https://d29g4g2dyqv443.cloudfront.net/sites/default/files/akamai/nvidia-robotics-applications.jpg)
#### Implementing Robotics Applications with ROS 2 and AI on the NVIDIA Jetson Platform

Deep learning is being adopted in robotics to accurately navigate indoor environments, detect and follow objects of interest, and maneuver without collisions.

[**Read Blog**](https://developer.nvidia.com/blog/implementing-robotics-applications-with-ros-2-and-ai-on-jetson-platform-2/)

 ![](https://d29g4g2dyqv443.cloudfront.net/sites/default/files/akamai/isaac-sim-social-synth-data-glass-physics-scaled-down.png)
#### What Is Synthetic Data?

Synthetic data generated from computer simulations or algorithms provides an inexpensive alternative to real-world data that’s increasingly used to create accurate AI models.

[**Read Blog**](https://blogs.nvidia.com/blog/2021/06/08/what-is-synthetic-data/)

* * *
  

#### Automatic Defect Inspection Using the NVIDIA End-to-End Deep Learning Platform
  

Learn about the problems with traditional quality inspection and how deep learning can address and solve these industrial inspection tasks.

[Read Blog](/blog/automatic-defect-inspection-using-the-nvidia-end-to-end-deep-learning-platform/)

#### Rapid Prototyping on NVIDIA Jetson Platforms with MATLAB
  

Create a prototype and deploy deep learning algorithms on hardware like the [NVIDIA Jetson Nano™ Developer Kit](https://developer.nvidia.com/embedded/jetson-nano-developer-kit) with MATLAB.

[Read Blog](/blog/rapid-prototyping-on-nvidia-jetson-platforms-with-matlab/)

#### Building a Multi-Camera Media Server for AI Processing on the NVIDIA Jetson Platform
  

Build a simple, real-time multi-camera media server for AI processing on the NVIDIA Jetson™ platform. By using [GStreamer Daemon (GstD), GstInterpipe](https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Daemon) GStreamer Daemon (GstD), GstInterpipe, and the [NVIDIA DeepStream SDK](/deepstream-sdk), you can develop a scalable and robust prototype that captures video from several different sources.

[Read Blog](/building-multi-camera-media-server-ai-processing-jetson/)

#### Introducing Jetson Xavier NX, the World’s Smallest AI Supercomputer for Autonomous Systems

Explore how [NVIDIA Jetson Xavier™ NX](/embedded/jetson-xavier-nx) allows you to deploy next-generation autonomous systems and intelligent edge devices that require high-performance AI and complex deep neural networks (DNNs) in a small, low-power footprint—mobile robots, drones, smart cameras, portable medical equipment, embedded Internet of Things (IoT) systems, and more.

[Read Blog](/blog/jetson-xavier-nx-the-worlds-smallest-ai-supercomputer/)

Sign up for the latest developer news from NVIDIA

[Subscribe](https://www.nvidia.com/en-us/preferences/email-signup/)