# Source: https://developer.nvidia.com/ai-apps-for-rtx-pcs.md

1. [Home](/)

AI Apps for RTX PCs

# AI on NVIDIA RTX PCs

Experiment, develop, and optimize with the latest AI capabilities on over 100M RTX PCs worldwide.

 ![A developer is powering AI apps on her NVIDIA RTX PC laptop](https://developer.download.nvidia.com/images/rtx/rtx_ai_pc.png)

## Benefits

![Decorative](https://developer.download.nvidia.com/icons/m48-monitor-performance.svg)

### Maximum Performance  

Powered by dedicated AI Tensor Cores with up to 3,352 TOPS, NVIDIA GeForce RTX™ GPUs offer the highest throughput and lowest latency available on PCs.

![Decorative](https://developer.download.nvidia.com/icons/m48-neuralnetwork-1.svg)

### Broadest Ecosystem  

NVIDIA’s AI development platform offers the broadest selection of AI developer tools, SDKs, models, and frameworks to build the next generation of AI applications on Windows.

![Decorative](https://developer.download.nvidia.com/icons/m48-people-growth.svg)

### 100M+ Installed Base  

Deploy advanced AI capabilities to the largest install base of powerful, dedicated AI accelerators, with more than 100M RTX AI PCs and workstations worldwide.

![Decorative](https://developer.download.nvidia.com/icons/m48-microservices-2.svg)

### Unified Development Experience  

Develop and deploy anywhere—across data center, cloud, and RTX AI PCs and workstations—with the same software stack from models to SDKs.

![Decorative](https://developer.download.nvidia.com/icons/m48-it-security-2.svg)

### Privacy and Confidentiality  

Running AI locally enables workloads that stay on-device at all times, enabling privacy and confidentiality.

![Decorative](https://developer.download.nvidia.com/icons/m48-laptop.svg)

### Local, Always Available  

Let users run as many inferences as they want without wait time, or without any internet connectivity.

## Develop and Deploy AI Applications for RTX PCs

Discover ways to add AI to your applications for peak performance, and get access to exclusive tools for building AI features.

### Accelerate AI With NVIDIA RTX GPUs  

Discover how to get the most performance out of your application across popular inference backends including TensorRT, Windows ML, and Llama.cpp.

[Learn About AI Acceleration on RTX PCs](/ai-apps-for-rtx-pcs/inference-backends)

### Optimize Applications for Maximum Performance  

Analyze, profile, and optimize your end-to-end application pipeline for maximum performance using NVIDIA tools.

[Learn How to Optimize Your Application](https://developer.nvidia.com/nsight-systems)

### Add AI Features to Your App With SDKs and Models

Jump-start your development with curated and pre-optimized AI SDKs and models for NVIDIA RTX GPUs.

[See AI SDKs and Models](https://developer.nvidia.com/ai-apps-for-rtx-pcs/sdks-models)

### Tailor AI Models to the Needs of Your App  

Customize AI models for application-specific needs, and optimize them for deployment with RTX AI Toolkit.

[Learn About RTX AI Toolkit](/rtx/ai-toolkit)

## Quick Getting Started Guides

Have questions or looking for additional recommendations? We’ve created quick-start guides to help answer common questions.

[See Recommendations  
 for Deploying LLMs on RTX PCs](https://forums.developer.nvidia.com/t/how-to-deploy-llms-on-rtx-pcs/317354)[See Our Software Migration Guide for   
NVIDIA Blackwell RTX GPUs](https://forums.developer.nvidia.com/t/software-migration-guide-for-nvidia-blackwell-rtx-gpus-a-guide-to-cuda-12-8-pytorch-tensorrt-and-llama-cpp/321330)

## Proven Technology

Over 600 AI Apps and Games have integrated RTX AI optimizations and SDKs

[See Full List](https://www.nvidia.com/en-us/geforce/news/nvidia-rtx-games-engines-apps/)

## Developer Tool Integrations

[
 ![Automatic1111 logo](https://developer.download.nvidia.com/images/rtx/logos/automatic1111.svg)
](https://github.com/AUTOMATIC1111/stable-diffusion-webui)

[
 ![ComfyUI logo](https://developer.download.nvidia.com/images/rtx/comfy-ui-logo.svg)
](https://www.comfy.org/)

[
 ![crewai logo](https://developer.download.nvidia.com/images/rtx/crewai-logo.svg)
](https://www.crewai.com/)

[
 ![flowise logo](https://developer.download.nvidia.com/images/rtx/flowise-ai-logo.svg)
](https://flowiseai.com/)

[
 ![HuggingFace logo](https://developer.download.nvidia.com/images/rtx/logos/hugging-face-no-text-logo.svg)
](https://huggingface.co/)

[
 ![JanAI logo](https://developer.download.nvidia.com/images/rtx/jan-ai-logo.svg)
](https://jan.ai/)

[
 ![LangChain logo](https://developer.download.nvidia.com/images/rtx/logos/langchain-logo.svg)
](https://www.langchain.com/)

[
 ![langflow logo](https://developer.download.nvidia.com/images/rtx/langflow-logo.svg)
](https://www.langflow.org/)

[
 ![LlamaIndex logo](https://developer.download.nvidia.com/images/rtx/logos/llamaindex-logo.svg)
](https://www.llamaindex.ai/)

[
 ![OobaBooga logo](https://developer.download.nvidia.com/images/rtx/logos/oobabooga.svg)
](https://github.com/oobabooga/text-generation-webui)

## NVIDIA Powers the World’s AI. And Yours.  

Upgrade to advanced AI with NVIDIA GeForce RTX™ GPUs and accelerate gaming, creating, productivity, and development. Thanks to specialized built-in AI processors, you get world-leading AI technology and performance powering everything you do—plus, your data always stays secure on your Windows PC.

[Learn More](https://www.nvidia.com/en-us/ai-on-rtx/)

 ![A content creator powers her video development using NVIDIA GeForce RTX GPUs with advanced AI](https://developer.download.nvidia.com/images/rtx/gforce-rtx-1920-1080.jpg)

## Build Innovative AI PC Applications Across Use Cases

### AI for Gaming Apps  

NVIDIA-built tools, SDKs, and partner engines work together to produce the next generation of gaming, including AI-powered NPCs, graphics workloads, and ray tracing.

[Learn More](https://developer.nvidia.com/industries/game-development)

 ![AI tools for developing creative apps](https://developer.download.nvidia.com/images/rtx/nvidia-studio-1920-1080.jpg)

### AI for Creative Apps

The suite of NVIDIA Studio tools accelerates Audio, Video, 3D, and Broadcasting applications to empower the artistic process on GPUs.

[Learn More](https://developer.nvidia.com/ai-for-creative-applications/resources)

 ![A programmer uses AI tools to develop productivity apps](https://developer.download.nvidia.com/images/rtx/ai-productivity-apps-1920-1080.jpg)

### AI for Productivity Apps

NVIDIA’s ecosystem of generative AI tools are powering the next generation of productivity and everyday applications from copilots, to chatbots, to search engines and beyond.

## Latest News

## Access Exclusive NVIDIA Resources

The NVIDIA Developer Program gives you free access to the latest AI models for development with NVIDIA NIM™, along with access to training, documentation, how-to guides, expert forums, support from peers and domain experts, and information on the right hardware to tackle the biggest challenges.

[Join the NVIDIA Developer Program](/developer-program)

 ![Explore NVIDIA gen AI training and certification](https://developer.download.nvidia.com/images/products/dli-individuals-850x480.jpg)

### Get Generative AI Training and Certification

Elevate your technical skills in generative AI and LLMs with NVIDIA Training’s comprehensive learning paths, covering fundamental to advanced topics, featuring hands-on training, and delivered by NVIDIA experts. Showcase your skills and advance your career by **getting certified** by NVIDIA.

[Explore Training](https://www.nvidia.com/en-us/learn/learning-path/generative-ai-llm/)

 ![NVIDIA experts discuss a new development project](https://developer.download.nvidia.com/images/products/onnect-with-experts-850x480.jpg)

### Connect With NVIDIA Experts

Have questions as you’re getting started? Explore our NVIDIA Developer Forum for AI to get your questions answered or explore insights from other developers.

[Visit Forums](https://forums.developer.nvidia.com/c/ai-data-science/86)

 ![NVIDIA Inception helps you build custom gen AI with partners](https://developer.download.nvidia.com/images/products/inference-850x480.jpg)

### Build Your Custom Generative AI With NVIDIA Partners

For generative AI startups, **NVIDIA Inception** provides access to the latest developer resources, preferred pricing on NVIDIA software and hardware, and exposure to the venture capital community. The program is free and available to tech startups of all stages.

[Learn More About NVIDIA Inception  
](https://www.nvidia.com/en-us/startups/)

Stay up to date on the latest NVIDIA generative AI news.

[Subscribe](/email-signup)