NVIDIA RTX vWS: Sizing and GPU Selection Guide for Virtualized Workloads

Sizing Guide

• Overview
  
  • What is NVIDIA RTX vWS?
  • Why NVIDIA vGPU?
  • NVIDIA vGPU Architecture
• Recommended NVIDIA GPUs for NVIDIA RTX vWS
  
  • Increased Frame Buffer Requirements with Ada and Ampere Architectures
• Selecting the Right NVIDIA GPU for Virtualization
  
  • NVIDIA GPUs for Virtualization
    
    • NVIDIA L40S
    • NVIDIA L40
    • NVIDIA L4
    • NVIDIA A40
    • NVIDIA A16
    • NVIDIA A10
  • GPU Performance Benchmark Tests
  • Knowledge Worker VDI
    
    • Test Results
  • Professional Graphics
    
    • Test Results
    • Benchmark Server Configuration
• Selecting the Right NVIDIA GPU Virtualization Software
  
  • Summary of Product Features
  • Optimal Workloads
  • Product Details
    
    • NVIDIA Virtual PC
    • NVIDIA RTX Virtual Workstation
  • Impact of GPU Sharing
    
    • Performance Allocation for a Shared GPU
    • Scheduling Options for GPU Sharing
    • Best Effort GPU Scheduler
    • Effect of GPU Sharing on Overall Throughput
• Sizing Methodology
  
  • vGPU Profiles
    
    • Example Equal-Size Mode Configurations for NVIDIA L4
    • Example Mixed-Size Mode Configurations for NVIDIA L40S
  • vCPU Oversubscription
• Tools
  
  • GPU Profiler
  • NVIDIA System Management Interface (nvidia-smi)
  • VMware esxtop
  • VMware Aria Operations
• Performance Metrics
  
  • Virtual Machine Metrics
    
    • Framebuffer Usage
    • vCPU Usage
    • Video Encode/Decode
  • Physical Host Metrics
    
    • CPU Core Utilization
    • GPU Utilization
• Performance Analysis
  
  • Single VM Testing FB Analysis
  • Host Utilization Analysis
• Example VDI Deployment Configurations
• Deployment Best Practices
  
  • Understand Your Environment
  • Run a Proof of Concept
  • Leverage Management and Monitoring Tools
  • Understand Your Users & Applications
  • Use Benchmark Testing
  • Understanding the GPU Scheduler
  • Understanding GPU Channels
    
    • Monitoring GPU Channel Usage During POC
• Conclusion
  
  • Process for Success
  • Virtualize Any Application with an Amazing User Experience
• Additional Resources
  
  • NVIDIA vPC Resources
  • NVIDIA RTX Virtual Workstation Resources
  • Other Resources

Appendix

• NVIDIA Test Environment
• Support and Services