Today NVIDIA has launched its brand new enterprise solution: NVIDIA Enterprise AI
NVIDIA AI Enterprise software suite is an end-to-end cloud-native suite of AI tools and frameworks, optimized and exclusively certified by NVIDIA to run on VMware vSphere. This includes frameworks that are broadly applicable and used across vertical industries such as manufacturing, logistics, financial services, retail, and healthcare. For example, it includes:
- TensorFlow and PyTorch for machine learning
- NVIDIA Tensor RT, for GPU optimized deep learning inference and NVIDIA Triton Inference Server to deploy trained AI models at scale
- RAPIDS, for end-to-end data science and analytics pipelines
This unique combination of the NVIDIA AI Enterprise software suite with VMware vSphere is the next step in delivering a powerful AI-Ready Enterprise Platform.
Scale without compromise: With NVIDIA Virtual GPUs (vGPUs) enabling both time-sliced sharing as well as new multi-instance GPU (MIG) hardware-level spatial partitioning, customers have multiple options in how they can share valuable GPU resources across more data scientists and increase GPU utilization as they scale AI workloads in the enterprise.
vSphere DRS automatically places workloads across AI infrastructure at scale for optimal consumption, and vSphere vMotion provides live migration to simplify infrastructure maintenance such as consolidation, expansion, or upgrades.
NVIDIA datacenter and edge portfolio, a GPU for every possible workload.
Nvidia Networking portfolio for Enterprise AI
Multi Instance GPU (MIG) is especially useful for AI Inference. Fully isolated and secure instances at the hardware level with dedicated high-bandwidth memory, cache, and compute cores.
AI workloads come in all sizes with a wide variety of data requirements. Some process images, like live traffic reporting systems or online shopping recommender systems. Others are text-based, like a customer service support system powered by conversational AI. Everything is possible with this very cool new solution from NVIDIA and VMware. I really love it