AI in Action
Welcome to AI in Action, the podcast dedicated to cutting through the hype and exploring the real-world business applications of Artificial Intelligence. Hosted by Ben Price, this series brings together experts from TD SYNNEX and NVIDIA to demystify the rapidly evolving AI landscape. From its roots in the 1950s to today's cutting-edge Generative, Predictive, and Visual technologies. Whether you are looking to understand the critical importance of data sovereignty, navigate the shift from cloud to local AI, or leverage the European Center of Excellence to empower your team, AI in Action provides the blueprint partners need to transform complex technology into profitable business outcomes.
AI in Action
Navigating the NVIDIA Software Stack: From vGPU to Enterprise AI
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
In this fourth episode of AI in Action, hosted by TD SYNNEX in conjunction with NVIDIA, we shift our focus from the physical hardware to the powerful software layer that makes modern AI possible. Join host Ben, along with experts Michael Gern and Jake Fielden, as they demystify the NVIDIA enterprise software ecosystem.
The conversation breaks down how organisations can effectively partition and provision their GPU resources—whether for professional CAD designers, office workers, or intensive AI workloads, using technologies like vGPU and Multi-Instance GPU (MIG). Michael also highlights the "best-kept secret" of NVIDIA software licensing and how developers can access the full toolkit for free to start building today.
Key topics covered in this episode include:
- The Transition to NVIDIA Enterprise: Understanding the rebranding of NVIDIA’s curated software suite and the importance of enterprise-grade support for open-source tools.
- Optimized Models & NIMs: How to utilize NVIDIA Inference Microservices (NIMs) to deploy pre-trained, high-quality models for vision and language tasks without starting from scratch.
- The Ecosystem Advantage: How TD SYNNEX's Destination AI program and ISV partners help bridge the skills gap for companies without in-house data scientists.
- Practical Sizing & Testing: Tips for right-sizing your AI environment and how to access TD SYNNEX AI labs or cloud resources to test your models before you buy.
Whether you are a developer looking for the right tools or a business leader trying to understand the ROI of your hardware investment, this episode provides a clear roadmap for the software stack.