NVIDIA Unveils AI Foundry for Custom Enterprise Generative AI Models

NVIDIA has introduced AI Foundry, a service designed to help enterprises create and deploy custom generative AI models tailored to their specific needs. This service leverages data, accelerated computing, and advanced software tools, according to the NVIDIA Blog.

Industry Pioneers Drive AI Innovation

Leading companies such as Amdocs, Capital One, Getty Images, KT, Hyundai Motor Company, SAP, ServiceNow, and Snowflake are early adopters of NVIDIA AI Foundry. These industry pioneers are setting the stage for a new era of AI-driven innovation in enterprise software, technology, communications, and media.

Jeremy Barnes, Vice President of AI Product at ServiceNow, emphasized the competitive edge that custom models provide. “Organizations deploying AI can gain a competitive edge with custom models that incorporate industry and business knowledge,” Barnes stated. “ServiceNow is using NVIDIA AI Foundry to fine-tune and deploy models that can integrate easily within customers’ existing workflows.”

The Pillars of NVIDIA AI Foundry

NVIDIA AI Foundry is built on several key pillars: foundation models, enterprise software, accelerated computing, expert support, and a broad partner ecosystem. The service includes AI foundation models from NVIDIA and the AI community, as well as the complete NVIDIA NeMo software platform for rapid model development.

The computing backbone of NVIDIA AI Foundry is the NVIDIA DGX Cloud, a network of accelerated compute resources co-engineered with leading public clouds like Amazon Web Services, Google Cloud, and Oracle Cloud Infrastructure. This setup allows AI Foundry customers to develop and fine-tune custom generative AI applications efficiently and scale their AI initiatives without significant upfront investments in hardware.

Additionally, NVIDIA AI Enterprise experts are available to assist customers through each step of building, fine-tuning, and deploying their models with proprietary data, ensuring alignment with business requirements.

Global Ecosystem and Partner Support

NVIDIA AI Foundry customers benefit from a global ecosystem of partners offering comprehensive support. Consulting services from partners like Accenture, Deloitte, Infosys, and Wipro include design, implementation, and management of AI-driven digital transformation projects. For example, Accenture has introduced its own AI Foundry-based offering, the Accenture AI Refinery framework.

Service delivery partners such as Data Monsters, Quantiphi, Slalom, and SoftServe help enterprises navigate the complexities of integrating AI into their existing IT landscapes, ensuring that AI applications are scalable, secure, and aligned with business objectives.

Customers can develop NVIDIA AI Foundry models for production using AIOps and MLOps platforms from partners like Cleanlab, DataDog, Dataiku, Dataloop, DataRobot, Domino Data Lab, Fiddler AI, New Relic, Scale, and Weights & Biases. These models can be deployed as NVIDIA NIM inference microservices, which include the custom model, optimized engines, and a standard API to run on preferred accelerated infrastructure.

Inferencing solutions like NVIDIA TensorRT-LLM enhance efficiency for Llama 3.1 models, minimizing latency and maximizing throughput. This allows enterprises to generate tokens faster while reducing the total cost of running models in production, supported by the NVIDIA AI Enterprise software suite.

Moreover, Together AI announced that it will enable its ecosystem of over 100,000 developers and enterprises to use its NVIDIA GPU-accelerated inference stack to deploy Llama 3.1 endpoints and other open models on DGX Cloud.

“Every enterprise running generative AI applications wants a faster user experience, with greater efficiency and lower cost,” said Vipul Ved Prakash, founder and CEO of Together AI. “Now, developers and enterprises using the Together Inference Engine can maximize performance, scalability, and security on NVIDIA DGX Cloud.”

NVIDIA NeMo Simplifies Custom Model Development

NVIDIA NeMo, integrated into AI Foundry, provides developers with tools to curate data, customize foundation models, and evaluate performance. NeMo technologies include:

• NeMo Curator: A GPU-accelerated data-curation library that enhances generative AI model performance by preparing large-scale, high-quality datasets for pretraining and fine-tuning.
• NeMo Customizer: A scalable microservice that simplifies fine-tuning and alignment of large language models (LLMs) for domain-specific use cases.
• NeMo Evaluator: Automatically assesses generative AI models across academic and custom benchmarks on any accelerated cloud or data center.
• NeMo Guardrails: Manages dialog, supporting accuracy, appropriateness, and security in smart applications with large language models.

With these tools, businesses can create custom AI models that are precisely tailored to their needs, improving alignment with strategic objectives, accuracy in decision-making, and operational efficiency.

Philipp Herzig, Chief AI Officer at SAP, noted, “As a next step of our partnership, SAP plans to use NVIDIA’s NeMo platform to help businesses accelerate AI-driven productivity powered by SAP Business AI.”

Custom Models Drive Competitive Advantage

NVIDIA AI Foundry addresses the unique challenges enterprises face in adopting AI. While generic AI models may fall short of meeting specific business needs and data security requirements, custom AI models offer superior flexibility, adaptability, and performance. This makes them ideal for enterprises seeking a competitive edge.

“Safe, trustworthy AI is a non-negotiable for enterprises harnessing generative AI, with retrieval accuracy directly impacting the relevance and quality of generated responses in RAG systems,” said Baris Gultekin, Head of AI at Snowflake. “Snowflake Cortex AI leverages NeMo Retriever, a component of NVIDIA AI Foundry, to further provide enterprises with easy, efficient, and trusted answers using their custom data.”

For more information on how NVIDIA AI Foundry can boost enterprise productivity and innovation, visit NVIDIA AI Foundry.