Nvidia intros new guardrail microservices for agentic AI

Nvidia today added new Nvidia inference microservices (NIMs) for AI guardrails to its Nvidia NeMo Guardrails software tools. The new microservices aim to help enterprises improve accuracy, security, and control of agentic AI applications, addressing a key reservation IT leaders have about adopting the technology.

“One-in-ten organizations are already using AI agents today, and more than 80% plan to adopt AI agents within the next three years,” Kari Briski, vice president of enterprise AI models, software, and services at Nvidia, said in a press conference Wednesday. “This means that you don’t just build agents for accuracy of the task, but you must also evaluate AI agents to meet security, data privacy, and governance requirements, and that can be a major barrier to deployment.”

Briski explained that beyond trust, safety, security, and compliance, successfully deploying AI agents in production requires they be performant. They must stay on track while remaining fast and responsive in their interactions with end users and other AI agents. To that end, Nvidia today introduced three new NIMs for NeMo Guardrails aimed at content safety, topic control, and jailbreak detection.