Nvidia unveils preview of DeepSeek-R1 NIM microservice

Nvidia stock has recovered somewhat since then — it rose nearly 9% on Tuesday — with industry watchers noting that while the Chinese LLM adds a healthy dose of competition to the gen AI landscape with its innovations, the market may have overreacted. Still, analysts believe DeepSeek’s entrance heralds the possibility for more affordable gen AI initiatives.

A shot to the system

Sidestepping the frenzy, Nvidia on Thursday said it was making the DeepSeek-R1 NIM available to help developers experiment with its logic inference, reasoning, mathematics, coding, and language capabilities for customizing their own specialized AI agents. The NIM runs on eight H200 GPUs connected via Nvidia NVLink and NVLink Switch.

“Instead of offering direct responses, reasoning models like DeepSeek-R1 perform multiple inference passes over a query, conducting chain-of-thought, consensus, and search methods to generate the best answer,” Erik Pounds, director of product marketing at Nvidia, wrote in a blog post Thursday.



Source link

Leave a Comment