Salesforce debuts gen AI benchmark for CRM

“Cost and performance optimization means you’re not going to use one model for everything,” she says. “Because cost is an issue, there’s a need to route the right work to the right model.”

Enter the new gen AI benchmark. While others exist, they tend to be academic, theoretical, and focused on general purpose gen AI without much in the way of business relevance. The Salesforce benchmark is intended to help businesses understand the pros and cons of various LLMs as part of their AI technology stack, and make informed decisions that align with their business objectives and priorities.

“When it comes to CRM applications, we want to ensure the qualities of these generative processes are aligned with the CRM goals,” says Silvio Savarese, EVP, and chief scientist of Salesforce Research. “The idea is that if a customer has certain needs about use cases, or costs to serve, or latency, they can look at our results, tabular data, and plots and graphs, and they can make an informed decision.”