AI success: Real or hallucination?

Everyone likes to save their own labor, to unload repetitive and boring tasks, and so there’s a lot of interest in this sort of AI application. The problem is that this kind of worker assistance doesn’t seem to monetize. I was told by CIOs who audited the use of generative AI in their companies that generative AI tools to help workers with documents, emails, etc. almost never actually saved money. However, the tools their companies were trying were either free or very cheap, and the CIOs said they might save a bit of time or improve results a bit. One CFO said that most of the AI we hear about is what we could fairly call “AI candy.” Or maybe another AI hallucination?

There are good AI projects that save money, though, and CIOs say that these do typically involve the CIO and go through the traditional CFO assessment. For example, almost every company that has tried AI as a customer support chatbot says that it has improved customer service and lowered costs, and CIOs say that they’ve had no difficulty making a business case for AI in that mission. In applications involving network management, just over 80% of CIOs said their projects met ROI goals, and three-quarters of companies that self-hosted AI models for business analysis said their projects met business goals. Why don’t we hear about these?

The problem, say CIOs, is that in the early days of adoption of any technology, it’s the potential of the technology that gets the most attention. Generative AI is easy to play with, so a lot of people do, and their interest gets a lot of attention. The specific challenges of self-hosting AI are of interest to a small number of users, too small to attract as much attention. In addition, the small number of enterprises actually involved in CIO-driven, self-hosted projects means that it takes longer to expose all the real issues to be faced, to answer the questions that will be the most critical for AI adoption.

Going back to those CIOs, over three-quarters say that they don’t have staff skills needed to launch an AI project and bring it to completion. A few admit to having hired for such a project and then found it couldn’t make the business case, pass a compliance audit, or both. Apparently, all this dabbling with generative AI in personal productivity applications isn’t educating the workforce in a way that supports staffing those real-world, money-saving, projects. One CIO told me that there were 20 training sessions offered on writing generative AI prompts for every one course about hosting business analysis applications in a way that could pass compliance muster.

The biggest problem may not be compliance muster, but financial muster. If AI is consuming hundreds of thousands of GPUs per year, requiring that those running AI data centers canvas frantically in search of the power needed to drive these GPUs and to cool them, somebody is paying to build AI, and paying a lot. Users report that the great majority of the AI tools they use are free. Let me try to grasp this; AI providers are spending big to…give stuff away? That’s an interesting business model, one I personally wish was more broadly accepted. But let’s be realistic. Vendors may be willing to pay today for AI candy, but at some point AI has to earn its place in the wallets of both supplier and user CFOs, not just in their hearts. We have AI projects that have done that, but most CIOs and CFOs aren’t hearing about them, and that’s making it harder to develop the applications that would truly make the AI business case.

So the reality of AI is buried in hype? It sure sounds like AI is more hallucination than reality, but there’s a qualifier. Millions of workers are using AI, and while what they’re currently doing with it isn’t making a real business case, that’s a lot of activity. Is it possible that someone in this mass-market AI group, will uncover something that creates enough real value to pay all those AI bills and earn a profit? Is it possible that just having millions demand AI would eventually compel companies to accept paying for the same applications CIOs and CFOs scoff at today? If that’s what happens, then today AI isn’t a hallucination after all, and it might prove that those CIOs and CFOs, and maybe even me, are the ones hallucinating…but I wouldn’t bet on it.