The world of personal computing is on the cusp of a revolution, and it's all about AI. Gartner, a leading analyst firm, predicts a shift towards hybrid AI models, where the power of artificial intelligence is harnessed both in the cloud and on the desktop. This development is particularly intriguing, especially for corporate PC buyers, as it offers a potential solution to the ever-increasing costs associated with cloud-based AI services.
The Cost Conundrum
One of the most compelling reasons for this shift is the cost of cloud-based AI services, particularly the complex and often imprecise science of tokenomics. Tokenomics refers to the varying definitions and pricing structures of AI service providers, which can make it challenging for businesses to manage their expenses effectively. As Gartner's Research Vice President, Steve Kleynhans, points out, enterprises are becoming increasingly concerned about the economic sustainability of cloud-centric AI strategies. This is where AI PCs come into play.
AI PCs: The New Frontier
AI PCs, equipped with neural processing units capable of impressive performance, offer a potential solution to the token cost problem. By running AI workloads on the desktop, businesses can gain a better understanding of their AI cloud cost dynamics and potentially offset these costs. Kleynhans believes that the potential for savings is clear, and the increasing power of AI PCs, which he predicts will be ten times more powerful by 2031, further strengthens this case.
The Role of Small Language Models
The development of small language models (SLMs) and small reasoning models (SRMs) is a significant factor in this shift. These smaller models, which are more efficient and cost-effective, can run on today's AI PCs, which pack neural processing units capable of at least 50 TOPS performance. This opens up a world of possibilities for businesses, including the creation of always-on personal assistants and agents that can fundamentally change how users interact with their devices.
The Future of AI PCs
Looking ahead, Kleynhans predicts that by 2029, 30 percent of enterprises will be using AI PCs to reduce their cloud AI token costs, and by 2030, 70 percent of the corporate PC installed base will be capable of running some local GenAI workloads. This shift will complement clouds, which will continue to handle the most demanding workloads, but it will also transform the PC from a simple endpoint into a critical component of the broader AI infrastructure.
The Way Forward
For businesses, this shift towards AI PCs presents an exciting opportunity. By embracing this technology, they can gain a better understanding of their AI cloud cost dynamics and potentially offset these costs. However, it's important to note that polished tools for enterprise users are yet to materialize, and the discussion around AI PCs should be part of any new AI deployment for all employees. Starting to experiment with SLMs and SRMs is also a worthwhile activity.
In my opinion, the shift towards hybrid AI models and the increasing power of AI PCs is a fascinating development. It raises a deeper question about the future of personal computing and the role of AI in shaping it. As we move forward, it will be interesting to see how businesses embrace this technology and how it transforms the way we interact with our devices.
