Akamai Launches New AI Inference Service and Expands GPU Fleet

Akamai has introduced Akamai Inference, a new cloud-based AI inference service providing managed access to open-weight and custom models through OpenAI-compatible APIs. The service, available in beta, includes 12 open-weight models and offers serverless, pay-per-use, or dedicated deployment options. Akamai also announced Akamai Agent Sandbox for secure AI agent execution and has expanded its dedicated GPU fleet with Nvidia Blackwell Ultra GPU clusters, preparing for Nvidia Vera Rubin platform support next year.

Context

Akamai is a leading content delivery network and cloud service provider. The introduction of Akamai Inference comes amid growing demand for AI solutions across industries. The service's compatibility with OpenAI APIs positions it to attract developers familiar with existing AI frameworks, while the expansion of their GPU fleet indicates a commitment to supporting high-performance computing needs.

Why it matters

Akamai's launch of the AI inference service represents a significant step in making advanced AI capabilities more accessible to businesses. By providing managed access to various models, companies can leverage AI without extensive infrastructure investments. This move could enhance the competitive landscape in cloud services and AI deployment.

Implications

The introduction of Akamai Inference may influence how companies approach AI integration, particularly those lacking in-house expertise. It could lead to increased competition among cloud service providers to offer similar or enhanced AI capabilities. Businesses relying on AI for operations may experience improved efficiency and innovation as they gain easier access to advanced models.

What to watch

In the near term, observers should monitor the uptake of Akamai Inference during its beta phase and subsequent feedback from users. The performance and reliability of the service will be critical as businesses evaluate its potential. Additionally, the rollout of Nvidia Vera Rubin platform support next year will be a key milestone for Akamai's GPU capabilities.