In another wild turn for AI chips, Meta signs deal for millions of Amazon AI CPUs

Amazon conscionable scored a large coup with Meta thanks, erstwhile again, to Amazon’s ain homegrown chips. Meta has signed a woody to usage millions of AWS Graviton chips to powerfulness its increasing AI needs, Amazon announced Friday.

Note that the AWS Graviton is an ARM-based CPU, (a cardinal processing unit, the spot that handles wide computing tasks) not a GPU (a graphical processing unit).

While GPUs stay the spot of prime for grooming ample models, erstwhile those models are trained, AI agents built connected apical of them are causing a displacement successful the benignant of spot is needed. Agents make compute-intensive workloads similar real-time reasoning, penning code, search, and the the coordination progressive successful managing agents done multi-step tasks. AWS’s latest mentation of Graviton was designed specifically to grip AI-related compute needs, the institution says.

This woody brings much of Meta’s currency backmost to AWS alternatively of competitors similar Google Cloud. Last August, Meta signed a six year, $10 cardinal woody with Google Cloud, though Meta had, until then, chiefly been an AWS lawsuit that besides utilized Microsoft Azure.

We couldn’t assistance but announcement that AWS timed the announcement of this woody close arsenic the Google Cloud Next league wrapped up, similar a virtual smirk astatine its unreality rival. Google, of course, besides makes its ain customized AI chips and announced caller versions of them astatine the show.

True, Amazon makes its ain AI GPU arsenic well: the Trainium, which, contempt its name, is utilized for some grooming and inference — the signifier that happens aft a exemplary is trained, erstwhile it’s actively processing prompts.

But Anthropic had already swooped successful with a woody announced earlier this period that commandeered galore of those chips for years to come. The Claude shaper agreed to walk $100 cardinal implicit 10 years to tally its workloads connected AWS — with a peculiar absorption connected Trainium — portion Amazon agreed to put different $5 cardinal (bringing its full to $13 cardinal of investment) into Anthropic successful return.

Ultimately, the Meta woody is allowing Amazon to showcase a immense AI lawsuit arsenic a proving constituent for its homegrown CPUs. These are chips that vie with Nvidia’s caller Vera CPU, which is besides ARM-based and designed to grip AI agentic workloads. The difference, of course, is that Nvidia sells its chips and AI systems to enterprises and unreality providers (including AWS). AWS lone sells entree to its chips done its unreality service.

Earlier this period Amazon CEO Andy Jassy took purpose astatine Nvidia and Intel successful his yearly shareholder letter, saying that enterprises privation amended price-performance ratios for AI, and that helium intends to triumph deals connected that basis. This besides means the unit couldn’t beryllium higher connected Amazon’s interior spot gathering squad to deliver, a squad that we visited past period successful an exclusive circuit of their lab.