Amazon is in talks to sell its custom-made Trainium AI chips for use in other companies’ data centers, Bloomberg reports, noting this "represents a key expansion of its efforts to cut into Nvidia's dominance", although a less optimistic read is that the company does not have enough demand or capacity to use the chips for its own uses.
Peter DeSantis, Amazon’s AI chief, said the world’s largest cloud computing company has begun discussions but declined to name potential customers. Presumably, it will try to steal market share by offering its product at a much more competitive terms, which suggests more pricing pressure across the AI ecosystem.
“We view AI infrastructure as rapidly evolving,” he said in an interview in Paris. “And we’re constantly looking at ways to get to more customers.”
Introduced in 2020, Amazon’s AI accelerator, Trainium, has won a few marquee buyers, including OpenAI, Anthropic and Uber, which access the hardware via Amazon Web Services. The chip has produced more than $225 billion in revenue commitments, Amazon said in April (for a word of caution about purchase commitments read our discussion on the trillions in off-balance sheet liabilities sloshing inside the AI ecosystem).
That same month, CEO Andy Jassy wrote in his shareholder letter that it’s “quite possible” Amazon would sell racks of its chips to third parties. It was part of a broader attempt to reposition the sprawling company around AI, an area where it’s seen as falling behind rivals.
Amazon and other cloud computing titans have each been developing their own alternatives to Nvidia’s popular graphics processing units — and ramped up these efforts after ChatGPT’s arrival.
While the AI boom has generated soaring cloud sales, it’s also fueled a new crop of specialized AI cloud providers and driven demand for “sovereign” services in Europe and other regions that are subject to local laws and usually locate information and data processing in the host country.
In April, Alphabet CEO Sundar Pichai said Google will begin to deliver its Nvidia GPU rival chips, called tensor processing units, to a “select group of customers” for use in their own data centers. Amazon is following suit with Trainium, in part, due to the growing demand outside of the US for computing resources that are controlled locally, according to DeSantis. Alternatively, there is just not enough demand in the US, no matter what the daily bullish propaganda says (because as a reminder, due to the $2 trillion in interlinked off-balance sheet liabilities, the moment one counterparty trips, it will drag down everyone else with it).
Meanwhile, some of that foreign push, particularly in Europe, has prompted calls for countries to lessen their reliance on US technology or drop it altogether. Speaking at the VivaTech conference in France, DeSantis said the AWS business has not been impacted at all by this trend. Yet.
The third version of the Trainium chip, which began shipping earlier this year, is “largely sold out,” he said. Amazon said there’s already strong interest in a fourth version that’s expected to debut next year.
DeSantis dismissed the idea that selling Trainium outside of AWS would eat into the company’s cloud business. “There’s so much underconsumption in AI,” he said. “I’m not worried about it.” But with token prices tumbling, and compute rental costs in free fall, both of which signal a sudden drop in demand (or excess supply) for compute...
... he should be.
The executive also cited growth for Amazon’s Graviton chips, a general-purpose processor that it recently began providing to Meta. Over the last three years, DeSantis said Amazon has added more Graviton chips to its computing systems than any other type of chip.
Amazon shares gained as much as 2.5% on Thursday, reaching an intraday high of $243 on the news.