The biggest benefit that is coming from the separation of the Intel chip design and marketing business from its foundry operations is that Intel’s chip product groups no longer have to shoulder the totality of the immense costs of its manufacturing operations. …
The first thing to note about the rumored “Stargate” system that Microsoft is planning to build to support the computational needs of its large language model partner, OpenAI, is that the people doing the talking – reportedly OpenAI chief executive officer Sam Altman – are talking about a datacenter, not a supercomputer. …
While a lot of people focus on the floating point and integer processing architectures of various kinds of compute engines, we are spending more and more of our time looking at memory hierarchies and interconnect hierarchies. …
If Microsoft has the half of OpenAI that didn’t leave, then Amazon and its Amazon Web Services cloud division needs the half of OpenAI that did leave – meaning Anthropic. …
For more than a year now, we have been talking about how investments in AI servers have put a damper on budgets for servers used to support other corporate applications. …
Last November, we got a sneak peak at a supercomputer called “Ceiba” that would be built jointly by Nvidia and Amazon Web Services, based on its then-new GH200 Grace-Hopper CPU-GPU compute complexes, its NVLink Switch 3 memory fabric for GPUs, and the Elastic Fabric Adapter (EFA2) Ethernet interconnect that is custom designed by AWS to link racks of machines to each other. …
We like datacenter compute engines here at The Next Platform, but as the name implies, what we really like are platforms – how compute, storage, networking, and systems software are brought together to create a platform on which to build applications. …
If you want to take on Nvidia on its home turf of AI processing, then you had better bring more than your A game. …
It is a pity that we can’t make silicon wafers any larger than 300 millimeters in diameter. …
If you handle hundreds of trillions of AI model executions per day, and are going to change that by one or two orders of magnitude as GenAI goes mainstream, you are going to need GPUs. …
All Content Copyright The Next Platform