Compute
The First AI Benchmarks Pitting AMD Against Nvidia
Rated horsepower for a compute engine is an interesting intellectual exercise, but it is where the rubber hits the road that really matters. …
H100
AI
Huawei’s HiSilicon Can Compete With Nvidia GPUs In China
Each time that the United States has figured out that it needed to do export controls on massively parallel compute engines to try to discourage China from buying such gear and building supercomputers with them, it has already been too late to have much of a long term effect on China’s ability to run the advanced HPC simulations and AI training workloads that we were worried would be enabled by such computing oomph. …
AI
Stacking Up AMD Versus Nvidia For Llama 3.1 GPU Inference
Training AI models is expensive, and the world can tolerate that to a certain extent so long as the cost inference for these increasingly complex transformer models can be driven down. …
AI
Stacking Up Intel Gaudi Against Nvidia GPUs For AI
Updated: Here is something we don’t see much anymore when it comes to AI systems: list prices for the accelerators and the base motherboards that glue a bunch of them together into a shared compute complex. …
Compute
AMD Previews “Turin” Epyc CPUs, Expands Instinct GPU Roadmap
Computex, the annual conference in Taiwan to showcase the island nation’s vast technology business, has been transformed into what amounts to a half-time show for the datacenter IT year. …
AI
Nvidia’s Enormous Financial Success Becomes . . . Normal
For the past five years, since Nvidia acquired InfiniBand and Ethernet switch and network interface card supplier Mellanox, people have been wondering what the split is between compute and networking in the Nvidia datacenter business that has exploded in growth and now represents most of revenue for each quarter. …
AI
With Gaudi 3, Intel Can Sell AI Accelerators To The PyTorch Masses
We have said it before, and we will say it again right here: If you can make a matrix math engine that runs the PyTorch framework and the Llama large language model, both of which are open source and both of which come out of Meta Platforms and both of which will be widely adopted by enterprises, then you can sell that matrix math engine. …
HPC
OSC Blends Intel HBM CPUs And Nvidia HBM GPUs For “Cardinal” Supercomputer
For a lot of state universities in the United States, and their equivalent political organizations of regions or provinces in other nations across the globe, it is a lot easier to find extremely interested undergraduate and graduate students who want to contribute to the font of knowledge in high performance computing than it is to find the budget to build a top-notch supercomputer of reasonable scale. …
AI
Half Eos’d: Even Nvidia Can’t Get Enough H100s For Its Supercomputer
Note: There is a story called A Tale Of Two Nvidia Eos Supercomputers that augments and corrects information that originally appeared in this story as it was published on February 15. …
AI
Groq Says It Can Deploy 1 Million AI Inference Chips In Two Years
If you are looking for an alternative to Nvidia GPUs for AI inference – and who isn’t these days with generative AI being the hottest thing since a volcanic eruption – then you might want to give Groq a call. …