Compute
Rebellions AI Puts Together An HBM And Arm Alliance To Take On Nvidia
The number of AI inference chip startups in the world is gross – literally gross, as in a dozen dozens. …
inference
Compute
What Is Cerebras Going To Do With That $1.1 Billion In New Funding?
What does Cerebras Systems, the first successful waferscale computing commercializer and a contender in the race to provide compute for the world’s burgeoning AI inference workload, do for an encore? …
AI
Google Shows Off Its Inference Scale And Prowess
If the hyperscalers are masters of anything, it is driving scale up and driving costs down so that a new type of information technology can be cheap enough so it can be widely deployed. …
Connect
Skimpy HBM Memory Opens Up The Way For AI Inference Memory Godbox
Generative AI is arguably the most complex application that humankind has ever created, and the math behind it is incredibly complex even if the results are simple enough to understand. …
Compute
With “Ironwood” TPU, Google Pushes The AI Accelerator To The Floor
If you want to be a leading in supplying AI models and AI applications, as well as AI infrastructure to run it, to the world, it is also helpful to have a business that needs a lot of AI that can underwrite the development of homegrown infrastructure that can be sold side-by-side with the standard in the industry. …
Connect
Future Proofing Inference Servers With PCI-Express Switches
At this point in the history of datacenter systems, there can be no higher praise than to be chosen by Nvidia as a component supplier for its AI systems. …
AI
Cerebras Trains Llama Models To Leap Over GPUs
It was only a few months ago when waferscale compute pioneer Cerebras Systems was bragging that a handful of its WSE-3 engines lashed together could run circles around Nvidia GPU instances based on Nvidia’s “Hopper” H100 GPUs when running the open source Llama 3.1 foundation model created by Meta Platforms. …
AI
Cerebras Needs Wall Street Money To Expand Beyond One Core Customer
Waferscale compute engine and AI system maker Cerebras Systems has filed with the US Securities and Exchange Commission to sell a chunk of itself to the public, giving we outsiders a view of the past two and a half years of its internal financials. …
AI
The Battle Begins For AI Inference Compute In The Datacenter
The major cloud builders and their hyperscaler brethren – in many cases, one company acts like both a cloud and a hyperscaler – have made their technology choices when it comes to deploying AI training platforms. …
Compute
The First AI Benchmarks Pitting AMD Against Nvidia
Rated horsepower for a compute engine is an interesting intellectual exercise, but it is where the rubber hits the road that really matters. …