Compute
OpenAI To Join The Custom AI Chip Club?
It would be hard to find something that is growing faster than the Nvidia datacenter business, but there is one contender: OpenAI. …
GPU
Compute
Dell Making The Most Of Its GPU Allocations, Like Everyone Else
In a world where Nvidia is allocating proportional shares of its GPU hotcakes to all of the OEMs and ODMs, companies like Dell, Hewlett Packard, Lenovo, and Supermicro get their shares and then they turn around and try to sell systems using them at the highest possible price. …
Connect
Crafting A DGX-Alike AI Server Out Of AMD GPUs And PCI Switches
Not everybody can afford an Nvidia DGX AI server loaded up with the latest “Hopper” H100 GPU accelerators or even one of its many clones available from the OEMs and ODMs of the world. …
Compute
AMD Feels The Server Recession, Too, But Growth Is Looming Large
With a server recession underway and its latest Epyc CPUs and Instinct GPU accelerators still ramping, this was a predictably soft, but still not terrible in the scheme of things, quarter for AMD. …
AI
Where To Park Your AI Cluster Is As Important As Procuring It
When we think about high performance computing, it is often in the context of liquid-cooled systems deployed in facilities specifically designed to accommodate their power and thermal requirements. …
AI
H100 GPU Instance Pricing On AWS: Grin And Bear It
UPDATED: It is funny what courses were the most fun and most useful when we look back at college. …
Compute
AI Is A Modest – But Important – Slice Of TSMC’s Business
Given the exorbitant demand for compute and networking for running Ai workloads and the dominance of Taiwan Semiconductor Manufacturing Co in making the compute engine chips and providing the complex packaging for them, you would think that the world’s largest foundry would be making money hands over fist in the second quarter. …
AI
Chiplet Cloud Can Bring The Cost Of LLMs Way Down
If Nvidia and AMD are licking their lips thinking about all of the GPUs they can sell to the hyperscalers and cloud builders to support their huge aspirations in generative AI – particularly when it comes to the OpenAI GPT large language model that is the centerpiece of all of the company’s future software and services – they had better think again. …
Compute
The Third Time Charm Of AMD’s Instinct GPU
The great thing about the Cambrian explosion in compute that has been forced by the end of Dennard scaling of clock frequencies and Moore’s Law lowering in the cost of transistors is not only that we are getting an increasing diversity of highly tuned compute engines and broadening SKU stacks across those engines, but also that we are getting many different interpretations of the CPU, GPU, DPU, and FPGA themes. …
Compute
Intel Downplays Hybrid CPU-GPU Engines, Merges NNP Into GPU
When Intel announced its “Falcon Shores” project to build a hybrid CPU-GPU compute engine back in February 2022 that allowed the independent scaling of CPU and GPU capacity within a single socket, it looked like the chip maker was preparing to take on rivals Nvidia and AMD head on with hybrid compute motors, which Intel calls XPUs, AMD calls APUs, and Nvidia doesn’t really have if you want to be strict about what its “superchips” are and what they are not. …