The Next Platform
  • Home
  • Compute
  • Store
  • Connect
  • Control
  • Code
  • AI
  • HPC
  • Enterprise
  • Hyperscale
  • Cloud
  • Edge
Latest
  • [ December 1, 2023 ] If You Want To Sell AI To Enterprises, You Need To Sell Ethernet Connect
  • [ December 1, 2023 ] Meta Sees Little Risk in RISC-V Custom Accelerators Compute
  • [ November 30, 2023 ] Arrow Hits the Mark for Petabyte-Class Analytics Problems Control
  • [ November 30, 2023 ] Redefining datacenter connectivity with open source networking AI
  • [ November 29, 2023 ] With HPC Humming Along, HPE Awaits Its AI Boom Compute
  • [ November 28, 2023 ] AWS Taps Nvidia NVSwitch For Liquid Cooled, Rackscale GPU Nodes Compute
  • [ November 28, 2023 ] AWS Adopts Arm V2 Cores For Expansive Graviton4 Server CPU Compute
  • [ November 28, 2023 ] HPC Pioneers Pave The Way For A Flood Of Arm Supercomputers HPC
HomeLLM

LLM

Compute

AWS Taps Nvidia NVSwitch For Liquid Cooled, Rackscale GPU Nodes

November 28, 2023 Timothy Prickett Morgan 2

Since the advent of distributed computing, there has been a tension between the tight coherency of memory and its compute within a node – the base level of a unit of compute – and the looser coherency over the network across those nodes. …

Cloud

Amazon Gears Up To Profit Mightily From The Generative AI Boom

October 31, 2023 Timothy Prickett Morgan 0

Because they are in the front of the line for acquiring Nvidia datacenter GPUs, the hyperscalers and cloud builders are going to be the ones who benefit mightily from shortages of matrix math engines that can train AI models and run inference against them. …

Connect

Meta Platforms Is Determined To Make Ethernet Work For AI

September 26, 2023 Timothy Prickett Morgan 3

We said it from the beginning: There is no way that Meta Platforms, the originator of the Open Compute Project, wanted to buy a complete supercomputer system from Nvidia in order to advance its AI research and move newer large language models and recommendation engines into production. …

AI

The Least Crazy And Least Mean GenAI Model Will Win

September 25, 2023 Timothy Prickett Morgan 5

It takes big money as well as big ideas to compete in the generative AI space. …

AI

H100 GPU Instance Pricing On AWS: Grin And Bear It

July 27, 2023 Timothy Prickett Morgan 4

UPDATED: It is funny what courses were the most fun and most useful when we look back at college. …

AI

The $1 Billion And Higher Ante To Play The AI Game

July 5, 2023 Timothy Prickett Morgan 4

If you want to get the attention of server makers and compute engine providers and especially if you are going to be building GPU-laden clusters with shiny new gear to drive AI training and possibly AI inference for large language models and recommendation engines, the first thing you need is $1 billion. …

AI

Nvidia’s Grace-Hopper Hybrid Systems Bring Huge Memory To Bear

May 29, 2023 Timothy Prickett Morgan 9

If you were hoping to get your hands on one of Nvidia’s “Grace” Arm-based CPUs, then you better be prepared to buy a pretty big machine. …

AI

Keeping Large Language Models From Running Off The Rails

April 26, 2023 Jeffrey Burt 0

The heady, exciting days of ChatGPT and other generative AI and large-language models (LLMs) is beginning to give way to the understanding that enterprises will need to get a tight grasp on how these models are being used in their operations or they will risk privacy, security, legal, and other problems down the road. …

AI

Where Financial Models Meet Large Language Models

April 13, 2023 Timothy Prickett Morgan 4

If you are a Global 20,000 company and you want to build a large language model that is specifically tuned to your business, the first thing you need is a corpus of your own textual data on which to train that LLM. …

About

The Next Platform is published by Stackhouse Publishing Inc in partnership with the UK’s top technology publication, The Register.

It offers in-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Read more…

Newsletter

Featuring highlights, analysis, and stories from the week directly from us to your inbox with nothing in between.
Subscribe now

  • RSS
  • Twitter
  • Facebook
  • LinkedIn
  • Email the editor
  • About
  • Contributors
  • Contact
  • Sales
  • Newsletter
  • Books
  • Events
  • Privacy
  • Ts&Cs
  • Cookies
  • Do not sell my personal information

All Content Copyright The Next Platform