Micron Is Fashionably Late To The HBM Party, But Not Too Late
Here is what memory bandwidth and a certain amount of capacity is worth in the GenAI revolution. …
Here is what memory bandwidth and a certain amount of capacity is worth in the GenAI revolution. …
There are lots of ways that we might build out the memory capacity and memory bandwidth of compute engines to drive AI and HPC workloads better than we have been able to do thus far. …
Intel recently demonstrated a new type of DIMM memory technology called Multiplexer Combined Rank (MCR), also referred to as MRDIMMs, that provides up to 2.3X better performance for HPC workloads and up to a 2X better on AI inference workloads in comparison to 5th Gen Intel Xeon processors, based on internal Intel analysis. …
If you don’t like gut-wrenching, hair-raising, white-knuckling boom bust cycles, then do not go into the memory business. …
What is the most important factor that will drive the Nvidia datacenter GPU accelerator juggernaut in 2024? …
As we have seen with various kinds of high bandwidth, stacked DRAM memory to compute engines in the past decade, just adding this wide, fast, and expensive memory to a compute engine can radically improve the effective performance of the device. …
Over the last twenty years, memory has risen from ten percent of the semiconductor market to almost 30 percent — a trend that is expected to continue, propelled by compute at the edge all the way up to datacenter. …
If the HPC and AI markets need anything right now, it is not more compute but rather more memory capacity at a very high bandwidth. …
We have nothing against disk drives. Seriously. And in fact, we are amazed at the amount of innovation that continues to go into the last electromechanical device still in use in computing, which from a commercial standpoint started out with the tabulating machines created by Herman Hollerith in 1884 and used to process the 1890 census in the United States, thus laying the foundation of International Business Machines. …
Micron has a habit of building interesting research prototypes that offer a vague hope of commercialization for the sheer purpose of learning how to make its own memory and storage subsystem approaches more tuned to next generation applications. …
All Content Copyright The Next Platform