LLaMA - The Next Platform

SambaNova Tackles Generative AI With New Chip And New Approach

September 20, 2023 Timothy Prickett Morgan 2

If you have the entire corpus of the Internet scrubbed of nonsense plus whatever else you can scrounge up in whatever language all put into the right format so you can chew on that data one token at a time with trillions of parameters of interconnections between those tokens to build a large language model for generative AI applications, you have an enormous problem. …

The Balancing Act Of Training Generative AI

July 17, 2023 Timothy Prickett Morgan 6

We learn a lot of lessons from the hyperscalers and HPC centers of the world, and one of them is that those who control their own software control their own fates. …

Move Over ChatGPT, Meta Platforms LLaMA Makes Some Drama

February 28, 2023 Timothy Prickett Morgan 2

Large language models, also known as AI foundation models and part of a broader category of AI transformer models, have been growing at an exponential pace in terms of the number of parameters they can process and the amount of compute and memory bandwidth capacity they require. …