The Next Platform
How Nvidia Blackwell Systems Attack 1 Trillion Parameter AI Models

We like datacenter compute engines here at The Next Platform, but as the name implies, what we really like are platforms – how compute, storage, networking, and systems software are brought together to create a platform on which to build applications. …

How Nvidia Blackwell Systems Attack 1 Trillion Parameter AI Models was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
AWS And Nvidia Reboot “Ceiba” Supercomputer For Blackwell GPUs

Last November, we got a sneak peak at a supercomputer called “Ceiba” that would be built jointly by Nvidia and Amazon Web Services, based on its then-new GH200 Grace-Hopper CPU-GPU compute complexes, its NVLink Switch 3 memory fabric for GPUs, and the Elastic Fabric Adapter (EFA2) Ethernet interconnect that is custom designed by AWS to link racks of machines to each other. …

AWS And Nvidia Reboot “Ceiba” Supercomputer For Blackwell GPUs was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Hyperscalers Bringing Nvidia’s Grace-Blackwell Superchip To Their Clouds

At his company’s GTC 2024 Technical Conference this week, Nvidia co-founder and chief executive officer Jensen Huang, unveiled the chip maker’s massive Blackwell GPUs and accompanying NVLink networking systems, promising a future where hyperscale cloud providers, HPC centers, and other organizations of size and means can meet the rapidly increasing compute demands driven by the emergence of generative AI. …

Hyperscalers Bringing Nvidia’s Grace-Blackwell Superchip To Their Clouds was written by Jeffrey Burt at The Next Platform.

The Next Platform
Expanding The Search For A Range Of New Materials

Finding new functional materials for batteries and catalysts and lots of other uses is a major goal of researchers around the world. …

Expanding The Search For A Range Of New Materials was written by Linda Barney at The Next Platform.

The Next Platform
Nvidia Research Gives Generative AI Images And 3D A Speed Boost

Time is money when it comes to generative AI, as is the case with most technologies. …

Nvidia Research Gives Generative AI Images And 3D A Speed Boost was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
How Long Until The ODMs Take Over Ethernet Switching?

For more than a year now, we have been talking about how investments in AI servers have put a damper on budgets for servers used to support other corporate applications. …

How Long Until The ODMs Take Over Ethernet Switching? was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Amazon Gives Anthropic $2.75 Billion So It Can Spend It On AWS XPUs

If Microsoft has the half of OpenAI that didn’t leave, then Amazon and its Amazon Web Services cloud division needs the half of OpenAI that did leave – meaning Anthropic. …

Amazon Gives Anthropic $2.75 Billion So It Can Spend It On AWS XPUs was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
How To Build A Better “Blackwell” GPU Than Nvidia Did

While a lot of people focus on the floating point and integer processing architectures of various kinds of compute engines, we are spending more and more of our time looking at memory hierarchies and interconnect hierarchies. …

How To Build A Better “Blackwell” GPU Than Nvidia Did was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Microsoft Stargate: The Next AI Platform Will Be An Entire Cloud Region

The first thing to note about the rumored “Stargate” system that Microsoft is planning to build to support the computational needs of its large language model partner, OpenAI, is that the people doing the talking – reportedly OpenAI chief executive officer Sam Altman – are talking about a datacenter, not a supercomputer. …

Microsoft Stargate: The Next AI Platform Will Be An Entire Cloud Region was written by Timothy Prickett Morgan at The Next Platform.
➖ Sent by @TheFeedReaderBot ➖

The Next Platform
Creating A Greener Edge

Commissioned: The network edge is on its way to becoming the location where data is created faster than ever before, and where application innovation is arguably at its sharpest as organizations around the world look to acquire meaningful insight from information collected as close to real time as possible to speed up their decision making. …

Creating A Greener Edge was written by David Gordon at The Next Platform.

The Next Platform
Celestial AI Wants To Break The Memory Wall, Fuse HBM With DDR5

In 2024, there is no shortage of interconnects if you need to stitch tens, hundreds, thousands, or even tens of thousands of accelerators together. …

Celestial AI Wants To Break The Memory Wall, Fuse HBM With DDR5 was written by Tobias Mann at The Next Platform.

The Next Platform
Intel’s Chips No Longer Pay More Than Their Fair Share Of Foundry Costs

The biggest benefit that is coming from the separation of the Intel chip design and marketing business from its foundry operations is that Intel’s chip product groups no longer have to shoulder the totality of the immense costs of its manufacturing operations. …

Intel’s Chips No Longer Pay More Than Their Fair Share Of Foundry Costs was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Mixed Results For The Datacenter Thundering Thirteen In Q4

We have been tracking the financial results for the big players in the datacenter that are public companies for three and a half decades, but starting last year we started dicing and slicing the numbers for the largest IT suppliers for stuff that goes into datacenters so we can give you a better sense what is and what is not happening out there. …

Mixed Results For The Datacenter Thundering Thirteen In Q4 was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
With Gaudi 3, Intel Can Sell AI Accelerators To The PyTorch Masses

We have said it before, and we will say it again right here: If you can make a matrix math engine that runs the PyTorch framework and the Llama large language model, both of which are open source and both of which come out of Meta Platforms and both of which will be widely adopted by enterprises, then you can sell that matrix math engine. …

With Gaudi 3, Intel Can Sell AI Accelerators To The PyTorch Masses was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Google Joins The Homegrown Arm Server CPU Club

If you are wondering why Intel chief executive officer Pat Gelsinger has been working so hard to get the company’s foundry business not only back on track but utterly transformed into a merchant foundry that, by 2030 or so can take away some business from archrival Taiwan Semiconductor Manufacturing Co, the reason is simple. …

Google Joins The Homegrown Arm Server CPU Club was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Gelsinger: With Gaudi 3 and Xeon 6, AI Workloads Will Come Our Way

The steady rise of AI over the past several years – and the accelerated growth with the introduction generative AI since OpenAI’s launch of ChatGPT in November 2022 – has shifted Intel’s status as a challenger in a chip market that it long had dominated. …

Gelsinger: With Gaudi 3 and Xeon 6, AI Workloads Will Come Our Way was written by Jeffrey Burt at The Next Platform.

The Next Platform
With MTIA v2 Chip, Meta Can Do AI Training As Well As Inference

If you control your code base and you have only a handful of applications that run at massive scale – what some have called hyperscale – then you, too, can win the Chip Jackpot like Meta Platforms and a few dozen companies and governments in the world have. …

With MTIA v2 Chip, Meta Can Do AI Training As Well As Inference was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Looking To Adopt Generative AI Within Your Organization?

SPONSORED POST: Generative AI is the subject of significant interest from enterprises busy looking to use it to help them improve business processes and build innovative new applications and services which can attract new customers and grow revenue. …

Looking To Adopt Generative AI Within Your Organization? was written by Timothy Prickett Morgan at The Next Platform.