The Next Platform
Power Efficiency, Customization Will Drive Arm’s Role In AI

More than a decade ago, executives at Arm Ltd saw the energy costs in datacenters soaring and sensed an opportunity to extend the low-power architecture of its eponymous systems-on-a-chip that has dominated the mobile phone markets from the get-go and took over the embedded device market from PowerPC into enterprise servers. …

Power Efficiency, Customization Will Drive Arm’s Role In AI was written by Jeffrey Burt at The Next Platform.

The Next Platform
What Happens When Hyperscalers And Clouds Buy Most Servers And Storage?

We have a long-standing joke that dates from the early 2000s, when the hyperscalers – there were not yet cloud builders as we now know them – started having hundreds of millions of users and millions of servers and storage arrays to run applications for them at the same time there was the beginnings of consolidation among the OEMs who created the servers and storage used by nearly all enterprises, including dot-com startups. …

What Happens When Hyperscalers And Clouds Buy Most Servers And Storage? was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
TSMC Will Have An AI Business Bigger Than All Of Intel Foundry

Everyone is in a big hurry to get the latest and greatest GPU accelerators to build generative AI platforms. …

TSMC Will Have An AI Business Bigger Than All Of Intel Foundry was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Meta’s Llama 3 AI Is Smart, But Who Is Going To Profit From It?

With large language models, bigger is better (and faster) but better is also better. …

Meta’s Llama 3 AI Is Smart, But Who Is Going To Profit From It? was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
AI At The Edge: From Theory To Practice

The Internet of Things (IoT) has shown significant growth and promise, with data generated by IoT devices alone expected to reach 73.1 zettabytes by 2025. …

AI At The Edge: From Theory To Practice was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Sweetened IT Spending Forecast Is Not Precisely A GenAI Boom

Here is a paradox for you: Spending on infrastructure to support generative AI is apparently booming, as clearly evidenced by the skyrocketing revenues and profits of Nvidia. …

Sweetened IT Spending Forecast Is Not Precisely A GenAI Boom was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Sandia Pushes The Neuromorphic AI Envelope With Hala Point “Supercomputer”

Not many devices in the datacenter have been etched with the Intel 4 process, which is the chip maker’s spin on 7 nanometer extreme ultraviolet immersion lithography. …

Sandia Pushes The Neuromorphic AI Envelope With Hala Point “Supercomputer” was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
IBM Buys HashiCorp To Control The Alternative To Red Hat Kubernetes

It has been quite a week for Hashi Corp, the company behind the open source Hashi Stack of systems software for creating and running modern, distributed applications. …

IBM Buys HashiCorp To Control The Alternative To Red Hat Kubernetes was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Intel Hits Bottom In The Datacenter – Maybe

It would be hard to pick a worse time to not have an XPU offload engine that can do lots of matrix math at mixed precision and that can ship in volume. …

Intel Hits Bottom In The Datacenter – Maybe was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
The Cutting Edge In Power Grid Management

Commissioned: Thanks to recent technological advancements, there are many different sources of electricity available which can help organizations address our growing demand for energy from power hungry devices such as electric vehicles while reducing their reliance on fossil fuels like petroleum, coal, and gas. …

The Cutting Edge In Power Grid Management was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Building The Power Grid Of Tomorrow

The energy sector is undergoing a monumental shift as the power grid struggles to accommodate growing demand and the complexity of modern energy systems. …

Building The Power Grid Of Tomorrow was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
The Perfect AI Storage: Trino From Facebook And Iceberg From Netflix?

When it comes to solving data analytics problems at scale, it is tough to beat the hyperscalers. …

The Perfect AI Storage: Trino From Facebook And Iceberg From Netflix? was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
AMD Firing On All Compute Engine Cylinders

A few years ago, it was hard to imagine how AMD would have survived without re-entering the datacenter with its CPU and GPU compute engines. …

AMD Firing On All Compute Engine Cylinders was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
How To Make More Money Renting A GPU Than Nvidia Makes Selling It

It is not a coincidence that the companies that got the most “Hopper” H100 allocations from Nvidia in 2023 were also the hyperscalers and cloud builders, who in many cases wear both hats and who are as interested in renting out their GPU capacity for others to build AI models as they are in innovating in the development of large language models. …

How To Make More Money Renting A GPU Than Nvidia Makes Selling It was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Supermicro Finally Mints Some Coin Peddling Rackscale Iron

With new generations of GPUs and other kinds of AI accelerators either shipping or soon to start shipping and new CPUs also soon to be available from Intel and AMD, and sales already at a historical high level at Supermicro, you might not be expecting for sales to bust through a whole new higher ceiling starting in the next quarter. …

Supermicro Finally Mints Some Coin Peddling Rackscale Iron was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
AI Accelerates Cloud Revenues As Well As Cloud Investments

Three years ago, thanks in part to competitive pressures as Microsoft Azure, Google Cloud, and others started giving Amazon Web Services a run for the cloud money, the growth rate in quarterly spending on cloud services was slowing. …

AI Accelerates Cloud Revenues As Well As Cloud Investments was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Red Hat Saddles Up For The Wide Open GenAI Horizons

A theme snaking its way through conversations these days about generative AI is the need for open source models, open platforms, and industry standards as ways to make the emerging technology more accessible and widely adopted by enterprises. …

Red Hat Saddles Up For The Wide Open GenAI Horizons was written by Jeffrey Burt at The Next Platform.

The Next Platform
AI At The Edge Is Different From AI In The Datacenter

Today’s pace of business requires companies to find faster ways to serve customers, gather actionable insights, increase operational efficiency, and reduce costs. …

AI At The Edge Is Different From AI In The Datacenter was written by Timothy Prickett Morgan at The Next Platform.

The Next Platform
Greasing The Skids To Move AI From InfiniBand To Ethernet

Just about everybody, including Nvidia, thinks that in the long run, most people running most AI training and inference workloads at any appreciable scale – hundreds to millions of datacenter devices – will want a cheaper alternative for networking AI accelerators than InfiniBand. …

Greasing The Skids To Move AI From InfiniBand To Ethernet was written by Timothy Prickett Morgan at The Next Platform.