Escaping the Matrix: AI and Submarine Cables

We are actually transferring from sci-fi to actuality with the launch of many AI companies which might be poised to rework industries and reshape our each day lives.

Whereas information facilities are increasing quickly to help AI necessities, there’s much less readability on how AI may affect long-haul community infrastructure, particularly submarine cables.

That is precisely what I delved into throughout my keynote at Submarine Networks World 2024.

On this presentation, I checked out three large questions:

1. How large are AI coaching information units and fashions?

To know AI’s potential affect on submarine cables, we should think about the sheer measurement of coaching information and fashions.

I used to be curious to grasp simply how large the coaching information and fashions are by way of gigabytes, as a substitute of the extra obscure metrics used within the AI world like parameters or tokens. In any case, this information is the uncooked materials that might be carried across the globe on submarine cables. 

2. How will AI affect demand for submarine cable bandwidth?

Over the previous couple of years, I have been asking folks how AI may form the demand of submarine cable bandwidth. I offered some outcomes of this non-scientific, faux survey within the chart under.

Even with no definitive reply to this query, it’s value digging into what components could play a task.

Two phrases: location issues.

A mannequin could require pulling coaching information from sources positioned everywhere in the world, or it might be relying purely on a knowledge set already saved domestically. Mannequin coaching and inference (utilizing an AI mannequin) may happen throughout the similar metropolis, or the mannequin could also be distributed globally throughout a number of information facilities.

And that is simply the tip of the iceberg.

Components akin to information measurement, mannequin coaching frequency, energy availability, information sovereignty legal guidelines, inference latency, and on-device inference will even affect bandwidth necessities.

3. Is there an AI-fueled bubble in new submarine cables?

Many veterans of the telecom trade will recall the submarine cable funding bubble (and subsequent meltdown) within the late Nineties/early 2000s. Is the present degree of funding just like what occurred 1 / 4 of a century in the past?

Whereas a whole lot of billions of {dollars} are flooding into GPUs, information facilities, and energy era, the funding into new cables is extra modest.

Transferring ahead

I closed with a take a look at some components to control because the AI revolution progresses. Specifically, the placement of future AI factories is essential. Will these be in areas which might be unconnected or underserved by submarine cables?

Extra Knowledge This Approach 👇

You will discover my full 2024 Submarine Networks World presentation over right here.

Obtain the slides. Free your thoughts.