← All notesNAPOLEONIC / THE CORRESPONDENCE

When intelligence meets infrastructure

Following the thread from a model on a screen to the physical systems that make it possible.

The physical world returns.

A system, not a single invention

It is tempting to talk about artificial intelligence as if it were a weightless product. A prompt goes in, an answer comes out, and the machinery in between disappears. But every interaction sits on a physical foundation: processors, networks, cooling, power, and the people who put those pieces together.

A useful research question is what changes when we treat that foundation as part of the product. The answer may look different for a training cluster, an inference service, and a machine operating in the real world. Each has its own constraints.

Follow the constraint

The interesting part of a system is often the part that cannot easily expand. Adding more of one resource can reveal a new bottleneck somewhere else. Faster processors can make memory more important. More available compute can make access to useful data the limiting factor.

That suggests a method for analysis: map the dependencies before deciding where the value will accumulate. Start with what the end user needs, trace the inputs, and ask which assumptions would have to change for the system to scale.

Questions to carry forward

Which constraints are temporary coordination problems, and which are enduring physical limits? Where can software substitute for capital expenditure? Which improvements make an entire system more useful, rather than one component more impressive?

These are starting questions, not a settled investment thesis. The aim is to see the infrastructure clearly enough to notice when the important bottleneck moves.

This is an illustrative essay written for the website design preview.

Next essay