The shadow list

The headline number is large and it is also the least interesting thing on this page. 113 machines from 100 operators, and the result lands at around half of every ranked system in this dataset combined. These were disclosed because the operators wanted credit for open hardware, for scale, or for a training run, not because anyone required it. There is no reason to think they are unusual, and every reason to think the ones nobody blogged about are larger.

The more useful finding is the shape of the disclosure. Of the 575 unranked systems here, 408 disclose no hardware at all. Not a performance figure, not an accelerator count, nothing that could be turned into a number by any method. That is the normal case. The disclosing clusters are in this analysis precisely because they are the exception, which means any shadow estimate anyone publishes, including this one, is built on the small minority of operators who chose to say something.

Two ways this number misleads, in opposite directions. It overstates, because these clusters would never actually achieve it: HPL needs tuning, a tightly coupled fabric and a reason to run it, and a training cluster has none of the three. It understates far more severely, because FP64 is not what the hardware was bought for. The same H100s deliver an order of magnitude more arithmetic in BF16 and more again in FP8, which is the precision that training actually uses. Read as "how much of a ranked machine is this hardware equivalent to", the figure is fair. Read as "how much compute is out there", it is far too low.

That is the deeper problem with the whole exercise, and it is not solvable by better estimation. The benchmark that defines the visible world measures a precision the invisible world does not use. Even a perfect shadow list would be denominated in the wrong unit. Why FP64 and FP8 diverged is worth reading alongside this page.

The measured-rate chart is worth a second look on its own terms, independent of the shadow argument. It is a clean generational curve built from nothing but sourced fields on system rows, and it shows something the marketing numbers do not: a factor of roughly forty in real delivered HPL throughput per accelerator between 2010 and 2024, and a visible spread between two systems running identical silicon.