Throughput, and why it is not a benchmark
A throughput figure is a duration for one clip on one card at one configuration. It is useful for estimating whether an approach is plausible, and it cannot be used to rank two releases against each other. As of 2026-09-22.
| Part | Usually stated |
|---|---|
| The card | Yes, when a timing is published at all |
| The clip length | Sometimes |
| The resolution | Sometimes |
| The software version | Rarely |
Inclusion rule. Components of a reusable timing. A component that is rarely stated is listed, because its absence is why timings age. Order. From the part almost always given to the part almost never given.
1Timings age differently from memory figures
Inference code gets faster while the weights stay the same size. A memory figure from a year ago is probably still roughly right; a timing from a year ago may be substantially pessimistic.
That is why the register keeps the date a figure was read next to the value, and why a timing is recorded with the card it was measured on rather than on its own.
2Two timings in this register, two purposes
One release states a duration on a named consumer card together with the output it produced, which is a plausibility check for somebody who owns that card. Another states a duration on a large data-centre card with no memory floor at all.
The first is checkable by a reader; the second is a capacity number for a class of machine most readers do not have. Both are quoted rather than ranked.
3The two timings in the register
One family publishes a duration on a named consumer card together with the release and the output it produced. Another publishes a duration on a large data-centre card with no memory figure anywhere on the page.
The first can be checked by somebody who owns that card; the second is a capacity number for a class of machine most readers do not have. Neither is ranked against anything here.
A reading note, not an entry: no vendor value appears on this page. Where the register records this term for a particular release, it is on the hardware column and on that family's own page. Nearby terms: Storage footprint, Resolution tier.