NodeValid

Published video-model weights, licences and hardware notes

Batch size, the hidden variable in a figure

Batch size is how many outputs a single run produces at once. It multiplies the activation memory without touching the weights, and most memory figures in this register do not say what it was. As of 2026-09-22.

What batch size multipliesWeights are held once regardless of batch size, and everything else scales with it, which is why an unstated batch makes a figure ambiguous in one direction only.Scales with batch sizeHeld onceActivationsYes, roughly linearly—Intermediate buffersYes—Weights—Loaded once for the runAutoencoder passesYes, per clip—Weights once, activations per clip
Fig. 1 The part that scales and the part that does not, in one run.
What an unstated batch size leaves open. Recorded 2026-09-22.
ReadingConsequence
Assume oneThe figure is the per-stream cost, probably
Assume moreThe per-stream cost is lower than stated
Stated as oneThe figure is the lowest honest value
Not statedThe figure cannot be scaled with confidence

Inclusion rule. Readings a reader can take of a memory figure with no batch size attached. Each is listed with what follows from it. Order. From the safest assumption to the least informative case.

1One repository states it, which is unusual

A memory table in this register gives three peak figures and says they are at batch size one. That removes the commonest hidden variable and means the figures are the lowest the vendor could honestly publish.

Anyone planning throughput rather than feasibility should read those numbers as a per-stream cost with no batching headroom included.

2Why it matters for capacity planning

Feasibility asks whether one clip fits. Capacity asks how many fit at once, and that question cannot be answered from a figure whose batch size is unknown.

The register records the batch size where a vendor stated it and leaves the cell as published otherwise. Assuming one would be reasonable and would still be an assumption.

3How often this is stated here

One family states it, for three peak figures at three configurations. Everywhere else in the register a reader has to assume a single stream and know that they are assuming.

It is the largest hidden multiplier in the hardware column, because weights are held once and everything else scales with the batch. A figure at an unstated batch size is ambiguous in one direction only.

A reading note, not an entry: no vendor value appears on this page. Where the register records this term for a particular release, it is on the hardware column and on that family's own page. Nearby terms: Cold start, Throughput.