Intercontinental bandwidth is expensive in two senses: it costs money on the cloud egress invoice, and it costs time when artists are waiting for an asset to come down the pipe. A render fleet that does not think about this can spend a meaningful fraction of every job's wall time on cold-pulling scene files that are already sitting in cache somewhere else in the building.
The shared cache pattern is the simplest and largest lever. One Samba (SMB3) cache server in the main datacenter holds project assets. Each render node mounts the cache and reads scene files over LAN. When a new asset is referenced by a job, the cache pulls it from the customer's cloud storage once. Every subsequent node that needs that asset reads it from the LAN copy. A 20-node fleet that would otherwise pull a 40 GB scene file twenty times pulls it once.
This is straightforward in principle. In practice, two pieces of the design matter.
Avoid per-node caching. It is tempting to give each render node its own large local SSD and let it cache whatever it wants. For a 20-node fleet with 10 TB of project data, this becomes 200 TB of duplicated storage with no shared invalidation story. We do not do this. The shared cache is the only cache; nodes treat their local disks as scratch space, not as a project archive.
Pre-warm the cache before D-day. When a customer announces that a project starts on Monday, we pre-warm the cache over the weekend. The first job on Monday reads from a warm cache instead of triggering twenty hours of cold pulls. This is the single most reliable way to make the first render of a project feel fast.
A note on right-sizing: the cache box uses a single SATA SSD with an ext4 filesystem. For a cache (as opposed to primary storage), a single-disk layout is the correct trade-off. The cache is not the source of truth — the customer's cloud storage is — and the cache can be rebuilt by re-pulling from cloud or rsyncing from a project backup. Building a redundant array on top of an encrypted volume would add cost, add complexity, and not change the operational story; a node losing the cache is a one-evening rebuild, not a data loss event. Right-sizing the cache hardware to match the role is one of the easier ways to keep operating cost predictable.
For teams considering a permanent cluster rather than a single cross-country deployment, the dedicated cluster options page covers what that arrangement looks like in more detail.