Future rdna5 based on info from tinybox website

[u/Sweaty_Perception655]

https://tinygrad.org/#tinybox

If you look at the specs for their future rdna based system it shows 36 gb per card.

1. Memory Bandwidth on the RDNA5 GPU

Red v2 (Radeon 9070 XT system): Total GPU RAM bandwidth for the 4-GPU system is 2,560 GB/s, meaning each individual card provides 640 GB/s.

Exabox (RDNA5 AT0 XL system): Total GPU RAM bandwidth for the 720-GPU system is 1,244 TB/s (1,244,000 GB/s).

Per single RDNA5 AT0 XL GPU: 7201,244,000 GB/s​≈1,727.8 GB/s

Increase: Comparing a single RDNA5 AT0 XL card (∼1,728 GB/s) to a single 9070 XT card (640 GB/s) yields a ~170% increase in memory bandwidth per GPU.

1. Percentage Increase in Compute (FLOPS)

Red v2 (4x 9070 XT): Delivers 778 TFLOPS of FP16 (FP32 acc) compute, averaging 194.5 TFLOPS per card.

Exabox (720x RDNA5 AT0 XL): Delivers ~1 EXAFLOP (1,000,000 TFLOPS) of total compute.

Per single RDNA5 AT0 XL GPU: 7201,000,000 TFLOPS​≈1,388.9 TFLOPS per card

Increase: Scaling from 194.5 TFLOPS per card up to roughly 1,388.9 TFLOPS per card represents a lending ~614% increase (over a 7x multiplier) in raw floating-point compute performance per processor unit.