Search Ctrl K
Home / Tools
THE FEUTEX TOOLKIT

Ring All Reduce Traffic

Estimate bytes sent per worker and bandwidth-only duration for ring all-reduce.

AI Infrastructure workspace● Runs in your browser
01 Your input
02 Your result
View or copy raw result data
FormulaBytes sent per worker = 2*(n-1)/n*size; Bandwidth lower bound = 2*(n-1)/n*size/1024/bandwidth
Sources and model references

Made for real tasks

  • Estimate bytes sent per worker and bandwidth-only duration for ring all-reduce.
Explore step-by-step workflows →

Worked example

Inputs

Gradient payload
1000 MiB
Workers
8 workers
Effective link throughput
20 GiB/s

Expected results

Bytes sent per worker
1750 MiB
Bandwidth lower bound
0.08544921875 s

Load the example in the workspace to reproduce these results. Display rounding does not change the underlying calculation.

How to use this tool

  1. Enter gradient payload, workers, effective link throughput in the displayed units.
  2. Calculate the scenario, then compare it with measurements before changing a system.

Try this example

{
  "size": 1000,
  "n": 8,
  "bandwidth": 20
}

Accuracy and scope

Reduce-scatter plus all-gather; excludes per-step latency, topology bottlenecks and overlap.

Is my data uploaded?

This tool runs locally in your browser. Input and output are not sent to a processing server. Copy or download your result before leaving the page.