Search Ctrl K
Home / Tools
THE FEUTEX TOOLKIT

Tensor Parallel Shard Fit

Estimate minimum equal shards for weights after reserving device memory for runtime.

AI Infrastructure workspace● Runs in your browser
01 Your input
02 Your result
View or copy raw result data
FormulaMinimum equal shards = Math.ceil(weights/(device-reserve)); Aggregate remaining capacity = devices*(device-reserve)-weights

Made for real tasks

  • Estimate minimum equal shards for weights after reserving device memory for runtime.
Explore step-by-step workflows →

Worked example

Inputs

Weight storage
140 GiB
Memory per device
80 GiB
Runtime reserve per device
20 GiB
Available devices
4 devices

Expected results

Minimum equal shards
3 devices
Aggregate remaining capacity
100 GiB

Load the example in the workspace to reproduce these results. Display rounding does not change the underlying calculation.

How to use this tool

  1. Enter weight storage, memory per device, runtime reserve per device, available devices in the displayed units.
  2. Calculate the scenario, then compare it with measurements before changing a system.

Try this example

{
  "weights": 140,
  "device": 80,
  "reserve": 20,
  "devices": 4
}

Accuracy and scope

Ideal evenly divisible weights; architecture divisibility, duplicated layers and communication buffers excluded.

Is my data uploaded?

This tool runs locally in your browser. Input and output are not sent to a processing server. Copy or download your result before leaving the page.