Search Ctrl K
Home / Tools
THE FEUTEX TOOLKIT

Transformer Projection FLOPs

Estimate QKV and output projection arithmetic for a dense attention block.

AI Infrastructure workspace● Runs in your browser
01 Your input
02 Your result
View or copy raw result data
FormulaFour projection FLOPs = 8*batch*tokens*hidden*hidden/1e9

Made for real tasks

  • Estimate QKV and output projection arithmetic for a dense attention block.
Explore step-by-step workflows →

Worked example

Inputs

Batch size
1 sequences
Sequence length
2048 tokens
Hidden width
4096 dimensions

Expected results

Four projection FLOPs
274.8779069 GFLOP

Load the example in the workspace to reproduce these results. Display rounding does not change the underlying calculation.

How to use this tool

  1. Enter batch size, sequence length, hidden width in the displayed units.
  2. Calculate the scenario, then compare it with measurements before changing a system.

Try this example

{
  "batch": 1,
  "tokens": 2048,
  "hidden": 4096
}

Accuracy and scope

Four square dense linear maps, multiply-add counted as two FLOPs; excludes attention matrices, MLP and grouped-query reductions.

Is my data uploaded?

This tool runs locally in your browser. Input and output are not sent to a processing server. Copy or download your result before leaving the page.