Question 1

Which files can I audit?

Accepted Answer

Any CSV with one column for the model and columns for input and output tokens. Activity and usage exports from most LLM platforms work as they are. If a column is not recognized, pick it by hand after loading the file.

Question 2

Is my usage data uploaded?

Accepted Answer

No. The file is parsed in your browser and nothing in it is sent to our servers. Only the per-model totals shown on the page are computed, and they stay on the page.

Question 3

How is the LLM Gateway cost calculated?

Accepted Answer

Each model in your file is matched to the catalogue and priced at the cheapest provider currently serving it, using that provider's input, cached input and output prices. The platform fee charged on credits is then added to the total.

Question 4

What if my file has no cost column?

Accepted Answer

Then the comparison uses each model's list price at the lab that built it as the baseline, and says so above the result. A model whose lab is not one of our providers has no list price here and is left out.

Question 5

What is left out?

Accepted Answer

Models that cannot be priced on both sides are excluded from both totals and listed under the table, and so are rows with an unreadable token count or cost. Models billed per image, second or request, and long-context price tiers, are not modelled, so treat the result as an estimate for text workloads.

LLM savings audit

How the audit works

Savings audit, answered

Stay ahead of the curve