Braintrust
The organization's project list, then one BTQL query per project per day for totals per model: LLM spans, input, output and cached tokens, and estimated cost. Aggregates only — no span, no input, no output.
Access
- Kind
- A read-only key you paste
- What to give
- API key
- Why that one
- A Braintrust API key for the organization. Valistry lists projects and asks BTQL for daily totals per model — sums only, never a span, never an input.
What it attributes on its own
- From the source
- day · project · model · LLM spans · input, output and cached tokens · what Braintrust estimated them to cost
- Needs a rule or a trace
- the provider's invoice — Braintrust estimates a cost, it does not bill you · team, workflow and agent unless a rule maps the project · outcome — scores are a later slice
The addresses it calls
- https://api.braintrust.dev
Only these. A call anywhere else is refused before it leaves, and every call is logged.
Connecting it
- Create an API key. Settings → API keys → Create. It reads every project in the organization. Open ↗
- Confirm the host. The Braintrust cloud, or the address of your own data plane.
- Paste both and click Test and connect. Valistry lists projects, asks for the last seven days a day at a time, reports what it found, then fills thirty.
Braintrust estimates a cost; the provider bills it. Connecting both Braintrust and a provider it traces counts the same call twice — connect one. Braintrust is the better of the two when you need the project and, later, the score on the row; the provider is better when you need the invoice.