Braintrust
Daily totals per project and model. AI calls, tokens and estimated cost. Input, output and cached tokens. Never an input or an output.
Access
- Kind
- A read-only key you paste
- What to give
- API key
- Why that one
- A Braintrust API key for the organization. Valistry lists projects and asks BTQL for daily totals per model — sums only, never a span, never an input.
What it attributes on its own
- From the source
- day; project; model; LLM spans; input, output and cached tokens; what Braintrust estimated them to cost
- Needs a rule or a trace
- the provider's invoice — Braintrust estimates a cost, it does not bill you; team, workflow and agent unless a rule maps the project; outcome — scores are a later slice
The addresses it calls
- https://api.braintrust.dev
Valistry calls only these addresses. It blocks any other call and logs every call.
Connecting it
- Create an API key. Settings → API keys → + API key Open ↗
- Copy your API URL. Settings → Data plane → API URL. Copy it into the box below. Open ↗
Braintrust estimates a cost; the provider bills it. Connecting both Braintrust and a provider it traces counts the same call twice — connect one. Braintrust is the better of the two when you need the project and, later, the score on the row; the provider is better when you need the invoice.