Valistry

LiteLLM proxy

Each AI call, except its content. Model, key, team, tokens and cost. Time to first token, prompt version and retries. Never the prompt or the reply.

Access

Kind
A read-only key you paste
What to give
Proxy URL and an admin key
Why that one
LiteLLM runs on your servers, so Valistry needs its address as well as a key. The key reads the spend log, and the proxy's keys, teams, users, models, tags, budgets and router settings. It never reads a prompt or a reply.

What it attributes on its own

From the source
virtual key (hashed by the proxy); team; the key's owner (hashed, joined by email); end user (hashed); model and upstream provider; cache hits; what the proxy charged
Needs a rule or a trace
outcome — a proxy records the call, not what it was for; workflow and agent unless a call carries a workflow: tag or a rule maps the team or the key

Connecting it

  1. Give your proxy's address. Copy the https address your applications call.
  2. Add a read-only admin key. Open /ui → Internal Users → Invite User. Then make their key under Virtual Keys. Open ↗

If you also connect a provider behind the proxy, connect only one of the two, or each request counts twice.

Settings worth turning on in LiteLLM

  1. One virtual key per app. Issue each app its own key in the proxy. A shared key cannot be split later. Valistry reads it.
  2. Put every key on a team. A key on a team gives its spend an owner with no rule. Valistry reads it.
  3. Set a budget per key or team. The proxy stops a key at its budget. Valistry shows the same spend against your own budgets.

Questions about LiteLLM

What access does Valistry need?Your proxy's address and a key with the admin viewer role, which can only read.
Our proxy runs inside our network. Can Valistry reach it?Yes, if we host your data in India: allow 15.252.43.163 on port 443 or 4000, over HTTPS. Every call we make comes from there. Elsewhere, write to hello@valistry.ai.
LiteLLM already shows our spend. Why add Valistry?LiteLLM prices each call from a price list and sees only the calls sent through it. Valistry adds your invoices, your seats, and what each call produced.
We also call some providers directly. Is anything counted twice?Connect each provider once: through the proxy, or directly. A call read from both would be counted twice.