Betrieben in Deutschland
The self-hosted LLM gateway
for agencies & agent systems
One pk_ key for every connected provider, a hard budget limit before every call and a hash-chained audit trail — OpenAI-compatible, Anthropic-native, operated in Germany. In the same account: the Brain Repository your agents read their context from, and the PromptGallery to get started.
-
01 · AI gateway
One key, one budget, one ledger
Every model call runs through your
See the gateway →pk_key: budget checked before the call, costs per project and client, failover with credit. -
02 · Brain Repository
Your agents' context
Knowledge, rules and prompts in one place, searchable and reachable through the same API.
To the Brain Repository → -
03 · PromptGallery
Templates to get started
Approved prompts, copied into your own repository in one click.
Open the PromptGallery →
Building block 1 · AI gateway
One gateway, three guardrails
-
01 · KeyOne key for every provider
-
02 · CapHard budget caps before every call
-
03 · AuditHash-chained audit trail
What Promptopoly actually does for you
Six reasons teams run the gateway — each with the mechanism behind it.
-
No agent can blow up the bill
The budget is checked before every call, not invoiced afterwards. An agent stuck in a loop is stopped while it has still cost you nothing.
Daily, weekly and monthly budgets per tenant and project · prepaid wallet with atomic debit · refund on stream abort
-
One key instead of five provider accounts
A single
pk_key for OpenAI, Anthropic and Google (Gemini). A new model arrives through configuration, not through a deployment.OpenAI-compatible API · native
/v1/messagesendpoint · streaming and tool calling -
Provider keys never sit in your code again
The real provider keys stay in the KeyVault. Applications, agents and outside contractors only ever see the
pk_key — and that one can be revoked on its own.AES-256-GCM encrypted · plaintext only transient in RAM · rotation and fingerprinting included
-
Every call stays provable — months later
Who used which model, when and for what, is recorded without gaps in a hash chain. That answers audit and compliance questions without rebuilding anything in a spreadsheet.
HMAC hash chain · export as CSV or JSON · fixed deletion periods, 7-day response retention
-
Usage agencies can actually bill on
Costs accrue separately per project and per client. The log becomes the line item on the client invoice — instead of one lump sum nobody can split.
Reporting per tenant and project · model, token count and cost for every call
-
A provider outage no longer costs you a night
If a provider goes down, a fallback model takes over automatically. The failed attempt is credited back to your balance.
Curated model aliases · automatic failover with refund · made in Germany
And the context your agents work with lives in the same account: searchable, linked, reachable over the same API — the Brain Repository.
Building block 2 · Brain Repository
The memory your agents read from.
Knowledge, rules and prompts live in one place — reachable through the same API that carries the model calls. No more context lost in chat history.
A knowledge graph, not folders
Notes with links, backlinks and full-text search. An agent queries the workspace search and gets its context, instead of carrying it in every prompt.
Versioned prompts
Prompts and templates get a version on every change and can be restored to any earlier point.
Git mirror and team roles
Mirroring to GitHub, GitLab or Gitea. Per-workspace permissions for read, write or admin, with a change log — one repository for humans and agents.
Building block 3 · PromptGallery
The PromptGallery to get started.
263 approved prompts across 16 categories — searchable, cloned into your own repository in one click, and turned into a shareable form wherever they carry variables. The starting point until your own knowledge lives in the Brain Repository.
Open the PromptGallery →Questions and answers
Frequently asked questions
What is Promptopoly?
Promptopoly is a self-hosted LLM gateway. Calls to language models run through a single pk_ key instead of separate provider accounts. The budget is checked before every call; once it is exhausted the call is stopped rather than executed and billed.
How does Promptopoly stop an agent from blowing up the bill?
The cap applies before the call, not at billing time. An agent stuck in a loop hits a hard limit and is stopped. Every call is logged with model, token count and cost, so usage can be traced per project.
Which providers and models are supported?
OpenAI, Anthropic and Google (Gemini) through one OpenAI-compatible interface, plus the native Anthropic endpoint. Switching models requires no code change, because your application keeps talking to the same interface.
What is the Brain Repository?
The home for the knowledge your agents work with: notes with links and backlinks, full-text search, versioned prompts you can restore, and mirroring to Git. It is read through the same API as the model calls.
What is the PromptGallery?
A collection of approved prompt templates to get started. Any template can be copied into your own repository in one click and versioned there; templates with variables become a shareable form.
Is Promptopoly suitable as an engine for agent systems?
Yes, that is the main use case. Autonomous agents call models through the proxy and get budget limits, unified access and logging without having to implement any of it themselves. Operations run in Germany.
What does Promptopoly cost?
There is a free tier. Current pricing is on the pricing page.
Start for free
Free account, no credit card, no subscription. The gateway bills per use from a prepaid balance — and stops before your budget is exceeded.