llmproxy-k8s

Give your tenants API keys that forward to your real LLM providers, without running any state of your own.

How it works

#

1. You create Channel CRDs holding the real provider keys
2. You create a Group CRD per tenant, listing the channels they may use
3. Tenants create ProxyKey CRDs in their own namespaces, referencing their Group

Why

#

Every LLM gateway I looked at wanted Postgres and Redis to store what Kubernetes already stores. CRDs and Secrets are the database.

Get it

#

kubectl create namespace llmproxy-system
kubectl apply -f deploy/crds.yaml
kubectl apply -f deploy/operator.yaml