Back to feed
Dev.to
Dev.to
7/15/2026
I Built an OpenAI-Compatible Gateway to Control LLM Costs

I Built an OpenAI-Compatible Gateway to Control LLM Costs

Short summary

An indie developer built CostLLM, an OpenAI-compatible API gateway that sits between your code and LLM providers to give per-project cost visibility, hard budget caps, and rate limiting via virtual API keys. It works as a drop-in replacement for any OpenAI SDK by changing only the base URL. The stack includes FastAPI, Redis, PostgreSQL, and supports DeepSeek models with a free tier offering $10 signup credit.

  • •CostLLM is an OpenAI-compatible gateway for per-project LLM cost control
  • •Virtual API keys enable usage tracking, budget caps, and rate limiting
  • •Drop-in compatible with any OpenAI SDK; free tier includes $10 credit

Generated with AI, which can make mistakes.

#ai-tools#open-source
Read full article at Dev.to

Is this a good recommendation for you?

Comments

Failed to load comments. Please try again.

Explore more

I Built an Open-Source API Gateway for 100+ AI Models at $0.14/M Tokens
Dev.to
The original title is "The LLM Cost Death Spiral (And How I Got Out of It)"
Dev.to
The original title is "AICostPass: A tool for tracking AI API spending in real time"
Dev.to
The Complete Guide to OpenAI-Compatible APIs for Chinese LLMs
Dev.to