Back to feed
Dev.to
Dev.to
6/29/2026
Building an AI Cloud Cost Intelligence Platform That Doesn't Let AI Make Infrastructure Decisions

Building an AI Cloud Cost Intelligence Platform That Doesn't Let AI Make Infrastructure Decisions

Short summary

A developer built an Azure cost optimization platform by rejecting the common AI architecture where LLMs make infrastructure decisions. Instead, the system uses deterministic rules backed by verified APIs, with AI only explaining recommendations already validated. The pattern—resource discovery → real metrics → actual pricing → business rules → LLM explanation—prevents hallucinated commands and non-existent VM SKUs, making it replicable for AWS and GCP.

  • LLM hallucinations were causing bad infrastructure recommendations (non-existent VM SKUs, invalid Azure CLI commands)
  • Solution: split the system so AI only explains decisions made by deterministic rules and verified APIs
  • Pattern is replicable across Azure, AWS, and GCP for cost optimization and FinOps platforms

Generated with AI, which can make mistakes.

Is this a good recommendation for you?

Comments

Failed to load comments. Please try again.

Explore more