Dev.to
6/29/2026

Building an AI Cloud Cost Intelligence Platform That Doesn't Let AI Make Infrastructure Decisions
Short summary
A developer built an Azure cost optimization platform by rejecting the common AI architecture where LLMs make infrastructure decisions. Instead, the system uses deterministic rules backed by verified APIs, with AI only explaining recommendations already validated. The pattern—resource discovery → real metrics → actual pricing → business rules → LLM explanation—prevents hallucinated commands and non-existent VM SKUs, making it replicable for AWS and GCP.
- •LLM hallucinations were causing bad infrastructure recommendations (non-existent VM SKUs, invalid Azure CLI commands)
- •Solution: split the system so AI only explains decisions made by deterministic rules and verified APIs
- •Pattern is replicable across Azure, AWS, and GCP for cost optimization and FinOps platforms
Generated with AI, which can make mistakes.
Is this a good recommendation for you?



