Databricks on AWS isolates Prod Dev Sandbox with Unity Catalog

Short summary

Databricks on AWS architecture using three core principles: isolate production data (service principals write only, humans read-only), never copy production data (read in-place via Unity Catalog and Delta Sharing), and give analysts sandbox catalogs for free-write experimentation. Uses Medallion layers (landing→cleaned→integrated→business) with zone-based RBAC governing prod, dev, and sandbox catalogs within a single Unity Catalog metastore.

• •Production writes restricted to service principals; humans get read-only access to prevent accidental mutations
• •Data never copied; analysts and engineers read production data in-place via Unity Catalog or Delta Sharing to save storage
• •Sandbox catalogs per analyst for free-write experimentation, protecting production from expensive queries and test data

Generated with AI, which can make mistakes.