Onboard Databricks to CloudHiro cost optimization platform
To onboard your Databricks environment, we require the following access and configuration. Please read until the end before you start.
Azure Databricks onboarding
Please grant our Costi service principal access to your Databricks account.
In your Databricks account console, navigate to User management → Service principals and add the Costi service principal provided by CloudHiro.
Make sure the service principal is granted account-level access so it can be assigned to workspaces and Unity Catalog.
Assign full SELECT permissions to the Costi service principal on the following Unity Catalog System Tables:
system.billing.usagesystem.compute.clusterssystem.compute.node_timelinesystem.compute.warehousessystem.query.historyExample SQL to grant access (run from a SQL Warehouse or notebook):
GRANT USE CATALOG ON CATALOG system TO `costi-service-principal`; GRANT USE SCHEMA ON SCHEMA system.billing TO `costi-service-principal`; GRANT USE SCHEMA ON SCHEMA system.compute TO `costi-service-principal`; GRANT USE SCHEMA ON SCHEMA system.query TO `costi-service-principal`; GRANT SELECT ON TABLE system.billing.usage TO `costi-service-principal`; GRANT SELECT ON TABLE system.compute.clusters TO `costi-service-principal`; GRANT SELECT ON TABLE system.compute.node_timeline TO `costi-service-principal`; GRANT SELECT ON TABLE system.compute.warehouses TO `costi-service-principal`; GRANT SELECT ON TABLE system.query.history TO `costi-service-principal`;
Note
The relevant system schemas must be enabled at the account level. See the Databricks System Tables documentation for instructions on enabling each schema.
Assign the Costi service principal to a designated workspace where it has permissions to connect to a SQL Warehouse to execute the queries against these tables.
In the account console, open Workspaces → [your workspace] → Permissions and add the Costi service principal as a workspace user.
Create or pick a SQL Warehouse the service principal will use. In the warehouse Permissions tab, grant the service principal Can use access.
Share the following with CloudHiro to complete the connection:
- Databricks account ID
- Workspace URL (e.g.
https://<workspace>.cloud.databricks.com) - SQL Warehouse HTTP path
Please contact CloudHiro's CSM for more information.
That's it!
We are done setting up. You can now ask your partner for a tour of CloudHiro and the CloudHiro visualizer.