To connect Databricks to the Finout platform, please refer to the original Databricks guide for exporting billable usage in a CSV format: https://docs.databricks.com/administration-guide/account-settings/billable-usage-delivery.html
In this documentation, you will be guided on how to create an S3 bucket that is continuously updated with Databricks usage reports.
Grant Finout Access To Your Bucket
After creating the bucket, you need to grant Finout access to your bucket by creating an IAM role.
Copy your
“external-id”from the Finout console, or use a random one, preferably in the format offinout-XXXXXXXClick creating a new cross-account role in IAM to create a role for Another AWS account.
In the Account ID field, enter:
277411487094.Select the Require external ID option, and enter the
“external-id”you got from the previous section.Click Next until the review screen is displayed. Then configure it as shown below and click Next.
Go to your newly created role.
Copy the
Role ARNand paste it into the Finout console.Click Add permissions and select Create inline policy.
Select JSON, and paste this inside - While changing <BUCKET_NAME> with the bucket you create in the first section (or your existing CUR bucket, if you already have AWS as a Cost Center in Finout)
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"s3:Get*",
"s3:List*"
],
"Resource": "arn:aws:s3:::<BUCKET_NAME>/*"
},
{
"Effect": "Allow",
"Action": [
"s3:Get*",
"s3:List*"
],
"Resource": "arn:aws:s3:::<BUCKET_NAME>"
}
]
}Click Next until the review screen is displayed, then name it
finout-access-policy.Click on Create policy to have your policy created for the IAM role.
Send Finout the following details:
The newly created role
The external ID
Bucket name
Path in the bucket
Region
Provide Finout with the cost per DBU for each Databricks service
Still need help? Please feel free to reach out to our team at [email protected].