BigQuery Telemetry Integration

Overview

Integrate your Google Cloud Platform (GCP) BigQuery data directly with Finout to automatically fetch and update telemetry data daily. By granting Finout secure, controlled access to your relevant BigQuery datasets and tables, you enable enhanced cost visibility, showback capabilities, and advanced cost allocation strategies. This integration allows Finout to retrieve your business metrics and convert them into structured telemetry for KPI Center, custom cost centers, or shared cost allocation within the platform.

Connect BiqQuery Telemetry

1. Create or Use a Service Account

Set up a dedicated GCP service account for Finout. This provides a secure and manageable identity for Finout within your GCP project.

1. Navigate to the IAM & Admin section in your GCP console.

   
2. Select Service Accounts. From here, you can either create a new service account specifically for Finout or identify an existing one that you wish to use where new or existing service accounts can be managed.

2. Generate and Share Credentials JSON File

For Finout to securely authenticate with your GCP project, you need to generate a JSON credentials file from the service account.

1. Locate the dedicated service account created or chosen in Step 1.

   
2. Click on the rightmost side of that service account, and select Manage keys. You are brought to create a new key.

   

3. Click Add key and then choose Create new key. The Create private key popup appears.

   

4. Select JSON as the key type. A JSON file containing the necessary authentication keys will be downloaded to your device.

5. Share this file with Finout support in a secure way.

3. Assign IAM Roles to the Service Account

To enable Finout to view and extract data from BigQuery, specific Identity and Access Management (IAM) roles must be granted to the service account.

1. Navigate back to the Service Account chosen in Step 1.

   
2. Click on to the rightmost side of the service account and select Manage permissions. The Manage service account permissions option appears.

   
3. Click Manage access. You are brought to Assign roles.

   
4. Grant two essential permissions by clicking Add role. The BigQuery roles appear.

   
5. Choose the BigQuery role.

   • BigQuery Data Viewer: This role provides read-only access to view BigQuery datasets, schemas, and table content.

   • BigQuery Job User: This role grants the permission to execute the queries required for data extraction from your BigQuery tables.

6. Click Save.

4. Restrict Access to a Specific Table (Optional)

For enhanced security and granular control, you have the option to limit the service account's access to only one specific BigQuery table, rather than an entire dataset.

1. Navigate to IAM & Admin > IAM in your GCP console and click . The Assign roles appears.

   
2. Click Add IAM condition to apply a resource-level condition to the IAM role. The condition editor appears.

   
3. Add a Title and Description.

4. In the Condition editor, define the target table using the following precise format in the Condition editor tab: resource.name.startsWith(“projects/<project-id>/datasets/<dataset-id>/tables/<table-id>”)

For more information on resource-level IAM conditions, see the GCP documentation.

5. Share BigQuery Access Details with Finout

Once all roles and permissions are correctly configured, you need to provide Finout with the necessary details to initiate data syncing.

• Securely share the following credentials with your designated Finout contact:

◦ Project ID

◦ Dataset ID

◦ Table ID

◦ Credentials JSON file - generated in Step 2.

These credentials ensure that Finout gains access only to the specified BigQuery table and can securely sync the data into Finout’s internal environment.

Result: Upon successful receipt of these details, your BigQuery data will typically be available in Finout within 24 hours, enabling you to create KPIs, define cost center logic, and implement advanced cost allocation strategies.