Integrating Google BigQuery
  • 01 Sep 2022
  • 3 Minutes to read

Integrating Google BigQuery


Article Summary

Using Google Big Query adds a $/£/€100 monthly charge to your Nexudus subscription per location enabled.

What You Need to Integrate Google Big Query

  • A Google Big Query account
  • A full unrestricted admin account in Nexudus

Step 1. Creating a Project in Google Big Query

The first step of the integration is to create a project for your location in Google BigQuery and copy your project ID.

Managing more than one location?

You can keep track of each individual location in the same project or create an individual project per location to keep them completely separate.

  1. Log in to your Google BigQuery account.

  2. Click Create Project.

  3. Name your project.

  4. Copy and save the project ID that is displayed under your project name.

You will need your project ID during Step 3 to complete the integration in Nexudus.

project id highlight(1)

  1. Select your organization from the drop-down list.

  2. Select the relevant location from the drop-down list.

  3. Click Create.

You've successfully created a project for your Nexudus location. Make sure you have your project ID saved for Step 3 of the integration process.

Step 2. Getting Your Google Big Query Credentials

Now that you've created your project, you need to get Google BigQuery credentials. These credentials are necessary to enable the integration in Nexudus.

  1. Go to https://console.cloud.google.com/apis/credentials.

  2. Click Create Credentials > Service Accounts.

  3. Add a meaningful title in the Service Account Name field.
    project name details(1)

  4. Click Done.
    You are redirected to the Credentials page.

  5. Click the service account you've just created in the Service Accounts section.
    json key details(1)

  6. Click the KEYS > Add Key.

  7. Select Create New Key in the drop-down list.

  8. Select JSON as the key type.

  9. Click Create.
    A JSON file is automatically downloaded.

  10. Click Close.

Your credentials are in a JSON file that you can find in the Downloads folder of your device. You can use the simple text editor that is already available on your device to open the file, namely Notepad in Windows or TextEdit in Mac.

  1. Open Notepad or TextEdit on your device.
  2. Click File > Open.
  3. Select All files from the drop-down menu next to the File Name field.
  4. Select your JSON credentials file and click Open.
    Your file includes a code snippet between curly braces.
    json key example(1)

Leave the file open in Notepad or TextEdit and move to Step 3.

Step 3. Enabling the Google Big Query Integration in Nexudus

Make sure you have the following information ready to copy and paste in Nexudus:

  • Your Google Big Query project ID
  • Your Google Big Query credentials file
Want to manage data from several locations from the same spot in Google BigQuery?

Use the same project ID and credentials in every location that you want to connect to Google BigQuery.

  1. Log in to dashboard.nexudus.com if you aren't already.

  2. Click Settings > Integrations > Google BigQuery.

  3. Enable the Google BigQuery integration toggle.

  4. Add your Google BigQuery Project ID.

  5. Remove the [obfuscated] element in the Credentials field.

  6. Add the code snippet from your credentials file in the Credentials field.

Make sure you add the entire code snippet, including the curly braces.
  1. Enable the relevant toggles, based on the data you want to transfer to Google BigQuery.

GoogleBigQuery_TogglesList.png

  1. Click the Save Changes button.

  2. Click Upload All Data in order to transfer the current data in your account to your Google BigQuery project.

Now that you've completed the integration process, you can see a menu named Nexudus in your Google BigQuery project. This menu includes a dataset for each of the type of record you decided to transfer from Nexudus to your Google BigQuery project.

folders in bigquery(1)

If you add several locations to the same project, each location will have its own menu and datasets.

If you create or update a Nexudus record that is part of the transfers included in the integration settings, the record is added or updated almost instantly in BigQuery.

Deleted Nexudus records can take up to 24 hours to be removed from your Google BigQuery project.

Was this article helpful?

Changing your password will log you out immediately. Use the new password to log back in.
First name must have atleast 2 characters. Numbers and special characters are not allowed.
Last name must have atleast 1 characters. Numbers and special characters are not allowed.
Enter a valid email
Enter a valid password
Your profile has been successfully updated.