...

Your use of this download is governed by Stonebranch’s Terms of Use, which are available at https://www.stonebranch.com/integration-hub/Terms-and-Privacy/Terms-of-Use/

...

Overview

This Universal Task allows Stonebranch users to schedule, trigger, monitor, and orchestrate the Google BigQuery process directly from Universal Controller.  

...

• This task uses Python modules google-cloud-bigquery and google-auth to make REST-API calls to Google BigQuery

• This task will use the GCP Project ID, BigQuery SQL or Schema, Dataset ID, Job ID, Location, Table ID, Cloud Storage URI, and Source File Format as parameters of BigQuery function, and GCP KeyFile (API KEY) of Service account for authenticating the REST-API calls to Google BigQuery.

• User can perform the following Google BigQuery operations:

  • BigQuery SQL

  • List dataset

  • List tables in dataset

  • View job information

  • Create a dataset

  • Load local file to a table

  • Load cloud storage data to a table

  • Export table data

...

Software Requirements for /wiki/spaces/UC71x/pages/5178050 and /wiki/spaces/UC71x/pages/5180675 Universal Template and Universal Task

• Requires Python 3.4 or higher. Tested with the Universal Agent bundled Python distribution.

• Python modules required:

  • google-cloud-bigquery
  • google-auth

...

• Universal Agent for Windows x64 Version 6.6 9 and later with Python options installed.

• Universal Agent for Linux Version 6.6 9 and later with Python options installed.

...

• Universal Controller Version 6.69.0.0 and later.

Software Requirements for the Application to be Scheduled

...

To use this downloadable Universal Template, you first must perform the following steps:

1. This Universal Task requires the /wiki/spaces/UC71x/pages/5178443 Resolvable Credentials feature. Check that the/wiki/spaces/UC71x/pages/5177877 Resolvable Credentials Permitted system property has been set to true.
2. Copy or Transfer To import the Universal Template file to a directory that can be accessed by the Universal Controller Tomcat user.

3. In the Universal Controller UI, select Configuration > Universal Templates to display the current list of /wiki/spaces/UC71x/pages/5178054.

4. Right-click any column header on the list to display an Action menu.

5. Select Import from the menu, enter the directory containing the Universal Template file(s) that you want to import, and click OKinto your Controller, follow the instructions here.
6. When the files have been imported successfully, refresh the Universal Templates list; the Universal Template will appear on the list.

Configure Google BigQuery Integration Universal Task

...

This document references the following documents:

...