...
Your use of this download is governed by Stonebranch’s Terms of Use, which are available at https://www.stonebranch.com/integration-hub/Terms-and-Privacy/Terms-of-Use/
...
Overview
This Universal Task allows Stonebranch users to schedule, trigger, monitor, and orchestrate the Google BigQuery process directly from Universal Controller.
Overview
This task uses Python modules google-cloud-bigquery and google-auth to make REST-API calls to Google BigQuery
This task will use the GCP Project ID, BigQuery SQL or Schema, Dataset ID, Job ID, Location, Table ID, Cloud Storage URI, and Source File Format as parameters of BigQuery function, and GCP KeyFile (API KEY) of Service account for authenticating the REST-API calls to Google BigQuery.
User can perform the following Google BigQuery operations:
BigQuery SQL
List dataset
List tables in dataset
View job information
Create a dataset
Load local file to a table
Load cloud storage data to a table
Export table data
...
Software Requirements for Universal Template and Universal Task
Requires Python 3.4 or higher. Tested with the Universal Agent bundled Python distribution.
Python modules required:
- google-cloud-bigquery
- google-auth
...
Universal Agent for Windows x64 Version 6.6 9 and later with Python options installed.
Universal Agent for Linux Version 6.6 9 and later with Python options installed.
...
Universal Controller Version 6.69.0.0 and later.
Software Requirements for the Application to be Scheduled
...
To use this downloadable Universal Template, you first must perform the following steps:
- This Universal Task requires the Resolvable Credentials feature. Check that the Resolvable Credentials Permitted system property has been set to true.
- Copy or Transfer To import the Universal Template file to a directory that can be accessed by the Universal Controller Tomcat user.
In the Universal Controller UI, select Configuration > Universal Templates to display the current list of Universal Templates.
Right-click any column header on the list to display an Action menu.
- Select Import from the menu, enter the directory containing the Universal Template file(s) that you want to import, and click OKinto your Controller, follow the instructions here.
- When the files have been imported successfully, refresh the Universal Templates list; the Universal Template will appear on the list.
Configure Google BigQuery Integration Universal Task
...
Examples for Google BigQuery Integration Universal Tasks
BigQuery SQL
List dataset
List Tables in dataset
View Job Information
Create a dataset
Load Local File to a Table
Load Cloud Storage Data to a Table
Export Table Data
Document References
This document references the following documents:
NameLocation | Description | |
|---|---|---|
Universal Templates | https://docs.stonebranch.com/confluence/display/UC70/Universal + Templates | User documentation for creating Universal Templates in the Universal Controller user interface. |
Universal Tasks | https://docs.stonebranch.com/confluence/display/UC70/Universal + Tasks | User documentation for creating Universal Tasks in the Universal Controller user interface. |
...