Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Your use of this download is governed by Stonebranch’s Terms of Use, which are available at https://www.stonebranch.com/integration-hub/Terms-and-Privacy/Terms-of-Use/

...

Overview

This Universal Task allows Stonebranch users to schedule, trigger, monitor, and orchestrate the Google BigQuery process directly from Universal Controller.  

Overview

  • This task uses Python modules google-cloud-bigquery and google-auth to make REST-API calls to Google BigQuery

  • This task will use the GCP Project ID, BigQuery SQL or Schema, Dataset ID, Job ID, Location, Table ID, Cloud Storage URI, and Source File Format as parameters of BigQuery function, and GCP KeyFile (API KEY) of Service account for authenticating the REST-API calls to Google BigQuery.

  • User can perform the following Google BigQuery operations:

    • BigQuery SQL

    • List dataset

    • List tables in dataset

    • View job information

    • Create a dataset

    • Load local file to a table

    • Load cloud storage data to a table

    • Export table data

...

Software Requirements for /wiki/spaces/UC71x/pages/5178050 and /wiki/spaces/UC71x/pages/5180675 Universal Template and Universal Task

  • Requires Python 3.4 or higher. Tested with the Universal Agent bundled Python distribution.

  • Python modules required:

    • google-cloud-bigquery
    • google-auth

...

  • Universal Agent for Windows x64 Version 6.6 9 and later with Python options installed.

  • Universal Agent for Linux Version 6.6 9 and later with Python options installed.

...

  • Universal Controller Version 6.69.0.0 and later.

Software Requirements for the Application to be Scheduled

...

To use this downloadable Universal Template, you first must perform the following steps:

  1. This Universal Task requires the /wiki/spaces/UC71x/pages/5178443 Resolvable Credentials feature. Check that the/wiki/spaces/UC71x/pages/5177877 Resolvable Credentials Permitted system property has been set to true.
  2. Copy or Transfer the Universal Template file to a directory that can be accessed by the Universal Controller Tomcat user.

  3. In the Universal Controller UI, select Configuration > Universal Templates to display the current list of /wiki/spaces/UC71x/pages/5178054 Universal Templates.

  4. Right-click any column header on the list to display an Action menu.
  5. Select Import from the menu, enter the directory containing the Universal Template file(s) that you want to import, and click OK.

...

This document references the following documents:

Name

Location

Description

Universal Templates

https://docs.stonebranch.com/confluence/display/

UC71x

UC72x/Universal+Templates

User documentation for creating Universal Templates in the Universal Controller user interface.

Universal Tasks

https://docs.stonebranch.com/confluence/display/

UC71x

UC72x/Universal+Tasks

User documentation for creating Universal Tasks in the Universal Controller user interface.