ploosh.

Documentation

This connector allows you to connect to a bigquery instance and execute SQL queries.

Connection configuration

Definition

NameMandatoryDefaultDescription
credentialsnoThe authentication use a google keyfile encoded in base 64
if credentials are not provided, the connector will use the default credentials from the environment for exemple by the gcloud CLI or the environment variable GOOGLEAPPLICATIONCREDENTIALS

⚠️ it's highly recommended to use a parameter to pass the credentials value

Example

bigquery_example:
  type: bigquery
  credentials: $var.gbqsampletoken

Test case configuration

Definition

NameMandatoryDefaultDescription
connectionyesThe connection to use
queryyesThe query to execute to the database

Example

Example BigQuery:
  source:
    connection: bigquery_example
    type: bigquery
    query: | 
        select * 
            from rh.employees
            where hire_date < "2000-01-01"
  expected:
    type: csv
    path: data/employeesbefore2000.csv