Insert All
|
|||||
|
|
||||
Streams data into BigQuery one record at a time without needing to run a load job. Requires the WRITER dataset role
Authorization
To use this building block you will have to grant access to at least one of the following scopes:
- View and manage your data in Google BigQuery
- Insert data into Google BigQuery
- View and manage your data across Google Cloud Platform services
Input
This building block consumes 11 input parameters
| Name | Format | Description |
|---|---|---|
projectId Required |
STRING |
Project ID of the destination table |
datasetId Required |
STRING |
Dataset ID of the destination table |
tableId Required |
STRING |
Table ID of the destination table |
ignoreUnknownValues |
BOOLEAN |
[Optional] Accept rows that contain values that do not match the schema. The unknown values are ignored. Default is false, which treats unknown values as errors |
skipInvalidRows |
BOOLEAN |
[Optional] Insert all valid rows of a request, even if invalid rows exist. The default value is false, which causes the entire request to fail if any invalid rows exist |
rows[] |
OBJECT |
|
rows[].insertId |
STRING |
[Optional] A unique ID for each row. BigQuery uses this property to detect duplicate insertion requests on a best-effort basis |
rows[].json |
OBJECT |
Represents a single JSON object |
rows[].json.customKey |
ANY |
|
kind |
STRING |
The resource type of the response |
templateSuffix |
STRING |
If specified, treats the destination table as a base template, and inserts the rows into an instance table named "{destination}{templateSuffix}". BigQuery will manage creation of the instance table, using the schema of the base template table. See https://cloud.google.com/bigquery/streaming-data-into-bigquery#template-tables for considerations when working with templates tables |
= Parameter name
= Format
|
projectId STRING Required Project ID of the destination table |
|
datasetId STRING Required Dataset ID of the destination table |
|
tableId STRING Required Table ID of the destination table |
|
ignoreUnknownValues BOOLEAN [Optional] Accept rows that contain values that do not match the schema. The unknown values are ignored. Default is false, which treats unknown values as errors |
|
skipInvalidRows BOOLEAN [Optional] Insert all valid rows of a request, even if invalid rows exist. The default value is false, which causes the entire request to fail if any invalid rows exist |
|
rows[] OBJECT |
|
rows[].insertId STRING [Optional] A unique ID for each row. BigQuery uses this property to detect duplicate insertion requests on a best-effort basis |
|
rows[].json OBJECT Represents a single JSON object |
|
rows[].json.customKey ANY |
|
kind STRING The resource type of the response |
|
templateSuffix STRING If specified, treats the destination table as a base template, and inserts the rows into an instance table named "{destination}{templateSuffix}". BigQuery will manage creation of the instance table, using the schema of the base template table. See https://cloud.google.com/bigquery/streaming-data-into-bigquery#template-tables for considerations when working with templates tables |
Output
This building block provides 8 output parameters
| Name | Format | Description |
|---|---|---|
insertErrors[] |
OBJECT |
|
insertErrors[].errors[] |
OBJECT |
|
insertErrors[].errors[].reason |
STRING |
A short error code that summarizes the error |
insertErrors[].errors[].message |
STRING |
A human-readable description of the error |
insertErrors[].errors[].location |
STRING |
Specifies where the error occurred, if present |
insertErrors[].errors[].debugInfo |
STRING |
Debugging information. This property is internal to Google and should not be used |
insertErrors[].index |
INTEGER |
The index of the row that error applies to |
kind |
STRING |
The resource type of the response |
= Parameter name
= Format
|
insertErrors[] OBJECT |
|
insertErrors[].errors[] OBJECT |
|
insertErrors[].errors[].reason STRING A short error code that summarizes the error |
|
insertErrors[].errors[].message STRING A human-readable description of the error |
|
insertErrors[].errors[].location STRING Specifies where the error occurred, if present |
|
insertErrors[].errors[].debugInfo STRING Debugging information. This property is internal to Google and should not be used |
|
insertErrors[].index INTEGER The index of the row that error applies to |
|
kind STRING The resource type of the response |