com.google.cloud.bigquery

Class LoadJobConfiguration

java.lang.Object

com.google.cloud.bigquery.JobConfiguration

com.google.cloud.bigquery.LoadJobConfiguration

All Implemented Interfaces:

LoadConfiguration, Serializable

public final class LoadJobConfiguration
extends JobConfiguration
implements LoadConfiguration

Google BigQuery load job configuration. A load job loads data from one of several formats into a table. Data is provided as URIs that point to objects in Google Cloud Storage. Load job configurations have JobConfiguration.Type.LOAD type.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LoadJobConfiguration.Builder

Method Summary

Methods

Modifier and Type	Method and Description
static LoadJobConfiguration.Builder	builder(TableId destinationTable, List<String> sourceUris) Creates a builder for a BigQuery Load Job configuration given the destination table and source URIs.
static LoadJobConfiguration.Builder	builder(TableId destinationTable, List<String> sourceUris, FormatOptions format) Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URIs.
static LoadJobConfiguration.Builder	builder(TableId destinationTable, String sourceUri) Creates a builder for a BigQuery Load Job configuration given the destination table and source URI.
static LoadJobConfiguration.Builder	builder(TableId destinationTable, String sourceUri, FormatOptions format) Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URI.
JobInfo.CreateDisposition	createDisposition() Returns whether the job is allowed to create new tables.
CsvOptions	csvOptions() Returns additional properties used to parse CSV data (used when LoadConfiguration.format() is set to CSV).
TableId	destinationTable() Returns the destination table to load the data into.
boolean	equals(Object obj)
String	format() Returns the format of the data files.
int	hashCode()
Boolean	ignoreUnknownValues() Returns whether BigQuery should allow extra values that are not represented in the table schema.
Integer	maxBadRecords() Returns the maximum number of bad records that BigQuery can ignore when running the job.
static LoadJobConfiguration	of(TableId destinationTable, List<String> sourceUris) Returns a BigQuery Load Job Configuration for the given destination table and source URIs.
static LoadJobConfiguration	of(TableId destinationTable, List<String> sourceUris, FormatOptions format) Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.
static LoadJobConfiguration	of(TableId destinationTable, String sourceUri) Returns a BigQuery Load Job Configuration for the given destination table and source URI.
static LoadJobConfiguration	of(TableId destinationTable, String sourceUri, FormatOptions format) Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.
List<String>	projectionFields() Returns which entity properties to load into BigQuery from a Cloud Datastore backup.
Schema	schema() Returns the schema for the destination table, if set.
List<String>	sourceUris() Returns the fully-qualified URIs that point to source data in Google Cloud Storage (e.g.
LoadJobConfiguration.Builder	toBuilder() Returns a builder for the object.
JobInfo.WriteDisposition	writeDisposition() Returns the action that should occur if the destination table already exists.

Methods inherited from class com.google.cloud.bigquery.JobConfiguration

toString, type

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Method Detail

destinationTable

public TableId destinationTable()

Description copied from interface: LoadConfiguration

Returns the destination table to load the data into.

Specified by:

destinationTable in interface LoadConfiguration

createDisposition

public JobInfo.CreateDisposition createDisposition()

Description copied from interface: LoadConfiguration

Returns whether the job is allowed to create new tables.

Specified by:

createDisposition in interface LoadConfiguration

See Also:

Create Disposition

writeDisposition

public JobInfo.WriteDisposition writeDisposition()

Description copied from interface: LoadConfiguration

Returns the action that should occur if the destination table already exists.

Specified by:

writeDisposition in interface LoadConfiguration

See Also:

Write Disposition

csvOptions

public CsvOptions csvOptions()

Description copied from interface: LoadConfiguration

Returns additional properties used to parse CSV data (used when LoadConfiguration.format() is set to CSV). Returns null if not set.

Specified by:

csvOptions in interface LoadConfiguration

maxBadRecords

public Integer maxBadRecords()

Description copied from interface: LoadConfiguration

Returns the maximum number of bad records that BigQuery can ignore when running the job. If the number of bad records exceeds this value, an invalid error is returned in the job result. By default no bad record is ignored.

Specified by:

maxBadRecords in interface LoadConfiguration

schema

public Schema schema()

Description copied from interface: LoadConfiguration

Returns the schema for the destination table, if set. Returns null otherwise.

Specified by:

schema in interface LoadConfiguration

format

public String format()

Description copied from interface: LoadConfiguration

Returns the format of the data files.

Specified by:

format in interface LoadConfiguration

ignoreUnknownValues

public Boolean ignoreUnknownValues()

Description copied from interface: LoadConfiguration

Returns whether BigQuery should allow extra values that are not represented in the table schema. If true, the extra values are ignored. If true, records with extra columns are treated as bad records, and if there are too many bad records, an invalid error is returned in the job result. By default unknown values are not allowed.

Specified by:

ignoreUnknownValues in interface LoadConfiguration

projectionFields

public List<String> projectionFields()

Description copied from interface: LoadConfiguration

Returns which entity properties to load into BigQuery from a Cloud Datastore backup. This field is only used if the source format is set to DATASTORE_BACKUP. Property names are case sensitive and must be top-level properties. If no properties are specified, BigQuery loads all properties. If any named property isn't found in the Cloud Datastore backup, an invalid error is returned in the job result.

Specified by:

projectionFields in interface LoadConfiguration

sourceUris

public List<String> sourceUris()

Returns the fully-qualified URIs that point to source data in Google Cloud Storage (e.g. gs://bucket/path). Each URI can contain one '*' wildcard character and it must come after the 'bucket' name.

toBuilder

public LoadJobConfiguration.Builder toBuilder()

Description copied from class: JobConfiguration

Returns a builder for the object.

Specified by:

toBuilder in interface LoadConfiguration

Specified by:

toBuilder in class JobConfiguration

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

builder

public static LoadJobConfiguration.Builder builder(TableId destinationTable,
                                   List<String> sourceUris)

Creates a builder for a BigQuery Load Job configuration given the destination table and source URIs.

builder

public static LoadJobConfiguration.Builder builder(TableId destinationTable,
                                   String sourceUri)

Creates a builder for a BigQuery Load Job configuration given the destination table and source URI.

builder

public static LoadJobConfiguration.Builder builder(TableId destinationTable,
                                   List<String> sourceUris,
                                   FormatOptions format)

Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URIs.

builder

public static LoadJobConfiguration.Builder builder(TableId destinationTable,
                                   String sourceUri,
                                   FormatOptions format)

Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URI.

of

public static LoadJobConfiguration of(TableId destinationTable,
                      List<String> sourceUris)

Returns a BigQuery Load Job Configuration for the given destination table and source URIs.

of

public static LoadJobConfiguration of(TableId destinationTable,
                      String sourceUri)

Returns a BigQuery Load Job Configuration for the given destination table and source URI.

of

public static LoadJobConfiguration of(TableId destinationTable,
                      List<String> sourceUris,
                      FormatOptions format)

Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.

of

public static LoadJobConfiguration of(TableId destinationTable,
                      String sourceUri,
                      FormatOptions format)

Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.