com.google.cloud.dataflow.examples.cookbook

Class BigQueryTornadoes

java.lang.Object

com.google.cloud.dataflow.examples.cookbook.BigQueryTornadoes

public class BigQueryTornadoes
extends Object

An example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.

Concepts: Reading/writing BigQuery; counting a PCollection; user-defined PTransforms

Note: Before running this example, you must create a BigQuery dataset to contain your output table.

To execute this pipeline locally, specify general pipeline configuration:

   --project=YOUR_PROJECT_ID
 
 

and the BigQuery table for the output, with the form

   --output=YOUR_PROJECT_ID:DATASET_ID.TABLE_ID
 

To execute this pipeline using the Dataflow service, specify pipeline configuration:

   --project=YOUR_PROJECT_ID
   --stagingLocation=gs://YOUR_STAGING_DIRECTORY
   --runner=BlockingDataflowPipelineRunner
 
 

and the BigQuery table for the output:

   --output=YOUR_PROJECT_ID:DATASET_ID.TABLE_ID
 

The BigQuery input table defaults to clouddataflow-readonly:samples.weather_stations and can be overridden with --input.

Constructor Summary

Constructors

Constructor and Description
BigQueryTornadoes()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BigQueryTornadoes

public BigQueryTornadoes()

Method Detail

main

public static void main(String[] args)