com.google.cloud.dataflow.examples

Class StreamingWordExtract

java.lang.Object

com.google.cloud.dataflow.examples.StreamingWordExtract

public class StreamingWordExtract
extends java.lang.Object

A streaming Dataflow Example using BigQuery output.

This pipeline example lines of text from a PubSub topic, splits each line into individual words, capitalizes those words, and writes the output to a BigQuery table.

To run this example using the Dataflow service, you must provide an input pubsub topic and an output BigQuery table, using the --inputTopic --dataset and --table options. Since this is a streaming pipeline that never completes, select the non-blocking pipeline runner --runner=DataflowPipelineRunner.

Constructor Summary

Constructors

Constructor and Description
StreamingWordExtract()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(java.lang.String[] args) Sets up and starts streaming pipeline.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamingWordExtract

public StreamingWordExtract()

Method Detail

main

public static void main(java.lang.String[] args)

Sets up and starts streaming pipeline.