
# "Complete" Examples

This directory contains end-to-end example pipelines that perform complex data processing tasks. They include:

- AutoComplete (https://github.com/GoogleCloudPlatform/DataflowJavaSDK/blob/master/examples/src/main/java/com/google/cloud/dataflow/examples/complete/AutoComplete.java)
  — An example that computes the most popular hash tags for every
  prefix, which can be used for auto-completion. Demonstrates how to use the
  same pipeline in both streaming and batch, combiners, and composite
  transforms.
  
- StreamingWordExtract (https://github.com/GoogleCloudPlatform/DataflowJavaSDK/blob/master/examples/src/main/java/com/google/cloud/dataflow/examples/complete/StreamingWordExtract.java)
  — A streaming pipeline example that inputs lines of text from a Cloud
  Pub/Sub topic, splits each line into individual words, capitalizes those
  words, and writes the output to a BigQuery table.

- TfIdf (https://github.com/GoogleCloudPlatform/DataflowJavaSDK/blob/master/examples/src/main/java/com/google/cloud/dataflow/examples/complete/TfIdf.java)
  — An example that computes a basic TF-IDF search table for a directory or
  Cloud Storage prefix. Demonstrates joining data, side inputs, and logging.

- TopWikipediaSessions (https://github.com/GoogleCloudPlatform/DataflowJavaSDK/blob/master/examples/src/main/java/com/google/cloud/dataflow/examples/complete/TopWikipediaSessions.java)
  — An example that reads Wikipedia edit data from Cloud Storage and
  computes the user with the longest string of edits separated by no more than
  an hour within each month. Demonstrates using Cloud Dataflow
  Windowing to perform time-based aggregations of data.

- TrafficMaxLaneFlow (https://github.com/GoogleCloudPlatform/DataflowJavaSDK/blob/master/examples/src/main/java/com/google/cloud/dataflow/examples/complete/TrafficMaxLaneFlow.java)
  — A streaming Cloud Dataflow example using BigQuery output in the
  traffic sensor domain. Demonstrates the Cloud Dataflow streaming
  runner, sliding windows, Cloud Pub/Sub topic ingestion, the use of the
  AvroCoder to encode a custom class, and custom
  Combine transforms.

- TrafficRoutes (https://github.com/GoogleCloudPlatform/DataflowJavaSDK/blob/master/examples/src/main/java/com/google/cloud/dataflow/examples/complete/TrafficRoutes.java)
  — A streaming Cloud Dataflow example using BigQuery output in the
  traffic sensor domain. Demonstrates the Cloud Dataflow streaming
  runner, GroupByKey, keyed state, sliding windows, and Cloud
  Pub/Sub topic ingestion.

See the [documentation](https://cloud.google.com/dataflow/getting-started) and the [Examples
README](../../../../../../../../../README.md) for
information about how to run these examples.
