A B C D F G I J L M P R S T W

A

apply(Iterable<String>) - Method in class com.google.cloud.dataflow.examples.CombinePerKeyExamples.ConcatWords

apply(PCollection<KV<URI, String>>) - Method in class com.google.cloud.dataflow.examples.TfIdf.ComputeTfIdf

apply(PInput) - Method in class com.google.cloud.dataflow.examples.TfIdf.ReadDocuments

apply(PCollection<KV<String, KV<URI, Double>>>) - Method in class com.google.cloud.dataflow.examples.TfIdf.WriteTfIdf

apply(PCollection<String>) - Method in class com.google.cloud.dataflow.examples.WindowingWordCount.CountWords

apply(PCollection<String>) - Method in class com.google.cloud.dataflow.examples.WordCount.CountWords

B

BigQueryTornadoes - Class in com.google.cloud.dataflow.examples

An example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.

BigQueryTornadoes() - Constructor for class com.google.cloud.dataflow.examples.BigQueryTornadoes

C

com.google.cloud.dataflow.examples - package com.google.cloud.dataflow.examples

CombinePerKeyExamples - Class in com.google.cloud.dataflow.examples

An example that reads the public 'Shakespeare' data, and for each word in the dataset that is over a given length, generates a string containing the list of play names in which that word appears, and saves this information to a bigquery table.

CombinePerKeyExamples() - Constructor for class com.google.cloud.dataflow.examples.CombinePerKeyExamples

CombinePerKeyExamples.ConcatWords - Class in com.google.cloud.dataflow.examples

A 'combine function' used with the Combine.perKey transform.

CombinePerKeyExamples.ConcatWords() - Constructor for class com.google.cloud.dataflow.examples.CombinePerKeyExamples.ConcatWords

create(PipelineOptions) - Method in class com.google.cloud.dataflow.examples.WordCount.Options.OutputFactory

D

DatastoreWordCount - Class in com.google.cloud.dataflow.examples

A WordCount example using DatastoreIO.

DatastoreWordCount() - Constructor for class com.google.cloud.dataflow.examples.DatastoreWordCount

DatastoreWordCount.Options - Interface in com.google.cloud.dataflow.examples

Options supported by DatastoreWordCount.

DeDupExample - Class in com.google.cloud.dataflow.examples

This example uses as input Shakespeare's plays as plaintext files, and will remove any duplicate lines across all the files.

DeDupExample() - Constructor for class com.google.cloud.dataflow.examples.DeDupExample

F

FilterExamples - Class in com.google.cloud.dataflow.examples

This is an example that demonstrates several approaches to filtering, and use of the Mean transform.

FilterExamples() - Constructor for class com.google.cloud.dataflow.examples.FilterExamples

G

getDataset() - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

getDefaultOutputCoder() - Method in class com.google.cloud.dataflow.examples.TfIdf.ReadDocuments

getInput() - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

getInput() - Method in interface com.google.cloud.dataflow.examples.WordCount.Options

getKind() - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

getNumShards() - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

getNumShards() - Method in interface com.google.cloud.dataflow.examples.WordCount.Options

By default (numShards == 0), the system will choose the shard count.

getOutput() - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

getOutput() - Method in interface com.google.cloud.dataflow.examples.WordCount.Options

I

isReadOnly() - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

J

JoinExamples - Class in com.google.cloud.dataflow.examples

This example shows how to do a join on two collections.

JoinExamples() - Constructor for class com.google.cloud.dataflow.examples.JoinExamples

L

listInputDocuments(TfIdf.Options) - Static method in class com.google.cloud.dataflow.examples.TfIdf

Lists documents contained beneath the options.input prefix/directory.

M

main(String[]) - Static method in class com.google.cloud.dataflow.examples.BigQueryTornadoes

main(String[]) - Static method in class com.google.cloud.dataflow.examples.CombinePerKeyExamples

main(String[]) - Static method in class com.google.cloud.dataflow.examples.DatastoreWordCount

Main function.

main(String[]) - Static method in class com.google.cloud.dataflow.examples.DeDupExample

main(String[]) - Static method in class com.google.cloud.dataflow.examples.FilterExamples

main(String[]) - Static method in class com.google.cloud.dataflow.examples.JoinExamples

main(String[]) - Static method in class com.google.cloud.dataflow.examples.MaxPerKeyExamples

main(String[]) - Static method in class com.google.cloud.dataflow.examples.PubsubFileInjector

Sets up and starts streaming pipeline.

main(String[]) - Static method in class com.google.cloud.dataflow.examples.StreamingWordExtract

Sets up and starts streaming pipeline.

main(String[]) - Static method in class com.google.cloud.dataflow.examples.TfIdf

main(String[]) - Static method in class com.google.cloud.dataflow.examples.TopWikipediaSessions

main(String[]) - Static method in class com.google.cloud.dataflow.examples.WindowingWordCount

main(String[]) - Static method in class com.google.cloud.dataflow.examples.WordCount

MaxPerKeyExamples - Class in com.google.cloud.dataflow.examples

An example that reads the public samples of weather data from BigQuery, and finds the maximum temperature ('mean_temp') for each month.

MaxPerKeyExamples() - Constructor for class com.google.cloud.dataflow.examples.MaxPerKeyExamples

P

PubsubFileInjector - Class in com.google.cloud.dataflow.examples

A batch Dataflow pipeline for injecting a set of GCS files into a PubSub topic line by line.

PubsubFileInjector() - Constructor for class com.google.cloud.dataflow.examples.PubsubFileInjector

R

readDataFromDatastore(DatastoreWordCount.Options) - Static method in class com.google.cloud.dataflow.examples.DatastoreWordCount

An example which creates a pipeline to do DatastoreIO.Read from Datastore.

S

setDataset(String) - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

setInput(String) - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

setInput(String) - Method in interface com.google.cloud.dataflow.examples.WordCount.Options

setKind(String) - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

setNumShards(int) - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

setNumShards(int) - Method in interface com.google.cloud.dataflow.examples.WordCount.Options

setOutput(String) - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

setOutput(String) - Method in interface com.google.cloud.dataflow.examples.WordCount.Options

setReadOnly(boolean) - Method in interface com.google.cloud.dataflow.examples.DatastoreWordCount.Options

StreamingWordExtract - Class in com.google.cloud.dataflow.examples

A streaming Dataflow Example using BigQuery output.

StreamingWordExtract() - Constructor for class com.google.cloud.dataflow.examples.StreamingWordExtract

T

TfIdf - Class in com.google.cloud.dataflow.examples

An example that computes a basic TF-IDF search table for a directory or GCS prefix.

TfIdf() - Constructor for class com.google.cloud.dataflow.examples.TfIdf

TfIdf.ComputeTfIdf - Class in com.google.cloud.dataflow.examples

A transform containing a basic TF-IDF pipeline.

TfIdf.ComputeTfIdf() - Constructor for class com.google.cloud.dataflow.examples.TfIdf.ComputeTfIdf

TfIdf.ReadDocuments - Class in com.google.cloud.dataflow.examples

Reads the documents at the provided uris and returns all lines from the documents tagged with which document they are from.

TfIdf.ReadDocuments(Iterable<URI>) - Constructor for class com.google.cloud.dataflow.examples.TfIdf.ReadDocuments

TfIdf.WriteTfIdf - Class in com.google.cloud.dataflow.examples

A PTransform to write, in CSV format, a mapping from term and URI to score.

TfIdf.WriteTfIdf(String) - Constructor for class com.google.cloud.dataflow.examples.TfIdf.WriteTfIdf

TopWikipediaSessions - Class in com.google.cloud.dataflow.examples

An example that reads Wikipedia edit data from Cloud Storage and computes the user with the longest string of edits separated by no more than an hour within each month.

TopWikipediaSessions() - Constructor for class com.google.cloud.dataflow.examples.TopWikipediaSessions

W

WindowingWordCount - Class in com.google.cloud.dataflow.examples

An example that counts words in Shakespeare.

WindowingWordCount() - Constructor for class com.google.cloud.dataflow.examples.WindowingWordCount

WindowingWordCount.CountWords - Class in com.google.cloud.dataflow.examples

A PTransform that converts a PCollection containing lines of text into a PCollection of formatted word counts.

WindowingWordCount.CountWords() - Constructor for class com.google.cloud.dataflow.examples.WindowingWordCount.CountWords

WordCount - Class in com.google.cloud.dataflow.examples

An example that counts words in Shakespeare.

WordCount() - Constructor for class com.google.cloud.dataflow.examples.WordCount

WordCount.CountWords - Class in com.google.cloud.dataflow.examples

A PTransform that converts a PCollection containing lines of text into a PCollection of formatted word counts.

WordCount.CountWords() - Constructor for class com.google.cloud.dataflow.examples.WordCount.CountWords

WordCount.Options - Interface in com.google.cloud.dataflow.examples

Options supported by WordCount.

WordCount.Options.OutputFactory - Class in com.google.cloud.dataflow.examples

Returns gs://${STAGING_LOCATION}/"counts.txt" as the default destination.

WordCount.Options.OutputFactory() - Constructor for class com.google.cloud.dataflow.examples.WordCount.Options.OutputFactory

writeDataToDatastore(DatastoreWordCount.Options) - Static method in class com.google.cloud.dataflow.examples.DatastoreWordCount

An example which creates a pipeline to populate DatastoreIO from a text input.

A B C D F G I J L M P R S T W