com.google.cloud.dataflow.sdk.runners

Class TemplatingDataflowPipelineRunner

java.lang.Object

com.google.cloud.dataflow.sdk.runners.PipelineRunner<DataflowPipelineJob>

com.google.cloud.dataflow.sdk.runners.TemplatingDataflowPipelineRunner

public class TemplatingDataflowPipelineRunner
extends PipelineRunner<DataflowPipelineJob>

A PipelineRunner that's like DataflowPipelineRunner but only stores a template of a job.

Requires that getDataflowJobFile is set.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TemplatingDataflowPipelineRunner.Runner Register the TemplatingDataflowPipelineRunner.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TemplatingDataflowPipelineRunner(DataflowPipelineRunner internalRunner, PipelineOptions options)

Method Summary

Modifier and Type	Method and Description
<OutputT extends POutput,InputT extends PInput> OutputT	apply(PTransform<InputT,OutputT> transform, InputT input) Applies a transform to the given input, returning the output.
static TemplatingDataflowPipelineRunner	fromOptions(PipelineOptions options) Constructs a runner from the provided options.
DataflowPipelineJob	run(Pipeline p) Processes the given Pipeline, returning the results.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

TemplatingDataflowPipelineRunner

protected TemplatingDataflowPipelineRunner(DataflowPipelineRunner internalRunner,
                                           PipelineOptions options)

Method Detail

fromOptions

public static TemplatingDataflowPipelineRunner fromOptions(PipelineOptions options)

Constructs a runner from the provided options.

run

public DataflowPipelineJob run(Pipeline p)

Description copied from class: PipelineRunner

Processes the given Pipeline, returning the results.

Specified by:

run in class PipelineRunner<DataflowPipelineJob>

apply

public <OutputT extends POutput,InputT extends PInput> OutputT apply(PTransform<InputT,OutputT> transform,
                                                                     InputT input)

Description copied from class: PipelineRunner

Applies a transform to the given input, returning the output.

The default implementation calls PTransform.apply(input), but can be overridden to customize behavior for a particular runner.

Overrides:

apply in class PipelineRunner<DataflowPipelineJob>

toString

public String toString()

Overrides:

toString in class Object