com.google.cloud.dataflow.sdk.runners

Class PipelineRunner<Results extends PipelineResult>

java.lang.Object

com.google.cloud.dataflow.sdk.runners.PipelineRunner<Results>

Type Parameters:

Results - the type of the result of run(com.google.cloud.dataflow.sdk.Pipeline).

Direct Known Subclasses:

BlockingDataflowPipelineRunner, DataflowPipelineRunner, DirectPipelineRunner

public abstract class PipelineRunner<Results extends PipelineResult>
extends java.lang.Object

A PipelineRunner can execute, translate, or otherwise process a Pipeline.

Constructor Summary

Constructors

Constructor and Description
PipelineRunner()

Method Summary

Methods

Modifier and Type	Method and Description
<Output extends POutput,Input extends PInput> Output	apply(PTransform<Input,Output> transform, Input input) Applies a transform to the given input, returning the output.
static PipelineRunner<? extends PipelineResult>	fromOptions(PipelineOptions options) Constructs a runner from the provided options.
abstract Results	run(Pipeline pipeline) Processes the given Pipeline, returning the results.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PipelineRunner

public PipelineRunner()

Method Detail

fromOptions

public static PipelineRunner<? extends PipelineResult> fromOptions(PipelineOptions options)

Constructs a runner from the provided options.

Returns:

The newly created runner.

run

public abstract Results run(Pipeline pipeline)

Processes the given Pipeline, returning the results.

apply

public <Output extends POutput,Input extends PInput> Output apply(PTransform<Input,Output> transform,
                                                         Input input)

Applies a transform to the given input, returning the output.

The default implementation calls PTransform.apply(input), but can be overridden to customize behavior for a particular runner.