com.google.cloud.dataflow.sdk.runners.worker

Class ParDoFnBase

java.lang.Object

com.google.cloud.dataflow.sdk.runners.worker.ParDoFnBase

All Implemented Interfaces:

ParDoFn

public abstract class ParDoFnBase
extends Object
implements ParDoFn

A base class providing simple set up, processing, and tear down for a wrapped DoFn.

Subclasses override just a method to provide a DoFnInfo for the wrapped DoFn.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	ParDoFnBase(PipelineOptions options, SideInputReader sideInputReader, List<String> outputTags, String stepName, String transformName, ExecutionContext executionContext, CounterSet.AddCounterMutator addCounterMutator) Creates a ParDoFnBase using basic information about the step being executed.

Method Summary

Modifier and Type	Method and Description
void	finishBundle()
protected abstract DoFnInfo<?,?>	getDoFnInfo() Creates a fresh DoFnInfo.
ExecutionContext	getExecutionContext()
void	processElement(Object elem)
void	startBundle(Receiver... receivers)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParDoFnBase

protected ParDoFnBase(PipelineOptions options,
                      SideInputReader sideInputReader,
                      List<String> outputTags,
                      String stepName,
                      String transformName,
                      ExecutionContext executionContext,
                      CounterSet.AddCounterMutator addCounterMutator)

Creates a ParDoFnBase using basic information about the step being executed.

Method Detail

getExecutionContext

public ExecutionContext getExecutionContext()

getDoFnInfo

protected abstract DoFnInfo<?,?> getDoFnInfo()

Creates a fresh DoFnInfo. This will be called for each bundle.

startBundle

public void startBundle(Receiver... receivers)
                 throws Exception

Specified by:

startBundle in interface ParDoFn

Throws:

Exception

processElement

public void processElement(Object elem)
                    throws Exception

Specified by:

processElement in interface ParDoFn

Throws:

Exception

finishBundle

public void finishBundle()
                  throws Exception

Specified by:

finishBundle in interface ParDoFn

Throws:

Exception