com.google.cloud.dataflow.sdk.util.common.worker

Class WorkExecutor

java.lang.Object

com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor

All Implemented Interfaces:

AutoCloseable

Direct Known Subclasses:

MapTaskExecutor, SourceOperationExecutor

public abstract class WorkExecutor
extends Object
implements AutoCloseable

Abstract executor for WorkItem tasks.

Constructor Summary

Constructors

Constructor and Description
WorkExecutor(CounterSet outputCounters) Constructs a new WorkExecutor task.

Method Summary

Modifier and Type	Method and Description
void	close()
abstract void	execute() Executes the task.
CounterSet	getOutputCounters() Returns the set of output counters for this task.
Collection<Metric<?>>	getOutputMetrics() Returns a collection of output metrics for this task.
Reader.Progress	getWorkerProgress() Returns the worker's current progress.
Reader.DynamicSplitResult	requestDynamicSplit(Reader.DynamicSplitRequest splitRequest) See Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WorkExecutor

public WorkExecutor(CounterSet outputCounters)

Constructs a new WorkExecutor task.

Method Detail

getOutputCounters

public CounterSet getOutputCounters()

Returns the set of output counters for this task.

getOutputMetrics

public Collection<Metric<?>> getOutputMetrics()

Returns a collection of output metrics for this task.

execute

public abstract void execute()
                      throws Exception

Executes the task.

Throws:

Exception

getWorkerProgress

public Reader.Progress getWorkerProgress()
                                  throws Exception

Returns the worker's current progress.

Throws:

Exception

requestDynamicSplit

public Reader.DynamicSplitResult requestDynamicSplit(Reader.DynamicSplitRequest splitRequest)
                                              throws Exception

See Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest). Makes sense only for tasks that read input.

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception