com.google.cloud.dataflow.sdk.util.common.worker

Class MapTaskExecutor

java.lang.Object

com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor

com.google.cloud.dataflow.sdk.util.common.worker.MapTaskExecutor

All Implemented Interfaces:

AutoCloseable

public class MapTaskExecutor
extends WorkExecutor

An executor for a map task, defined by a list of Operations.

Field Summary

Fields

Modifier and Type	Field and Description
List<Operation>	operations The operations in the map task, in execution order.
protected StateSampler	stateSampler The StateSampler for tracking where time is being spent, or null.

Constructor Summary

Constructors

Constructor and Description
MapTaskExecutor(List<Operation> operations, CounterSet counters, StateSampler stateSampler) Creates a new MapTaskExecutor.

Method Summary

Modifier and Type	Method and Description
void	close()
void	execute() Executes the task.
ReadOperation	getReadOperation()
Reader.Progress	getWorkerProgress() Returns the worker's current progress.
Reader.DynamicSplitResult	requestDynamicSplit(Reader.DynamicSplitRequest splitRequest) See Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest).
boolean	supportsRestart()

Methods inherited from class com.google.cloud.dataflow.sdk.util.common.worker.WorkExecutor

getOutputCounters, getOutputMetrics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

operations

public final List<Operation> operations

The operations in the map task, in execution order.

stateSampler

protected final StateSampler stateSampler

The StateSampler for tracking where time is being spent, or null.

Constructor Detail

MapTaskExecutor

public MapTaskExecutor(List<Operation> operations,
                       CounterSet counters,
                       StateSampler stateSampler)

Creates a new MapTaskExecutor.

Parameters:

operations - the operations of the map task, in order of execution

counters - a set of system counters associated with operations, which may get extended during execution

stateSampler - a state sampler for tracking where time is being spent

Method Detail

execute

public void execute()
             throws Exception

Description copied from class: WorkExecutor

Executes the task.

Specified by:

execute in class WorkExecutor

Throws:

Exception

getWorkerProgress

public Reader.Progress getWorkerProgress()
                                  throws Exception

Description copied from class: WorkExecutor

Returns the worker's current progress.

Overrides:

getWorkerProgress in class WorkExecutor

Throws:

Exception

requestDynamicSplit

public Reader.DynamicSplitResult requestDynamicSplit(Reader.DynamicSplitRequest splitRequest)
                                              throws Exception

Description copied from class: WorkExecutor

See Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest). Makes sense only for tasks that read input.

Overrides:

requestDynamicSplit in class WorkExecutor

Throws:

Exception

getReadOperation

public ReadOperation getReadOperation()
                               throws Exception

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Overrides:

close in class WorkExecutor

Throws:

Exception

supportsRestart

public boolean supportsRestart()