com.google.cloud.dataflow.sdk.runners.worker

Class DataflowExecutionContext

java.lang.Object

com.google.cloud.dataflow.sdk.util.BaseExecutionContext

com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext

com.google.cloud.dataflow.sdk.runners.worker.DataflowExecutionContext

All Implemented Interfaces:

ExecutionContext

Direct Known Subclasses:

StreamingModeExecutionContext

public abstract class DataflowExecutionContext
extends BatchModeExecutionContext

Extensions to BatchModeExecutionContext specific to the Dataflow worker.

Constructor Summary

Constructors

Constructor and Description
DataflowExecutionContext()

Method Summary

Modifier and Type	Method and Description
abstract SideInputReader	getSideInputReader(Iterable<? extends com.google.api.services.dataflow.model.SideInputInfo> sideInputInfos) Returns a SideInputReader for all the side inputs described in the given SideInputInfo descriptors.
abstract SideInputReader	getSideInputReaderForViews(Iterable<? extends PCollectionView<?>> views) Returns a SideInputReader for all the provided views, where the execution context itself knows how to read data for the view.
static DataflowExecutionContext	withoutSideInputs() Returns a DataflowExecutionContext that does not support side inputs at all, for situations when side inputs are not relevant, such as testing.

Methods inherited from class com.google.cloud.dataflow.sdk.util.BatchModeExecutionContext

createStepContext, getKey, setKey, switchStateKey

Methods inherited from class com.google.cloud.dataflow.sdk.util.BaseExecutionContext

getAllStepContexts, getStepContext, noteOutput, noteSideOutput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataflowExecutionContext

public DataflowExecutionContext()

Method Detail

getSideInputReader

public abstract SideInputReader getSideInputReader(Iterable<? extends com.google.api.services.dataflow.model.SideInputInfo> sideInputInfos)
                                            throws Exception

Returns a SideInputReader for all the side inputs described in the given SideInputInfo descriptors. By default, throws UnsupportedOperationException. Individual workers should override this behavior.

Throws:

Exception

getSideInputReaderForViews

public abstract SideInputReader getSideInputReaderForViews(Iterable<? extends PCollectionView<?>> views)
                                                    throws Exception

Returns a SideInputReader for all the provided views, where the execution context itself knows how to read data for the view. By default, throws UnsupportedOperationException. Particular workers should override this behavior.

Throws:

Exception

withoutSideInputs

public static DataflowExecutionContext withoutSideInputs()

Returns a DataflowExecutionContext that does not support side inputs at all, for situations when side inputs are not relevant, such as testing.