com.google.cloud.dataflow.sdk.runners

Interface DirectPipelineRunner.EvaluationContext

All Superinterfaces:

DirectPipelineRunner.EvaluationResults, PipelineResult

Enclosing class:

DirectPipelineRunner

public static interface DirectPipelineRunner.EvaluationContext
extends DirectPipelineRunner.EvaluationResults

The interface provided to registered callbacks for interacting with the DirectPipelineRunner, including reading and writing the values of PCollections and PCollectionViews.

Method Summary

Methods

Modifier and Type	Method and Description
<T> Coder<T>	ensureCoderSerializable(Coder<T> coder) If the evaluation context is testing serializability, ensures that the argument Coder is serializable and deserializable by encoding it and then decoding it, and returning the result.
<T> T	ensureElementEncodable(TypedPValue<T> pvalue, T element) Ensures that the element is encodable and decodable using the TypePValue's coder, by encoding it and decoding it, and returning the result.
<Fn extends java.io.Serializable> Fn	ensureSerializable(Fn fn) If the evaluation context is testing serializability, ensures that the argument function is serializable and deserializable by encoding it and then decoding it, and returning the result.
<T> T	ensureSerializableByCoder(Coder<T> coder, T data, java.lang.String errorContext) If the evaluation context is testing serializability, ensures that the given data is serializable and deserializable with the given Coder by encoding it and then decoding it, and returning the result.
com.google.cloud.dataflow.sdk.util.common.CounterSet.AddCounterMutator	getAddCounterMutator() Returns a mutator, which can be used to add additional counters to this EvaluationContext.
<T> java.util.List<DirectPipelineRunner.ValueWithMetadata<T>>	getPCollectionValuesWithMetadata(PCollection<T> pc) Retrieves the value of the given PCollection, along with element metadata such as timestamps and windows.
DirectPipelineOptions	getPipelineOptions() Returns the configured pipeline options.
java.lang.String	getStepName(PTransform<?,?> transform) Gets the step name for this transform.
<T> java.util.List<T>	randomizeIfUnordered(java.util.List<T> elements, boolean inPlaceAllowed) If the evaluation context is testing unorderedness, randomly permutes the order of the elements, in a copy if !inPlaceAllowed, and returns the permuted list, otherwise returns the argument unchanged.
<T> void	setPCollection(PCollection<T> pc, java.util.List<T> elements) Shorthand for setting the value of a PCollection where the elements do not have timestamps or windows.
<T> void	setPCollectionValuesWithMetadata(PCollection<T> pc, java.util.List<DirectPipelineRunner.ValueWithMetadata<T>> elements) Sets the value of the given PCollection, where each element also has a timestamp and collection of windows.
<R,T,WT> void	setPCollectionView(PCollectionView<T> pc, java.lang.Iterable<com.google.cloud.dataflow.sdk.util.WindowedValue<R>> value) Sets the value associated with the given PCollectionView.
<T> void	setPCollectionWindowedValue(PCollection<T> pc, java.util.List<com.google.cloud.dataflow.sdk.util.WindowedValue<T>> elements) Sets the value of the given PCollection, where each element also has a timestamp and collection of windows.

Methods inherited from interface com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.EvaluationResults

getPCollection, getPCollectionList, getPCollectionView, getPCollectionWindowedValues

Method Detail

getPipelineOptions

DirectPipelineOptions getPipelineOptions()

Returns the configured pipeline options.

setPCollectionValuesWithMetadata

<T> void setPCollectionValuesWithMetadata(PCollection<T> pc,
                                        java.util.List<DirectPipelineRunner.ValueWithMetadata<T>> elements)

Sets the value of the given PCollection, where each element also has a timestamp and collection of windows. Throws an exception if the PCollection's value has already been set.

setPCollectionWindowedValue

<T> void setPCollectionWindowedValue(PCollection<T> pc,
                                   java.util.List<com.google.cloud.dataflow.sdk.util.WindowedValue<T>> elements)

Sets the value of the given PCollection, where each element also has a timestamp and collection of windows. Throws an exception if the PCollection's value has already been set.

setPCollection

<T> void setPCollection(PCollection<T> pc,
                      java.util.List<T> elements)

Shorthand for setting the value of a PCollection where the elements do not have timestamps or windows. Throws an exception if the PCollection's value has already been set.

getPCollectionValuesWithMetadata

<T> java.util.List<DirectPipelineRunner.ValueWithMetadata<T>> getPCollectionValuesWithMetadata(PCollection<T> pc)

Retrieves the value of the given PCollection, along with element metadata such as timestamps and windows. Throws an exception if the PCollection's value hasn't already been set.

setPCollectionView

<R,T,WT> void setPCollectionView(PCollectionView<T> pc,
                               java.lang.Iterable<com.google.cloud.dataflow.sdk.util.WindowedValue<R>> value)

Sets the value associated with the given PCollectionView. Throws an exception if the PCollectionView's value has already been set.

ensureElementEncodable

<T> T ensureElementEncodable(TypedPValue<T> pvalue,
                           T element)

Ensures that the element is encodable and decodable using the TypePValue's coder, by encoding it and decoding it, and returning the result.

randomizeIfUnordered

<T> java.util.List<T> randomizeIfUnordered(java.util.List<T> elements,
                                         boolean inPlaceAllowed)

If the evaluation context is testing unorderedness, randomly permutes the order of the elements, in a copy if !inPlaceAllowed, and returns the permuted list, otherwise returns the argument unchanged.

ensureSerializable

<Fn extends java.io.Serializable> Fn ensureSerializable(Fn fn)

If the evaluation context is testing serializability, ensures that the argument function is serializable and deserializable by encoding it and then decoding it, and returning the result. Otherwise returns the argument unchanged.

ensureCoderSerializable

<T> Coder<T> ensureCoderSerializable(Coder<T> coder)

If the evaluation context is testing serializability, ensures that the argument Coder is serializable and deserializable by encoding it and then decoding it, and returning the result. Otherwise returns the argument unchanged.

ensureSerializableByCoder

<T> T ensureSerializableByCoder(Coder<T> coder,
                              T data,
                              java.lang.String errorContext)

If the evaluation context is testing serializability, ensures that the given data is serializable and deserializable with the given Coder by encoding it and then decoding it, and returning the result. Otherwise returns the argument unchanged.

Error context is prefixed to any thrown exceptions.

getAddCounterMutator

com.google.cloud.dataflow.sdk.util.common.CounterSet.AddCounterMutator getAddCounterMutator()

Returns a mutator, which can be used to add additional counters to this EvaluationContext.

getStepName

java.lang.String getStepName(PTransform<?,?> transform)

Gets the step name for this transform.