See: Description
| Interface | Description |
|---|---|
| ElementCounter |
Abstract interface that counts elements processed.
|
| ParDoFn |
Interface for functions invocable by
ParDoOperation instances. |
| PartialGroupByKeyOperation.Combiner<K,InputT,AccumT,OutputT> |
Provides client-specific operations for combining values.
|
| PartialGroupByKeyOperation.GroupingKeyCreator<K> |
Provides client-specific operations for grouping keys.
|
| PartialGroupByKeyOperation.PairInfo |
Provides client-specific operations for working with elements
that are key/value or key/values pairs.
|
| PartialGroupByKeyOperation.SizeEstimator<T> |
Provides client-specific operations for size estimates.
|
| ProgressTracker<T> |
Provides an interface to an object capable of tracking progress through a
collection of elements to be processed.
|
| Reader.DynamicSplitRequest |
A framework-specific way to specify how
Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest) should split
the input into a primary and residual part. |
| Reader.DynamicSplitResult |
A framework-specific way to specify how
Reader.ReaderIterator.requestDynamicSplit(com.google.cloud.dataflow.sdk.util.common.worker.Reader.DynamicSplitRequest) has split
the input into a primary and residual part. |
| Reader.Position |
A representation of a position in an iteration through a
Reader. |
| Reader.Progress |
A representation of how far a
ReaderIterator is through a
Reader. |
| Reader.ReaderIterator<T> |
A stateful iterator over the data in a Reader.
|
| Receiver |
Abstract interface of things that accept inputs one at a time via process().
|
| ShuffleBatchReader |
ShuffleBatchReader provides an interface for reading a batch of
key/value entries from a shuffle dataset.
|
| ShuffleEntryReader |
ShuffleEntryReader provides an interface for reading key/value
entries from a shuffle dataset.
|
| ShufflePosition |
Represents a position in a stream of ShuffleEntries.
|
| Sink.SinkWriter<ElemT> |
Writes to a Sink.
|
| SourceFormat |
An interface for sources that can perform operations on source specifications, such as
splitting the source and computing its metadata.
|
| SourceFormat.OperationRequest |
A representation of an operation on the specification of a source,
e.g.
|
| SourceFormat.OperationResponse |
A representation of the result of a SourceOperationRequest.
|
| SourceFormat.SourceSpec |
A representation of a specification of a source.
|
| Class | Description |
|---|---|
| AbstractBoundedReaderIterator<T> |
An abstract base class for implementations of ReaderIterator classes for bounded sources,
where hasNext() returns the same value if called multiple times.
|
| BatchingShuffleEntryReader |
BatchingShuffleEntryReader provides a mechanism for reading entries from
a shuffle dataset.
|
| CachingShuffleBatchReader |
A
ShuffleBatchReader that caches batches as they're read. |
| FlattenOperation |
A flatten operation.
|
| GroupingShuffleEntryIterator |
An iterator through KeyGroupedShuffleEntries.
|
| KeyGroupedShuffleEntries |
A collection of ShuffleEntries, all with the same key.
|
| MapTaskExecutor |
An executor for a map task, defined by a list of Operations.
|
| Operation |
The abstract base class for Operations, which correspond to
Instructions in the original MapTask InstructionGraph.
|
| OutputObjectAndByteCounter |
An
ElementCounter that counts output objects, bytes, and mean bytes. |
| OutputReceiver |
Receiver that forwards each input it receives to each of a list of
output Receivers.
|
| ParDoOperation |
A ParDo mapping function.
|
| PartialGroupByKeyOperation |
A partial group-by-key operation.
|
| PartialGroupByKeyOperation.BufferingGroupingTable<K,V> |
A grouping table that simply buffers all inserted values in a list.
|
| PartialGroupByKeyOperation.CombiningGroupingTable<K,InputT,AccumT> |
A grouping table that uses the given combiner to combine values in place.
|
| PartialGroupByKeyOperation.SamplingSizeEstimator<T> |
Implements size estimation by adaptively delegating to an underlying
(potentially more expensive) estimator for some elements and returning
the average value for others.
|
| PartialGroupByKeyOperation.StructuralByteArray |
A wrapper around a byte[] that uses structural, value-based
equality rather than byte[]'s normal object identity.
|
| ProgressTrackerGroup<T> |
Implements a group of linked
ProgressTrackers that
collectively track how far a processing loop has gotten through the elements
it's processing. |
| ProgressTrackingReiterator<T> |
Implements a
Reiterator that uses a
ProgressTracker to track how far
it's gotten through some base Reiterator. |
| Reader<T> |
Abstract base class for readers.
|
| Reader.AbstractReaderIterator<T> |
An abstract base class for ReaderIterator implementations.
|
| Reader.DynamicSplitResultWithPosition |
A
Reader.DynamicSplitResult that specifies the boundary between the primary and
residual parts of the input using a Reader.Position. |
| ReadOperation |
A read operation.
|
| ReceivingOperation |
The abstract base class for Operations that have inputs and
implement process().
|
| ShuffleBatchReader.Batch |
The result returned by #read.
|
| ShuffleEntry |
Entry written to/read from a shuffle dataset.
|
| Sink<T> |
Abstract base class for Sinks.
|
| StateSampler |
A StateSampler object may be used to obtain an approximate
breakdown of the time spent by an execution context in various
states, as a fraction of the total time.
|
| WorkExecutor |
Abstract executor for WorkItem tasks.
|
| WorkProgressUpdater |
WorkProgressUpdater allows a work executor to send work progress
updates to the worker service.
|
| WriteOperation |
A write operation.
|
| Enum | Description |
|---|---|
| Operation.InitializationState |
The possible initialization states of an Operation.
|