com.google.cloud.dataflow.sdk.runners.worker

Class AvroByteReader<T>

java.lang.Object

java.util.Observable

com.google.cloud.dataflow.sdk.util.common.worker.Reader<T>

com.google.cloud.dataflow.sdk.runners.worker.AvroByteReader<T>

Type Parameters:

T - the type of the elements read from the source

public class AvroByteReader<T>
extends Reader<T>

A source that reads Avro files. Records are read from the Avro file as a series of byte arrays. The coder provided is used to deserialize each record from a byte array.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Reader

Reader.AbstractReaderIterator<T>, Reader.DynamicSplitRequest, Reader.DynamicSplitResult, Reader.DynamicSplitResultWithPosition, Reader.Position, Reader.Progress, Reader.ReaderIterator<T>

Field Summary

Fields inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Reader

stateSampler, stateSamplerOperationName

Constructor Summary

Constructors

Constructor and Description
AvroByteReader(String filename, Long startPosition, Long endPosition, Coder<T> coder)

Method Summary

Modifier and Type	Method and Description
Reader.ReaderIterator<T>	iterator() Returns a ReaderIterator that allows reading from this source.

Methods inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Reader

notifyElementRead, setStateSamplerAndOperationName, supportsRestart

Methods inherited from class java.util.Observable

addObserver, clearChanged, countObservers, deleteObserver, deleteObservers, hasChanged, notifyObservers, notifyObservers, setChanged

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroByteReader

public AvroByteReader(String filename,
                      @Nullable
                      Long startPosition,
                      @Nullable
                      Long endPosition,
                      Coder<T> coder)

Method Detail

iterator

public Reader.ReaderIterator<T> iterator()
                                  throws IOException

Description copied from class: Reader

Returns a ReaderIterator that allows reading from this source.

Specified by:

iterator in class Reader<T>

Throws:

IOException