com.google.cloud.dataflow.sdk.runners.worker

Class AvroReader<T>

java.lang.Object

java.util.Observable

com.google.cloud.dataflow.sdk.util.common.worker.Reader<WindowedValue<T>>

com.google.cloud.dataflow.sdk.runners.worker.AvroReader<T>

Type Parameters:

T - the type of the elements read from the source

public class AvroReader<T>
extends Reader<WindowedValue<T>>

A source that reads Avro files.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Reader

Reader.AbstractReaderIterator<T>, Reader.DynamicSplitRequest, Reader.DynamicSplitResult, Reader.DynamicSplitResultWithPosition, Reader.Position, Reader.Progress, Reader.ReaderIterator<T>

Field Summary

Fields inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Reader

stateSampler, stateSamplerOperationName

Constructor Summary

Constructors

Constructor and Description
AvroReader(String filename, Long startPosition, Long endPosition, WindowedValue.ValueOnlyWindowedValueCoder<T> coder)

Method Summary

Modifier and Type	Method and Description
Reader.ReaderIterator<WindowedValue<T>>	iterator() Returns a ReaderIterator that allows reading from this source.
Reader.ReaderIterator<WindowedValue<T>>	iterator(org.apache.avro.io.DatumReader<T> datumReader)

Methods inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Reader

notifyElementRead, setStateSamplerAndOperationName, supportsRestart

Methods inherited from class java.util.Observable

addObserver, clearChanged, countObservers, deleteObserver, deleteObservers, hasChanged, notifyObservers, notifyObservers, setChanged

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroReader

public AvroReader(String filename,
                  @Nullable
                  Long startPosition,
                  @Nullable
                  Long endPosition,
                  WindowedValue.ValueOnlyWindowedValueCoder<T> coder)

Method Detail

iterator

public Reader.ReaderIterator<WindowedValue<T>> iterator(org.apache.avro.io.DatumReader<T> datumReader)
                                                 throws IOException

Throws:

IOException

iterator

public Reader.ReaderIterator<WindowedValue<T>> iterator()
                                                 throws IOException

Description copied from class: Reader

Returns a ReaderIterator that allows reading from this source.

Specified by:

iterator in class Reader<WindowedValue<T>>

Throws:

IOException