com.google.cloud.dataflow.sdk.runners.worker

Class AvroSink<T>

java.lang.Object

com.google.cloud.dataflow.sdk.util.common.worker.Sink<WindowedValue<T>>

com.google.cloud.dataflow.sdk.runners.worker.AvroSink<T>

Type Parameters:

T - the type of the elements written to the sink

public class AvroSink<T>
extends Sink<WindowedValue<T>>

A sink that writes Avro files.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Sink

Sink.SinkWriter<ElemT>

Constructor Summary

Constructors

Constructor and Description
AvroSink(String filenamePrefix, String shardFormat, String filenameSuffix, int shardCount, WindowedValue.ValueOnlyWindowedValueCoder<T> coder)
AvroSink(String filename, WindowedValue.ValueOnlyWindowedValueCoder<T> coder)

Method Summary

Modifier and Type	Method and Description
Sink.SinkWriter<WindowedValue<T>>	writer() Returns a Writer that allows writing to this Sink.
Sink.SinkWriter<WindowedValue<T>>	writer(org.apache.avro.io.DatumWriter<T> datumWriter)

Methods inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Sink

supportsRestart

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroSink

public AvroSink(String filename,
                WindowedValue.ValueOnlyWindowedValueCoder<T> coder)

AvroSink

public AvroSink(String filenamePrefix,
                String shardFormat,
                String filenameSuffix,
                int shardCount,
                WindowedValue.ValueOnlyWindowedValueCoder<T> coder)

Method Detail

writer

public Sink.SinkWriter<WindowedValue<T>> writer(org.apache.avro.io.DatumWriter<T> datumWriter)
                                         throws IOException

Throws:

IOException

writer

public Sink.SinkWriter<WindowedValue<T>> writer()
                                         throws IOException

Description copied from class: Sink

Returns a Writer that allows writing to this Sink.

Specified by:

writer in class Sink<WindowedValue<T>>

Throws:

IOException