com.google.cloud.dataflow.sdk.runners.worker

Class AvroByteSink<T>

java.lang.Object

com.google.cloud.dataflow.sdk.util.common.worker.Sink<T>

com.google.cloud.dataflow.sdk.runners.worker.AvroByteSink<T>

Type Parameters:

T - the type of the elements written to the sink

public class AvroByteSink<T>
extends Sink<T>

A sink that writes Avro files. Records are written to the Avro file as a series of byte arrays. The coder provided is used to serialize each record into a byte array.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Sink

Sink.SinkWriter<ElemT>

Constructor Summary

Constructors

Constructor and Description
AvroByteSink(String filenamePrefix, Coder<T> coder)
AvroByteSink(String filenamePrefix, String shardFormat, String filenameSuffix, int shardCount, Coder<T> coder)

Method Summary

Modifier and Type	Method and Description
Sink.SinkWriter<T>	writer() Returns a Writer that allows writing to this Sink.

Methods inherited from class com.google.cloud.dataflow.sdk.util.common.worker.Sink

supportsRestart

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroByteSink

public AvroByteSink(String filenamePrefix,
                    Coder<T> coder)

AvroByteSink

public AvroByteSink(String filenamePrefix,
                    String shardFormat,
                    String filenameSuffix,
                    int shardCount,
                    Coder<T> coder)

Method Detail

writer

public Sink.SinkWriter<T> writer()
                          throws IOException

Description copied from class: Sink

Returns a Writer that allows writing to this Sink.

Specified by:

writer in class Sink<T>

Throws:

IOException