com.google.cloud.dataflow.sdk.runners.worker

Class ApplianceShuffleWriter

java.lang.Object

com.google.cloud.dataflow.sdk.runners.worker.ApplianceShuffleWriter

@ThreadSafe
public final class ApplianceShuffleWriter
extends Object

ApplianceShuffleWriter writes chunks of data to a shuffle dataset.

It is a JNI wrapper of an equivalent C++ class.

Constructor Summary

Constructors

Constructor and Description
ApplianceShuffleWriter(byte[] shuffleWriterConfig, long bufferSize)

Method Summary

Modifier and Type	Method and Description
void	close() Flushes written records and closes this writer.
void	finalize()
String	getDatasetId()
void	write(byte[] chunk) Writes a chunk of records.

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ApplianceShuffleWriter

public ApplianceShuffleWriter(byte[] shuffleWriterConfig,
                              long bufferSize)

Parameters:

shuffleWriterConfig - opaque configuration for creating a shuffle writer

bufferSize - the writer buffer size

Method Detail

finalize

public void finalize()

Overrides:

finalize in class Object

getDatasetId

public String getDatasetId()

write

public void write(byte[] chunk)
           throws IOException

Writes a chunk of records. The chunk is a sequence of pairs encoded as: where the sizes are 4-byte big-endian integers.

Throws:

IOException

close

public void close()
           throws IOException

Flushes written records and closes this writer.

Throws:

IOException