Package org.apache.hadoop.hbase.io.asyncfs

Class WrapperAsyncFSOutput

java.lang.Object

org.apache.hadoop.hbase.io.asyncfs.WrapperAsyncFSOutput

All Implemented Interfaces:

Closeable, AutoCloseable, AsyncFSOutput

@Private
public class WrapperAsyncFSOutput
extends Object
implements AsyncFSOutput

An AsyncFSOutput wraps a FSDataOutputStream.

Field Summary

Fields

Modifier and Type	Field	Description
private ByteArrayOutputStream	buffer
private final ExecutorService	executor
private final org.apache.hadoop.fs.FSDataOutputStream	out
private long	syncedLength

Constructor Summary

Constructors

Constructor	Description
WrapperAsyncFSOutput(org.apache.hadoop.fs.Path file, org.apache.hadoop.fs.FSDataOutputStream out)

Method Summary

Modifier and Type	Method	Description
int	buffered()	Return the current size of buffered data.
void	close()	Close the file.
CompletableFuture<Long>	flush(boolean sync)	Flush the buffer out.
private void	flush0(CompletableFuture<Long> future, ByteArrayOutputStream buffer, boolean sync)
org.apache.hadoop.hdfs.protocol.DatanodeInfo[]	getPipeline()	Return current pipeline.
long	getSyncedLength()	Returns byteSize success synced to underlying filesystem.
boolean	isBroken()	Whether the stream is broken.
void	recoverAndClose(CancelableProgressable reporter)	The close method when error occurred.
void	write(byte[] b)	Just call write(b, 0, b.length).
void	write(byte[] b, int off, int len)	Copy the data into the buffer.
void	write(ByteBuffer bb)	Copy the data in the given bb into the buffer.
void	writeInt(int i)	Write an int to the buffer.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

out

private final org.apache.hadoop.fs.FSDataOutputStream out

buffer

private ByteArrayOutputStream buffer

executor

private final ExecutorService executor

syncedLength

private volatile long syncedLength

Constructor Details

WrapperAsyncFSOutput

public WrapperAsyncFSOutput(org.apache.hadoop.fs.Path file,
 org.apache.hadoop.fs.FSDataOutputStream out)

Method Details

write

public void write(byte[] b)

Description copied from interface: AsyncFSOutput

Just call write(b, 0, b.length).

Specified by:

write in interface AsyncFSOutput

See Also:

• AsyncFSOutput.write(byte[], int, int)

write

public void write(byte[] b,
 int off,
 int len)

Description copied from interface: AsyncFSOutput

Copy the data into the buffer. Note that you need to call AsyncFSOutput.flush(boolean) to flush the buffer manually.

Specified by:

write in interface AsyncFSOutput

writeInt

public void writeInt(int i)

Description copied from interface: AsyncFSOutput

Write an int to the buffer.

Specified by:

writeInt in interface AsyncFSOutput

write

public void write(ByteBuffer bb)

Description copied from interface: AsyncFSOutput

Copy the data in the given bb into the buffer.

Specified by:

write in interface AsyncFSOutput

buffered

public int buffered()

Description copied from interface: AsyncFSOutput

Return the current size of buffered data.

Specified by:

buffered in interface AsyncFSOutput

getPipeline

public org.apache.hadoop.hdfs.protocol.DatanodeInfo[] getPipeline()

Description copied from interface: AsyncFSOutput

Return current pipeline. Empty array if no pipeline.

Specified by:

getPipeline in interface AsyncFSOutput

flush0

private void flush0(CompletableFuture<Long> future,
 ByteArrayOutputStream buffer,
 boolean sync)

flush

public CompletableFuture<Long> flush(boolean sync)

Description copied from interface: AsyncFSOutput

Flush the buffer out.

Specified by:

flush in interface AsyncFSOutput

Parameters:

sync - persistent the data to device

Returns:

A CompletableFuture that hold the acked length after flushing.

recoverAndClose

public void recoverAndClose(CancelableProgressable reporter)
                     throws IOException

Description copied from interface: AsyncFSOutput

The close method when error occurred.

Specified by:

recoverAndClose in interface AsyncFSOutput

Throws:

IOException

close

public void close()
           throws IOException

Description copied from interface: AsyncFSOutput

Close the file. You should call AsyncFSOutput.recoverAndClose(CancelableProgressable) if this method throws an exception.

Specified by:

close in interface AsyncFSOutput

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException

isBroken

public boolean isBroken()

Description copied from interface: AsyncFSOutput

Whether the stream is broken.

Specified by:

isBroken in interface AsyncFSOutput

getSyncedLength

public long getSyncedLength()

Description copied from interface: AsyncFSOutput

Returns byteSize success synced to underlying filesystem.

Specified by:

getSyncedLength in interface AsyncFSOutput