Package org.apache.hadoop.hbase.wal

Class AbstractRecoveredEditsOutputSink

java.lang.Object

org.apache.hadoop.hbase.wal.OutputSink

org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

Direct Known Subclasses:

BoundedRecoveredEditsOutputSink, RecoveredEditsOutputSink

@Private
abstract class AbstractRecoveredEditsOutputSink
extends OutputSink

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) final class	AbstractRecoveredEditsOutputSink.RecoveredEditsWriter	Private data structure that wraps a WALProvider.Writer and its Path, also collecting statistics about the data written to this output.

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.wal.OutputSink

OutputSink.WriterThread

Field Summary

Fields

Modifier and Type	Field	Description
private static final org.slf4j.Logger	LOG
private final ConcurrentMap<String,Long>	regionMaximumEditLogSeqNum
private final WALSplitter	walSplitter

Fields inherited from class org.apache.hadoop.hbase.wal.OutputSink

closeCompletionService, closeThreadPool, entryBuffers, numThreads, reporter, splits, status, totalSkippedEdits

Constructor Summary

Constructors

Constructor	Description
AbstractRecoveredEditsOutputSink(WALSplitter walSplitter, WALSplitter.PipelineController controller, EntryBuffers entryBuffers, int numWriters)

Method Summary

Modifier and Type	Method	Description
protected org.apache.hadoop.fs.Path	closeRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.RecoveredEditsWriter editsWriter, List<IOException> thrown)
protected AbstractRecoveredEditsOutputSink.RecoveredEditsWriter	createRecoveredEditsWriter(TableName tableName, byte[] region, long seqId)	Returns a writer that wraps a WALProvider.Writer and its Path.
private void	deleteOneWithFewerEntries(AbstractRecoveredEditsOutputSink.RecoveredEditsWriter editsWriter, org.apache.hadoop.fs.Path dst)
boolean	keepRegionEvent(WAL.Entry entry)	Some WALEdit's contain only KV's for account on what happened to a region.
(package private) void	updateRegionMaximumEditLogSeqNum(WAL.Entry entry)	Update region's maximum edit log SeqNum.

Methods inherited from class org.apache.hadoop.hbase.wal.OutputSink

append, close, finishWriterThreads, getNumberOfRecoveredRegions, getNumOpenWriters, getOutputCounts, getTotalSkippedEdits, restartWriterThreadsIfNeeded, setReporter, setStatus, startWriterThreads, updateStatusWithMsg

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

walSplitter

private final WALSplitter walSplitter

regionMaximumEditLogSeqNum

private final ConcurrentMap<String,Long> regionMaximumEditLogSeqNum

Constructor Details

AbstractRecoveredEditsOutputSink

public AbstractRecoveredEditsOutputSink(WALSplitter walSplitter,
 WALSplitter.PipelineController controller,
 EntryBuffers entryBuffers,
 int numWriters)

Method Details

createRecoveredEditsWriter

protected AbstractRecoveredEditsOutputSink.RecoveredEditsWriter createRecoveredEditsWriter(TableName tableName,
 byte[] region,
 long seqId)
                                                                                    throws IOException

Returns a writer that wraps a WALProvider.Writer and its Path. Caller should close.

Throws:

IOException

closeRecoveredEditsWriter

protected org.apache.hadoop.fs.Path closeRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.RecoveredEditsWriter editsWriter,
 List<IOException> thrown)
                                                       throws IOException

Throws:

IOException

keepRegionEvent

public boolean keepRegionEvent(WAL.Entry entry)

Description copied from class: OutputSink

Some WALEdit's contain only KV's for account on what happened to a region. Not all sinks will want to get all of those edits.

Specified by:

keepRegionEvent in class OutputSink

Returns:

Return true if this sink wants to accept this region-level WALEdit.

updateRegionMaximumEditLogSeqNum

void updateRegionMaximumEditLogSeqNum(WAL.Entry entry)

Update region's maximum edit log SeqNum.

deleteOneWithFewerEntries

private void deleteOneWithFewerEntries(AbstractRecoveredEditsOutputSink.RecoveredEditsWriter editsWriter,
 org.apache.hadoop.fs.Path dst)
                                throws IOException

Throws:

IOException