Package org.apache.hadoop.hbase.master.region

Class MasterRegionFlusherAndCompactor

java.lang.Object

org.apache.hadoop.hbase.master.region.MasterRegionFlusherAndCompactor

All Implemented Interfaces:

Closeable, AutoCloseable

@Private
class MasterRegionFlusherAndCompactor
extends Object
implements Closeable

As long as there is no RegionServerServices for a master local region, we need implement the flush and compaction logic by our own.

The flush logic is very simple, every time after calling a modification method in RegionProcedureStore, we will call the onUpdate() method below, and in this method, we will check the memstore size and if it is above the flush size, we will call HRegion.flush(boolean) to force flush all stores.

And for compaction, the logic is also very simple. After flush, we will check the store file count, if it is above the compactMin, we will do a major compaction.

Field Summary

Fields

Modifier and Type	Field	Description
private final Abortable	abortable
private final String	archivedHFileSuffix
private final AtomicLong	changesAfterLastFlush
private boolean	closed
private final ExecutorService	compactExecutor
private final Lock	compactLock
private final int	compactMin
private boolean	compactRequest
private final org.apache.hadoop.conf.Configuration	conf
private final Condition	flushCond
private final long	flushIntervalMs
private final Lock	flushLock
private final long	flushPerChanges
private boolean	flushRequest
private final long	flushSize
private final Thread	flushThread
private final org.apache.hadoop.fs.Path	globalArchivePath
private long	lastFlushTime
private static final org.slf4j.Logger	LOG
private final HRegion	region

Constructor Summary

Constructors

Constructor	Description
MasterRegionFlusherAndCompactor(org.apache.hadoop.conf.Configuration conf, Abortable abortable, HRegion region, long flushSize, long flushPerChanges, long flushIntervalMs, int compactMin, org.apache.hadoop.fs.Path globalArchivePath, String archivedHFileSuffix)

Method Summary

Modifier and Type	Method	Description
void	close()
private void	compact()
private void	flushLoop()
private void	moveHFileToGlobalArchiveDir()
private boolean	needCompaction()
(package private) void	onUpdate()
(package private) void	recordLastFlushTime()
(package private) void	requestFlush()
(package private) void	resetChangesAfterLastFlush()
(package private) static void	setupConf(org.apache.hadoop.conf.Configuration conf, long flushSize, long flushPerChanges, long flushIntervalMs)
private boolean	shouldFlush(long changes)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

conf

private final org.apache.hadoop.conf.Configuration conf

abortable

private final Abortable abortable

region

private final HRegion region

changesAfterLastFlush

private final AtomicLong changesAfterLastFlush

flushSize

private final long flushSize

flushPerChanges

private final long flushPerChanges

flushIntervalMs

private final long flushIntervalMs

compactMin

private final int compactMin

globalArchivePath

private final org.apache.hadoop.fs.Path globalArchivePath

archivedHFileSuffix

private final String archivedHFileSuffix

flushThread

private final Thread flushThread

flushLock

private final Lock flushLock

flushCond

private final Condition flushCond

flushRequest

private boolean flushRequest

lastFlushTime

private long lastFlushTime

compactExecutor

private final ExecutorService compactExecutor

compactLock

private final Lock compactLock

compactRequest

private boolean compactRequest

closed

private volatile boolean closed

Constructor Details

MasterRegionFlusherAndCompactor

MasterRegionFlusherAndCompactor(org.apache.hadoop.conf.Configuration conf,
 Abortable abortable,
 HRegion region,
 long flushSize,
 long flushPerChanges,
 long flushIntervalMs,
 int compactMin,
 org.apache.hadoop.fs.Path globalArchivePath,
 String archivedHFileSuffix)

Method Details

setupConf

static void setupConf(org.apache.hadoop.conf.Configuration conf,
 long flushSize,
 long flushPerChanges,
 long flushIntervalMs)

moveHFileToGlobalArchiveDir

private void moveHFileToGlobalArchiveDir()
                                  throws IOException

Throws:

IOException

compact

private void compact()

needCompaction

private boolean needCompaction()

flushLoop

private void flushLoop()

shouldFlush

private boolean shouldFlush(long changes)

onUpdate

void onUpdate()

requestFlush

void requestFlush()

resetChangesAfterLastFlush

void resetChangesAfterLastFlush()

recordLastFlushTime

void recordLastFlushTime()

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable