Package org.apache.hadoop.hbase.wal

Class RegionGroupingProvider

java.lang.Object

org.apache.hadoop.hbase.wal.AbstractWALProvider

org.apache.hadoop.hbase.wal.RegionGroupingProvider

All Implemented Interfaces:

PeerActionListener, WALProvider

@Private
public class RegionGroupingProvider
extends AbstractWALProvider

A WAL Provider that returns a WAL per group of regions. This provider follows the decorator pattern and mainly holds the logic for WAL grouping. WAL creation/roll/close is delegated to DELEGATE_PROVIDER Region grouping is handled via RegionGroupingProvider.RegionGroupingStrategy and can be configured via the property "hbase.wal.regiongrouping.strategy". Current strategy choices are

• defaultStrategy : Whatever strategy this version of HBase picks. currently "bounded".
• identity : each region belongs to its own group.
• bounded : bounded number of groups and region evenly assigned to each group.

Optionally, a FQCN to a custom implementation may be given.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) static class	RegionGroupingProvider.IdentityGroupingStrategy
static interface	RegionGroupingProvider.RegionGroupingStrategy	Map identifiers to a group number.
(package private) static enum	RegionGroupingProvider.Strategies	Maps between configuration names for strategies and implementation classes.

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.wal.WALProvider

WALProvider.AsyncWriter, WALProvider.Writer, WALProvider.WriterBase

Field Summary

Fields

Modifier and Type	Field	Description
private final ConcurrentMap<String,WALProvider>	cached	A group-provider mapping, make sure one-one rather than many-one mapping
private final KeyLocker<String>	createLock
static final String	DEFAULT_DELEGATE_PROVIDER
static final String	DEFAULT_REGION_GROUPING_STRATEGY
static final String	DELEGATE_PROVIDER	delegate provider for WAL creation/roll/close, but not support multiwal
private static final org.slf4j.Logger	LOG
private static final String	META_WAL_GROUP_NAME
private Class<? extends WALProvider>	providerClass
static final String	REGION_GROUPING_STRATEGY
private RegionGroupingProvider.RegionGroupingStrategy	strategy

Fields inherited from class org.apache.hadoop.hbase.wal.AbstractWALProvider

abortable, conf, factory, initialized, listeners, logPrefix, providerId, WAL_FILE_NAME_DELIMITER

Fields inherited from interface org.apache.hadoop.hbase.replication.regionserver.PeerActionListener

DUMMY

Constructor Summary

Constructors

Constructor	Description
RegionGroupingProvider()

Method Summary

Modifier and Type	Method	Description
protected void	close0()
private WALProvider	createProvider(String group)
protected WAL	createRemoteWAL(RegionInfo region, org.apache.hadoop.fs.FileSystem remoteFs, org.apache.hadoop.fs.Path remoteWALDir, String prefix, String suffix)
protected void	doInit(WALFactory factory, org.apache.hadoop.conf.Configuration conf, String providerId)
protected long	getLogFileSize0()
protected long	getNumLogFiles0()
(package private) RegionGroupingProvider.RegionGroupingStrategy	getStrategy(org.apache.hadoop.conf.Configuration conf, String key, String defaultValue)	instantiate a strategy from a config property.
private WAL	getWAL(String group)
protected WAL	getWAL0(RegionInfo region)
private WALProvider	getWALProvider(RegionInfo region)
protected List<WAL>	getWALs0()
protected void	shutdown0()

Methods inherited from class org.apache.hadoop.hbase.wal.AbstractWALProvider

addWALActionsListener, close, getLogFileSize, getNumLogFiles, getPeerActionListener, getSyncReplicationPeerIdFromWALName, getWAL, getWALs, init, initWAL, peerSyncReplicationStateChange, setSyncReplicationPeerInfoProvider, shutdown

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.wal.WALProvider

getWALFileLengthProvider

Field Details

LOG

private static final org.slf4j.Logger LOG

REGION_GROUPING_STRATEGY

public static final String REGION_GROUPING_STRATEGY

See Also:

• Constant Field Values

DEFAULT_REGION_GROUPING_STRATEGY

public static final String DEFAULT_REGION_GROUPING_STRATEGY

DELEGATE_PROVIDER

public static final String DELEGATE_PROVIDER

delegate provider for WAL creation/roll/close, but not support multiwal

See Also:

• Constant Field Values

DEFAULT_DELEGATE_PROVIDER

public static final String DEFAULT_DELEGATE_PROVIDER

META_WAL_GROUP_NAME

private static final String META_WAL_GROUP_NAME

See Also:

• Constant Field Values

cached

private final ConcurrentMap<String,WALProvider> cached

A group-provider mapping, make sure one-one rather than many-one mapping

createLock

private final KeyLocker<String> createLock

strategy

private RegionGroupingProvider.RegionGroupingStrategy strategy

providerClass

private Class<? extends WALProvider> providerClass

Constructor Details

RegionGroupingProvider

public RegionGroupingProvider()

Method Details

getStrategy

RegionGroupingProvider.RegionGroupingStrategy getStrategy(org.apache.hadoop.conf.Configuration conf,
 String key,
 String defaultValue)
                                                   throws IOException

instantiate a strategy from a config property. requires conf to have already been set (as well as anything the provider might need to read).

Throws:

IOException

doInit

protected void doInit(WALFactory factory,
 org.apache.hadoop.conf.Configuration conf,
 String providerId)
               throws IOException

Specified by:

doInit in class AbstractWALProvider

Throws:

IOException

createProvider

private WALProvider createProvider(String group)
                            throws IOException

Throws:

IOException

getWALProvider

private WALProvider getWALProvider(RegionInfo region)
                            throws IOException

Throws:

IOException

getWAL0

protected WAL getWAL0(RegionInfo region)
               throws IOException

Specified by:

getWAL0 in class AbstractWALProvider

Throws:

IOException

getWALs0

protected List<WAL> getWALs0()

Specified by:

getWALs0 in class AbstractWALProvider

getWAL

private WAL getWAL(String group)
            throws IOException

Throws:

IOException

createRemoteWAL

protected WAL createRemoteWAL(RegionInfo region,
 org.apache.hadoop.fs.FileSystem remoteFs,
 org.apache.hadoop.fs.Path remoteWALDir,
 String prefix,
 String suffix)
                       throws IOException

Specified by:

createRemoteWAL in class AbstractWALProvider

Throws:

IOException

shutdown0

protected void shutdown0()
                  throws IOException

Specified by:

shutdown0 in class AbstractWALProvider

Throws:

IOException

close0

protected void close0()
               throws IOException

Specified by:

close0 in class AbstractWALProvider

Throws:

IOException

getNumLogFiles0

protected long getNumLogFiles0()

Specified by:

getNumLogFiles0 in class AbstractWALProvider

getLogFileSize0

protected long getLogFileSize0()

Specified by:

getLogFileSize0 in class AbstractWALProvider