Package org.apache.hadoop.hbase.master.normalizer

Class TestSimpleRegionNormalizerOnCluster

java.lang.Object

org.apache.hadoop.hbase.master.normalizer.TestSimpleRegionNormalizerOnCluster

public class TestSimpleRegionNormalizerOnCluster
extends Object

Testing SimpleRegionNormalizer on minicluster.

Field Summary

Fields

Modifier and Type	Field	Description
private static org.apache.hadoop.hbase.client.AsyncAdmin	admin
static final HBaseClassTestRule	CLASS_RULE
private static final byte[]	FAMILY_NAME
private static final org.slf4j.Logger	LOG
private static org.apache.hadoop.hbase.master.HMaster	master
org.junit.rules.TestName	name
private static final HBaseTestingUtil	TEST_UTIL

Constructor Summary

Constructors

Constructor	Description
TestSimpleRegionNormalizerOnCluster()

Method Summary

Modifier and Type	Method	Description
static void	afterAllTests()
void	before()
static void	beforeAllTests()
private static org.apache.hadoop.hbase.TableName	buildTableNameForQuotaTest(String methodName)
private static int	createTableBegsMerge(org.apache.hadoop.hbase.TableName tableName)	create a table with 5 regions, having region sizes so as to provoke a merge of the smallest regions.
private static int	createTableBegsSplit(org.apache.hadoop.hbase.TableName tableName, boolean normalizerEnabled, boolean isMergeEnabled)	create a table with 5 regions, having region sizes so as to provoke a split of the largest region.
private static int	createTableTargetOfSplitAndMerge(org.apache.hadoop.hbase.TableName tableName)	Create a table with 4 regions, having region sizes so as to provoke a split of the largest region and a merge of an empty region into the largest.
private static void	dropIfExists(org.apache.hadoop.hbase.TableName tableName)
private static void	generateTestData(org.apache.hadoop.hbase.regionserver.Region region, int numRows)
private static List<org.apache.hadoop.hbase.regionserver.HRegion>	generateTestData(org.apache.hadoop.hbase.TableName tableName, int... regionSizesMb)
private static int	getRegionCount(org.apache.hadoop.hbase.TableName tableName)
private static int	getRegionCountUnchecked(org.apache.hadoop.hbase.TableName tableName)
private static double	getRegionSizeMB(org.apache.hadoop.hbase.master.MasterServices masterServices, org.apache.hadoop.hbase.client.RegionInfo regionInfo)
void	testHonorsNameFilter()
void	testHonorsNamespaceFilter()
void	testHonorsNormalizerSwitch()
void	testHonorsNormalizerTableSetting()	Test that disabling normalizer via table configuration is honored.
void	testHonorsPatternFilter()
void	testRegionNormalizationMerge()
(package private) void	testRegionNormalizationSplit(boolean limitedByQuota)
void	testRegionNormalizationSplitWithoutQuotaLimit()
void	testRegionNormalizationSplitWithQuotaLimit()
void	testTargetOfSplitAndMerge()	A test for when a region is the target of both a split and a merge plan.
private static void	waitForSkippedSplits(org.apache.hadoop.hbase.master.HMaster master, long existingSkippedSplitCount)
private static void	waitForTableRegionCount(org.apache.hadoop.hbase.TableName tableName, org.hamcrest.Matcher<? super Integer> matcher)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

TEST_UTIL

private static final HBaseTestingUtil TEST_UTIL

FAMILY_NAME

private static final byte[] FAMILY_NAME

admin

private static org.apache.hadoop.hbase.client.AsyncAdmin admin

master

private static org.apache.hadoop.hbase.master.HMaster master

name

public org.junit.rules.TestName name

Constructor Details

TestSimpleRegionNormalizerOnCluster

public TestSimpleRegionNormalizerOnCluster()

Method Details

beforeAllTests

public static void beforeAllTests()
                           throws Exception

Throws:

Exception

afterAllTests

public static void afterAllTests()
                          throws Exception

Throws:

Exception

before

public void before()
            throws Exception

Throws:

Exception

testHonorsNormalizerSwitch

public void testHonorsNormalizerSwitch()
                                throws Exception

Throws:

Exception

testHonorsNormalizerTableSetting

public void testHonorsNormalizerTableSetting()
                                      throws Exception

Test that disabling normalizer via table configuration is honored. There's no side-effect to look for (other than a log message), so normalize two tables, one with the disabled setting, and look for change in one and no change in the other.

Throws:

Exception

testRegionNormalizationSplitWithoutQuotaLimit

public void testRegionNormalizationSplitWithoutQuotaLimit()
                                                   throws Exception

Throws:

Exception

testRegionNormalizationSplitWithQuotaLimit

public void testRegionNormalizationSplitWithQuotaLimit()
                                                throws Exception

Throws:

Exception

testRegionNormalizationSplit

void testRegionNormalizationSplit(boolean limitedByQuota)
                           throws Exception

Throws:

Exception

testRegionNormalizationMerge

public void testRegionNormalizationMerge()
                                  throws Exception

Throws:

Exception

testHonorsNamespaceFilter

public void testHonorsNamespaceFilter()
                               throws Exception

Throws:

Exception

testHonorsPatternFilter

public void testHonorsPatternFilter()
                             throws Exception

Throws:

Exception

testHonorsNameFilter

public void testHonorsNameFilter()
                          throws Exception

Throws:

Exception

testTargetOfSplitAndMerge

public void testTargetOfSplitAndMerge()
                               throws Exception

A test for when a region is the target of both a split and a merge plan. Does not define expected behavior, only that some change is applied to the table.

Throws:

Exception

buildTableNameForQuotaTest

private static org.apache.hadoop.hbase.TableName buildTableNameForQuotaTest(String methodName)
                                                                     throws Exception

Throws:

Exception

waitForSkippedSplits

private static void waitForSkippedSplits(org.apache.hadoop.hbase.master.HMaster master,
 long existingSkippedSplitCount)

waitForTableRegionCount

private static void waitForTableRegionCount(org.apache.hadoop.hbase.TableName tableName,
 org.hamcrest.Matcher<? super Integer> matcher)

generateTestData

private static List<org.apache.hadoop.hbase.regionserver.HRegion> generateTestData(org.apache.hadoop.hbase.TableName tableName,
 int... regionSizesMb)
                                                                            throws IOException

Throws:

IOException

generateTestData

private static void generateTestData(org.apache.hadoop.hbase.regionserver.Region region,
 int numRows)
                              throws IOException

Throws:

IOException

getRegionSizeMB

private static double getRegionSizeMB(org.apache.hadoop.hbase.master.MasterServices masterServices,
 org.apache.hadoop.hbase.client.RegionInfo regionInfo)

createTableBegsSplit

private static int createTableBegsSplit(org.apache.hadoop.hbase.TableName tableName,
 boolean normalizerEnabled,
 boolean isMergeEnabled)
                                 throws Exception

create a table with 5 regions, having region sizes so as to provoke a split of the largest region.

• total table size: 12
• average region size: 2.4
• split threshold: 2.4 * 2 = 4.8

Throws:

Exception

createTableBegsMerge

private static int createTableBegsMerge(org.apache.hadoop.hbase.TableName tableName)
                                 throws Exception

create a table with 5 regions, having region sizes so as to provoke a merge of the smallest regions.

• total table size: 13
• average region size: 2.6
• sum of sizes of first two regions < average

Throws:

Exception

createTableTargetOfSplitAndMerge

private static int createTableTargetOfSplitAndMerge(org.apache.hadoop.hbase.TableName tableName)
                                             throws Exception

Create a table with 4 regions, having region sizes so as to provoke a split of the largest region and a merge of an empty region into the largest.

• total table size: 14
• average region size: 3.5

Throws:

Exception

dropIfExists

private static void dropIfExists(org.apache.hadoop.hbase.TableName tableName)
                          throws Exception

Throws:

Exception

getRegionCount

private static int getRegionCount(org.apache.hadoop.hbase.TableName tableName)
                           throws IOException

Throws:

IOException

getRegionCountUnchecked

private static int getRegionCountUnchecked(org.apache.hadoop.hbase.TableName tableName)