Package org.apache.hadoop.hbase.regionserver

Class TestScanner

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestScanner

public class TestScanner
extends Object

Test of a long-lived scanner validating as we go.

Field Summary

Fields

Modifier and Type	Field	Description
static final HBaseClassTestRule	CLASS_RULE
private final byte[]	col1
private static final byte[][]	COLS
private static final byte[][]	EXPLICIT_COLS
private static final byte[]	FIRST_ROW
private byte[]	firstRowBytes
private static final org.slf4j.Logger	LOG
org.junit.rules.TestName	name
private org.apache.hadoop.hbase.regionserver.HRegion	region
static final org.apache.hadoop.hbase.HRegionInfo	REGION_INFO	HRegionInfo for root region
private static final byte[]	ROW_KEY
private byte[]	secondRowBytes
private static final long	START_CODE
private static final HBaseTestingUtility	TEST_UTIL
(package private) static final org.apache.hadoop.hbase.HTableDescriptor	TESTTABLEDESC
private byte[]	thirdRowBytes

Constructor Summary

Constructors

Constructor	Description
TestScanner()

Method Summary

Modifier and Type	Method	Description
private int	count(org.apache.hadoop.hbase.client.Table countTable, int flushIndex, boolean concurrent)	Count table.
private org.apache.hadoop.hbase.Cell	getColumn(List<org.apache.hadoop.hbase.Cell> kvs, byte[] family, byte[] qualifier)
private void	getRegionInfo(org.apache.hadoop.hbase.client.Table table)	Use get to retrieve the HRegionInfo and validate it
private boolean	hasColumn(List<org.apache.hadoop.hbase.Cell> kvs, byte[] family, byte[] qualifier)
(package private) void	rowInclusiveStopFilter(org.apache.hadoop.hbase.client.Scan scan, byte[] stopRow)
(package private) void	rowPrefixFilter(org.apache.hadoop.hbase.client.Scan scan)
private void	scan(boolean validateStartcode, String serverName)	Use a scanner to get the region info and then validate the results
void	testFilters()
void	testRaceBetweenClientAndTimeout()	Test that closing a scanner while a client is using it doesn't throw NPEs but instead a UnknownScannerException.
void	testScanAndConcurrentMajorCompact()	Make sure scanner returns correct result when we run a major compaction with deletes.
void	testScanAndRealConcurrentFlush()	Tests to do a concurrent flush (using a 2nd thread) while scanning.
void	testScanAndSyncFlush()	Tests to do a sync flush during the middle of a scan.
void	testScanner()	The test!
void	testStopRow()	Test basic stop row filter works.
private void	validateRegionInfo(byte[] regionBytes)	Compare the HRegionInfo we read from HBase to what we stored

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

name

public org.junit.rules.TestName name

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

private static final HBaseTestingUtility TEST_UTIL

FIRST_ROW

private static final byte[] FIRST_ROW

COLS

private static final byte[][] COLS

EXPLICIT_COLS

private static final byte[][] EXPLICIT_COLS

TESTTABLEDESC

static final org.apache.hadoop.hbase.HTableDescriptor TESTTABLEDESC

REGION_INFO

public static final org.apache.hadoop.hbase.HRegionInfo REGION_INFO

HRegionInfo for root region

ROW_KEY

private static final byte[] ROW_KEY

START_CODE

private static final long START_CODE

See Also:

• Constant Field Values

region

private org.apache.hadoop.hbase.regionserver.HRegion region

firstRowBytes

private byte[] firstRowBytes

secondRowBytes

private byte[] secondRowBytes

thirdRowBytes

private byte[] thirdRowBytes

col1

private final byte[] col1

Constructor Details

TestScanner

public TestScanner()

Method Details

testStopRow

public void testStopRow()
                 throws Exception

Test basic stop row filter works.

Throws:

Exception

rowPrefixFilter

void rowPrefixFilter(org.apache.hadoop.hbase.client.Scan scan)
              throws IOException

Throws:

IOException

rowInclusiveStopFilter

void rowInclusiveStopFilter(org.apache.hadoop.hbase.client.Scan scan,
 byte[] stopRow)
                     throws IOException

Throws:

IOException

testFilters

public void testFilters()
                 throws IOException

Throws:

IOException

testRaceBetweenClientAndTimeout

public void testRaceBetweenClientAndTimeout()
                                     throws Exception

Test that closing a scanner while a client is using it doesn't throw NPEs but instead a UnknownScannerException. HBASE-2503

Throws:

Exception

testScanner

public void testScanner()
                 throws IOException

The test!

Throws:

IOException

validateRegionInfo

private void validateRegionInfo(byte[] regionBytes)
                         throws IOException

Compare the HRegionInfo we read from HBase to what we stored

Throws:

IOException

scan

private void scan(boolean validateStartcode,
 String serverName)
           throws IOException

Use a scanner to get the region info and then validate the results

Throws:

IOException

hasColumn

private boolean hasColumn(List<org.apache.hadoop.hbase.Cell> kvs,
 byte[] family,
 byte[] qualifier)

getColumn

private org.apache.hadoop.hbase.Cell getColumn(List<org.apache.hadoop.hbase.Cell> kvs,
 byte[] family,
 byte[] qualifier)

getRegionInfo

private void getRegionInfo(org.apache.hadoop.hbase.client.Table table)
                    throws IOException

Use get to retrieve the HRegionInfo and validate it

Throws:

IOException

testScanAndSyncFlush

public void testScanAndSyncFlush()
                          throws Exception

Tests to do a sync flush during the middle of a scan. This is testing the StoreScanner update readers code essentially. This is not highly concurrent, since its all 1 thread. HBase-910.

Throws:

Exception

testScanAndRealConcurrentFlush

public void testScanAndRealConcurrentFlush()
                                    throws Exception

Tests to do a concurrent flush (using a 2nd thread) while scanning. This tests both the StoreScanner update readers and the transition from memstore -> snapshot -> store file.

Throws:

Exception

testScanAndConcurrentMajorCompact

public void testScanAndConcurrentMajorCompact()
                                       throws Exception

Make sure scanner returns correct result when we run a major compaction with deletes.

Throws:

Exception

count

private int count(org.apache.hadoop.hbase.client.Table countTable,
 int flushIndex,
 boolean concurrent)
           throws Exception

Count table.

Parameters:

hri - Region

flushIndex - At what row we start the flush.

concurrent - if the flush should be concurrent or sync.

Returns:

Count of rows found.

Throws:

Exception