Package org.apache.hadoop.hbase.regionserver

Class TestWALMonotonicallyIncreasingSeqId

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestWALMonotonicallyIncreasingSeqId

public class TestWALMonotonicallyIncreasingSeqId
extends Object

Test for HBASE-17471.

MVCCPreAssign is added by HBASE-16698, but pre-assign mvcc is only used in put/delete path. Other write paths like increment/append still assign mvcc in ringbuffer's consumer thread. If put and increment are used parallel. Then seqid in WAL may not increase monotonically Disorder in wals will lead to data loss.

This case use two thread to put and increment at the same time in a single region. Then check the seqid in WAL. If seqid is wal is not monotonically increasing, this case will fail

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	TestWALMonotonicallyIncreasingSeqId.IncThread
class	TestWALMonotonicallyIncreasingSeqId.PutThread

Field Summary

Fields

Modifier and Type	Field	Description
static final HBaseClassTestRule	CLASS_RULE
private org.apache.hadoop.fs.FileSystem	fileSystem
(package private) CountDownLatch	latch
private final org.slf4j.Logger	LOG
org.junit.rules.TestName	name
private org.apache.hadoop.hbase.regionserver.HRegion	region
private static final HBaseTestingUtil	TEST_UTIL
private static org.apache.hadoop.fs.Path	testDir
private org.apache.hadoop.conf.Configuration	walConf
String	walProvider
private org.apache.hadoop.hbase.wal.WALFactory	wals

Constructor Summary

Constructors

Constructor	Description
TestWALMonotonicallyIncreasingSeqId()

Method Summary

Modifier and Type	Method	Description
private org.apache.hadoop.hbase.wal.WALStreamReader	createReader(org.apache.hadoop.fs.Path logPath, org.apache.hadoop.fs.Path oldWalsDir)
static List<Object[]>	data()
private org.apache.hadoop.hbase.client.TableDescriptor	getTableDesc(org.apache.hadoop.hbase.TableName tableName, byte[]... families)
private org.apache.hadoop.hbase.regionserver.HRegion	initHRegion(org.apache.hadoop.hbase.client.TableDescriptor htd, byte[] startKey, byte[] stopKey, int replicaId)
void	setUp()
void	tearDown()
static void	tearDownAfterClass()
void	testWALMonotonicallyIncreasingSeqId()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private final org.slf4j.Logger LOG

TEST_UTIL

private static final HBaseTestingUtil TEST_UTIL

testDir

private static org.apache.hadoop.fs.Path testDir

wals

private org.apache.hadoop.hbase.wal.WALFactory wals

fileSystem

private org.apache.hadoop.fs.FileSystem fileSystem

walConf

private org.apache.hadoop.conf.Configuration walConf

region

private org.apache.hadoop.hbase.regionserver.HRegion region

walProvider

public String walProvider

name

public org.junit.rules.TestName name

latch

CountDownLatch latch

Constructor Details

TestWALMonotonicallyIncreasingSeqId

public TestWALMonotonicallyIncreasingSeqId()

Method Details

data

public static List<Object[]> data()

getTableDesc

private org.apache.hadoop.hbase.client.TableDescriptor getTableDesc(org.apache.hadoop.hbase.TableName tableName,
 byte[]... families)

initHRegion

private org.apache.hadoop.hbase.regionserver.HRegion initHRegion(org.apache.hadoop.hbase.client.TableDescriptor htd,
 byte[] startKey,
 byte[] stopKey,
 int replicaId)
                                                          throws IOException

Throws:

IOException

setUp

public void setUp()
           throws IOException

Throws:

IOException

tearDown

public void tearDown()
              throws IOException

Throws:

IOException

tearDownAfterClass

public static void tearDownAfterClass()
                               throws IOException

Throws:

IOException

createReader

private org.apache.hadoop.hbase.wal.WALStreamReader createReader(org.apache.hadoop.fs.Path logPath,
 org.apache.hadoop.fs.Path oldWalsDir)
                                                          throws IOException

Throws:

IOException

testWALMonotonicallyIncreasingSeqId

public void testWALMonotonicallyIncreasingSeqId()
                                         throws Exception

Throws:

Exception