Package org.apache.hadoop.hbase.mob

Class MobStressToolRunner

java.lang.Object

org.apache.hadoop.hbase.mob.MobStressToolRunner

public class MobStressToolRunner
extends Object

Reproduction for MOB data loss 1. Settings: Region Size 200 MB, Flush threshold 800 KB. 2. Insert 10 Million records 3. MOB Compaction and Archiver a) Trigger MOB Compaction (every 2 minutes) b) Trigger major compaction (every 2 minutes) c) Trigger archive cleaner (every 3 minutes) 4. Validate MOB data after complete data load. This class is used by MobStressTool only. This is not a unit test

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) class	MobStressToolRunner.CleanMobAndArchive
(package private) class	MobStressToolRunner.MajorCompaction
(package private) class	MobStressToolRunner.WriteData

Field Summary

Fields

Modifier and Type	Field	Description
private org.apache.hadoop.hbase.client.Admin	admin
private org.apache.hadoop.conf.Configuration	conf
private long	count
private double	failureProb
private static final byte[]	fam
private org.apache.hadoop.hbase.client.ColumnFamilyDescriptor	familyDescriptor
private static final String	famStr
private HBaseTestingUtil	HTU
private static final org.slf4j.Logger	LOG
private static final long	mobLen
private static final byte[]	mobVal
private static final byte[]	qualifier
private static boolean	run
private org.apache.hadoop.hbase.client.Table	table
private org.apache.hadoop.hbase.client.TableDescriptor	tableDescriptor

Constructor Summary

Constructors

Constructor	Description
MobStressToolRunner()

Method Summary

Modifier and Type	Method	Description
private long	getNumberOfMobFiles(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hbase.TableName tableName, String family)
void	init(org.apache.hadoop.conf.Configuration conf, long numRows)
private void	initConf()
private void	printConf()
void	printStats(long loaded)
void	runStressTest()
private void	scanTable()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

HTU

private HBaseTestingUtil HTU

famStr

private static final String famStr

See Also:

• Constant Field Values

fam

private static final byte[] fam

qualifier

private static final byte[] qualifier

mobLen

private static final long mobLen

See Also:

• Constant Field Values

mobVal

private static final byte[] mobVal

conf

private org.apache.hadoop.conf.Configuration conf

tableDescriptor

private org.apache.hadoop.hbase.client.TableDescriptor tableDescriptor

familyDescriptor

private org.apache.hadoop.hbase.client.ColumnFamilyDescriptor familyDescriptor

admin

private org.apache.hadoop.hbase.client.Admin admin

count

private long count

failureProb

private double failureProb

table

private org.apache.hadoop.hbase.client.Table table

run

private static volatile boolean run

Constructor Details

MobStressToolRunner

public MobStressToolRunner()

Method Details

init

public void init(org.apache.hadoop.conf.Configuration conf,
 long numRows)
          throws IOException

Throws:

IOException

printConf

private void printConf()

initConf

private void initConf()

runStressTest

public void runStressTest()
                   throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

getNumberOfMobFiles

private long getNumberOfMobFiles(org.apache.hadoop.conf.Configuration conf,
 org.apache.hadoop.hbase.TableName tableName,
 String family)
                          throws IOException

Throws:

IOException

printStats

public void printStats(long loaded)

scanTable

private void scanTable()