Package org.apache.hadoop.hbase.mapreduce.replication

Class VerifyReplication.Verifier

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,KEYOUT,VALUEOUT>

org.apache.hadoop.hbase.mapreduce.TableMapper<ImmutableBytesWritable,Put>

org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication.Verifier

Enclosing class:

VerifyReplication

public static class VerifyReplication.Verifier
extends TableMapper<ImmutableBytesWritable,Put>

Map-only comparator for 2 tables

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	VerifyReplication.Verifier.Counters

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields

Modifier and Type	Field	Description
private int	batch
private Result	currentCompareRowInPeerTable
private String	delimiter
private int	reCompareBackoffExponent
private int	reCompareTries
private Connection	replicatedConnection
private ResultScanner	replicatedScanner
private Table	replicatedTable
private int	sleepMsBeforeReCompare
private Connection	sourceConnection
private Table	sourceTable
private Scan	tableScan
private boolean	verbose

Constructor Summary

Constructors

Constructor	Description
Verifier()

Method Summary

Modifier and Type	Method	Description
protected void	cleanup(org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>.org.apache.hadoop.mapreduce.Mapper.Context context)
private void	logFailRowAndIncreaseCounter(org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>.org.apache.hadoop.mapreduce.Mapper.Context context, VerifyReplication.Verifier.Counters counter, Result row, Result replicatedRow)
void	map(ImmutableBytesWritable row, Result value, org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>.org.apache.hadoop.mapreduce.Mapper.Context context)	Map method that compares every scanned row with the equivalent from a distant cluster.

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

sourceConnection

private Connection sourceConnection

sourceTable

private Table sourceTable

replicatedConnection

private Connection replicatedConnection

replicatedTable

private Table replicatedTable

replicatedScanner

private ResultScanner replicatedScanner

currentCompareRowInPeerTable

private Result currentCompareRowInPeerTable

tableScan

private Scan tableScan

reCompareTries

private int reCompareTries

reCompareBackoffExponent

private int reCompareBackoffExponent

sleepMsBeforeReCompare

private int sleepMsBeforeReCompare

delimiter

private String delimiter

verbose

private boolean verbose

batch

private int batch

Constructor Details

Verifier

public Verifier()

Method Details

map

public void map(ImmutableBytesWritable row,
 Result value,
 org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>.org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException

Map method that compares every scanned row with the equivalent from a distant cluster.

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>

Parameters:

row - The current table row key.

value - The columns.

context - The current context.

Throws:

IOException - When something is broken with the data.

logFailRowAndIncreaseCounter

private void logFailRowAndIncreaseCounter(org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>.org.apache.hadoop.mapreduce.Mapper.Context context,
 VerifyReplication.Verifier.Counters counter,
 Result row,
 Result replicatedRow)

cleanup

protected void cleanup(org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>.org.apache.hadoop.mapreduce.Mapper.Context context)

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>