Package org.apache.hadoop.hbase.mob.mapreduce

Class MobRefReporter.MobRefReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hadoop.hbase.mob.mapreduce.MobRefReporter.MobRefReducer

Enclosing class:

MobRefReporter

public static class MobRefReporter.MobRefReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Field Summary

Fields

Modifier and Type	Field	Description
(package private) org.apache.hadoop.fs.Path	archive
(package private) final Base64.Encoder	base64
(package private) final org.apache.hadoop.io.Text	DATALOSS_HLINK_DANGLING
(package private) final org.apache.hadoop.io.Text	DATALOSS_MISSING
(package private) final org.apache.hadoop.io.Text	DATALOSS_MISSING_IOE
(package private) final org.apache.hadoop.io.Text	INCONSISTENT_ARCHIVE_BAD_LINK
(package private) final org.apache.hadoop.io.Text	INCONSISTENT_ARCHIVE_IOE
(package private) final org.apache.hadoop.io.Text	INCONSISTENT_ARCHIVE_STALE
(package private) org.apache.hadoop.fs.Path	mob
(package private) String	mobRegion
(package private) final org.apache.hadoop.io.Text	OK_HLINK_CLONE
(package private) final org.apache.hadoop.io.Text	OK_HLINK_RESTORE
(package private) final org.apache.hadoop.io.Text	OK_MOB_DIR
(package private) String	seperator
(package private) TableName	table

Constructor Summary

Constructors

Constructor	Description
MobRefReducer()

Method Summary

Modifier and Type	Method	Description
private org.apache.hadoop.io.Text	encodeRows(org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>.org.apache.hadoop.mapreduce.Reducer.Context context, org.apache.hadoop.io.Text key, Iterable<ImmutableBytesWritable> rows)	reuses the passed Text key.
void	reduce(org.apache.hadoop.io.Text key, Iterable<ImmutableBytesWritable> rows, org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>.org.apache.hadoop.mapreduce.Reducer.Context context)
void	setup(org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>.org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

table

TableName table

mobRegion

String mobRegion

mob

org.apache.hadoop.fs.Path mob

archive

org.apache.hadoop.fs.Path archive

seperator

String seperator

OK_MOB_DIR

final org.apache.hadoop.io.Text OK_MOB_DIR

OK_HLINK_RESTORE

final org.apache.hadoop.io.Text OK_HLINK_RESTORE

OK_HLINK_CLONE

final org.apache.hadoop.io.Text OK_HLINK_CLONE

INCONSISTENT_ARCHIVE_BAD_LINK

final org.apache.hadoop.io.Text INCONSISTENT_ARCHIVE_BAD_LINK

INCONSISTENT_ARCHIVE_STALE

final org.apache.hadoop.io.Text INCONSISTENT_ARCHIVE_STALE

INCONSISTENT_ARCHIVE_IOE

final org.apache.hadoop.io.Text INCONSISTENT_ARCHIVE_IOE

DATALOSS_MISSING

final org.apache.hadoop.io.Text DATALOSS_MISSING

DATALOSS_HLINK_DANGLING

final org.apache.hadoop.io.Text DATALOSS_HLINK_DANGLING

DATALOSS_MISSING_IOE

final org.apache.hadoop.io.Text DATALOSS_MISSING_IOE

base64

final Base64.Encoder base64

Constructor Details

MobRefReducer

public MobRefReducer()

Method Details

setup

public void setup(org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>.org.apache.hadoop.mapreduce.Reducer.Context context)
           throws IOException,
InterruptedException

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException

reduce

public void reduce(org.apache.hadoop.io.Text key,
 Iterable<ImmutableBytesWritable> rows,
 org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>.org.apache.hadoop.mapreduce.Reducer.Context context)
            throws IOException,
InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException

encodeRows

private org.apache.hadoop.io.Text encodeRows(org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>.org.apache.hadoop.mapreduce.Reducer.Context context,
 org.apache.hadoop.io.Text key,
 Iterable<ImmutableBytesWritable> rows)
                                      throws IOException

reuses the passed Text key. appends the configured seperator and then a comma seperated list of base64 encoded row keys

Throws:

IOException