Package org.apache.hadoop.hbase.backup.mapreduce

Class MapReduceBackupCopyJob

java.lang.Object

org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, BackupCopyJob

@Private
public class MapReduceBackupCopyJob
extends Object
implements BackupCopyJob

Map-Reduce implementation of BackupCopyJob. Basically, there are 2 types of copy operation: one is copying from snapshot, which bases on extending ExportSnapshot's function, the other is copying for incremental log files, which bases on extending DistCp's function.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) class	MapReduceBackupCopyJob.BackupDistCp	Extends DistCp for progress updating to backup system table during backup.
(package private) static class	MapReduceBackupCopyJob.SnapshotCopy

Field Summary

Fields

Modifier and Type	Field	Description
static final String	BACKUP_COPY_OPTION_PREFIX
private long	bytesCopied
private org.apache.hadoop.conf.Configuration	conf
private static float	INIT_PROGRESS
private static final org.slf4j.Logger	LOG
static final String	NUMBER_OF_LEVELS_TO_PRESERVE_KEY
private float	progressDone
private float	subTaskPercntgInWholeTask

Constructor Summary

Constructors

Constructor	Description
MapReduceBackupCopyJob()

Method Summary

Modifier and Type	Method	Description
void	cancel(String jobId)	Cancel copy job
int	copy(BackupInfo context, BackupManager backupManager, org.apache.hadoop.conf.Configuration conf, BackupType copyType, String[] options)	Do backup copy based on different types.
org.apache.hadoop.conf.Configuration	getConf()
float	getSubTaskPercntgInWholeTask()	Get the current copy task percentage within the whole task if multiple copies are needed.
protected static List<String>	parseDistCpOptions(org.apache.hadoop.conf.Configuration conf)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	setSubTaskPercntgInWholeTask(float subTaskPercntgInWholeTask)	Set the current copy task percentage within the whole task if multiple copies are needed.
(package private) static void	updateProgress(BackupInfo backupInfo, BackupManager backupManager, int newProgress, long bytesCopied)	Update the ongoing backup with new progress.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NUMBER_OF_LEVELS_TO_PRESERVE_KEY

public static final String NUMBER_OF_LEVELS_TO_PRESERVE_KEY

See Also:

• Constant Field Values

BACKUP_COPY_OPTION_PREFIX

public static final String BACKUP_COPY_OPTION_PREFIX

See Also:

• Constant Field Values

LOG

private static final org.slf4j.Logger LOG

conf

private org.apache.hadoop.conf.Configuration conf

progressDone

private float progressDone

bytesCopied

private long bytesCopied

INIT_PROGRESS

private static float INIT_PROGRESS

subTaskPercntgInWholeTask

private float subTaskPercntgInWholeTask

Constructor Details

MapReduceBackupCopyJob

public MapReduceBackupCopyJob()

Method Details

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getSubTaskPercntgInWholeTask

public float getSubTaskPercntgInWholeTask()

Get the current copy task percentage within the whole task if multiple copies are needed.

Returns:

the current copy task percentage

setSubTaskPercntgInWholeTask

public void setSubTaskPercntgInWholeTask(float subTaskPercntgInWholeTask)

Set the current copy task percentage within the whole task if multiple copies are needed. Must be called before calling copy(BackupInfo, BackupManager, Configuration, BackupType, String[])

Parameters:

subTaskPercntgInWholeTask - The percentage of the copy subtask

updateProgress

static void updateProgress(BackupInfo backupInfo,
 BackupManager backupManager,
 int newProgress,
 long bytesCopied)
                    throws IOException

Update the ongoing backup with new progress.

Parameters:

backupInfo - backup info

newProgress - progress

bytesCopied - bytes copied

Throws:

IOException - exception

copy

public int copy(BackupInfo context,
 BackupManager backupManager,
 org.apache.hadoop.conf.Configuration conf,
 BackupType copyType,
 String[] options)
         throws IOException

Do backup copy based on different types.

Specified by:

copy in interface BackupCopyJob

Parameters:

context - The backup info

conf - The hadoop configuration

copyType - The backup copy type

options - Options for customized ExportSnapshot or DistCp

backupManager - backup manager

Returns:

result (0 - success, -1 failure )

Throws:

IOException - exception

cancel

public void cancel(String jobId)
            throws IOException

Description copied from interface: BackupCopyJob

Cancel copy job

Specified by:

cancel in interface BackupCopyJob

Parameters:

jobId - backup copy job handler

Throws:

IOException - if cancelling the jobs fails

parseDistCpOptions

protected static List<String> parseDistCpOptions(org.apache.hadoop.conf.Configuration conf)