Package org.apache.hadoop.hbase.util

Class HBaseFsck

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.util.HBaseFsck

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable

@Deprecated
@LimitedPrivate("Tools")
@Evolving
public class HBaseFsck
extends org.apache.hadoop.conf.Configured
implements Closeable

Deprecated.

For removal in hbase-4.0.0. Use HBCK2 instead.

HBaseFsck (hbck) is a tool for checking and repairing region consistency and table integrity problems in a corrupted HBase. This tool was written for hbase-1.x. It does not work with hbase-2.x; it can read state but is not allowed to change state; i.e. effect 'repair'. Even though it can 'read' state, given how so much has changed in how hbase1 and hbase2 operate, it will often misread. See hbck2 (HBASE-19121) for a hbck tool for hbase2. This class is deprecated.

Region consistency checks verify that hbase:meta, region deployment on region servers and the state of data in HDFS (.regioninfo files) all are in accordance.

Table integrity checks verify that all possible row keys resolve to exactly one region of a table. This means there are no individual degenerate or backwards regions; no holes between regions; and that there are no overlapping regions.

The general repair strategy works in two phases:

1. Repair Table Integrity on HDFS. (merge or fabricate regions)
2. Repair Region Consistency with hbase:meta and assignments

For table integrity repairs, the tables' region directories are scanned for .regioninfo files. Each table's integrity is then verified. If there are any orphan regions (regions with no .regioninfo files) or holes, new regions are fabricated. Backwards regions are sidelined as well as empty degenerate (endkey==startkey) regions. If there are any overlapping regions, a new region is created and all data is merged into the new region.

Table integrity repairs deal solely with HDFS and could potentially be done offline -- the hbase region servers or master do not need to be running. This phase can eventually be used to completely reconstruct the hbase:meta table in an offline fashion.

Region consistency requires three conditions -- 1) valid .regioninfo file present in an HDFS region dir, 2) valid row with .regioninfo data in META, and 3) a region is deployed only at the regionserver that was assigned to with proper state in the master.

Region consistency repairs require hbase to be online so that hbck can contact the HBase master and region servers. The hbck#connect() method must first be called successfully. Much of the region consistency information is transient and less risky to repair.

If hbck is run from the command line, there are a handful of arguments that can be used to limit the kinds of repairs hbck will do. See the code in printUsageAndExit() for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) class	HBaseFsck.CheckRegionConsistencyWorkItem	Deprecated.
private static class	HBaseFsck.FileLockCallable	Deprecated.
(package private) static class	HBaseFsck.HBaseFsckTool	Deprecated. This is a Tool wrapper that gathers -Dxxx=yyy configuration settings from the command line.
(package private) static class	HBaseFsck.PrintingErrorReporter	Deprecated.
private static class	HBaseFsck.RegionBoundariesInformation	Deprecated.
(package private) class	HBaseFsck.WorkItemHdfsDir	Deprecated. Contact hdfs and get all information about specified table directory into regioninfo list.
(package private) static class	HBaseFsck.WorkItemHdfsRegionInfo	Deprecated. Contact hdfs and get all information about specified table directory into regioninfo list.
(package private) static class	HBaseFsck.WorkItemOverlapMerge	Deprecated.
(package private) static class	HBaseFsck.WorkItemRegion	Deprecated. Contact a region server and get all information from it

Field Summary

Fields

Modifier and Type	Field	Description
private Admin	admin	Deprecated.
private boolean	checkHdfs	Deprecated.
private boolean	checkMetaOnly	Deprecated.
private boolean	checkRegionBoundaries	Deprecated.
private boolean	cleanReplicationBarrier	Deprecated.
private TableName	cleanReplicationBarrierTable	Deprecated.
private ClusterConnection	connection	Deprecated.
private final RetryCounterFactory	createZNodeRetryCounterFactory	Deprecated.
private static final int	DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME	Deprecated.
private static final int	DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL	Deprecated.
private static final int	DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME	Deprecated.
private static final int	DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL	Deprecated.
private static final int	DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS	Deprecated.
private static final int	DEFAULT_MAX_LOCK_FILE_ATTEMPTS	Deprecated.
private static final int	DEFAULT_MAX_MERGE	Deprecated.
private static final int	DEFAULT_OVERLAPS_TO_SIDELINE	Deprecated.
static final long	DEFAULT_SLEEP_BEFORE_RERUN	Deprecated.
static final long	DEFAULT_TIME_LAG	Deprecated.
private static final int	DEFAULT_WAIT_FOR_LOCK_TIMEOUT	Deprecated.
private static boolean	details	Deprecated. Options
private Set<Result>	emptyRegionInfoQualifiers	Deprecated.
private final HbckErrorReporter	errors	Deprecated. State
protected ExecutorService	executor	Deprecated.
private boolean	fixAny	Deprecated.
private boolean	fixAssignments	Deprecated.
private boolean	fixEmptyMetaCells	Deprecated.
(package private) int	fixes	Deprecated.
private boolean	fixHdfsHoles	Deprecated.
private boolean	fixHdfsOrphans	Deprecated.
private boolean	fixHdfsOverlaps	Deprecated.
private boolean	fixHFileLinks	Deprecated.
private boolean	fixMeta	Deprecated.
private boolean	fixReferenceFiles	Deprecated.
private boolean	fixReplication	Deprecated.
private boolean	fixSplitParents	Deprecated.
private boolean	fixTableOrphans	Deprecated.
private boolean	fixVersionFile	Deprecated.
private static boolean	forceExclusive	Deprecated.
static final String	HBCK_LOCK_FILE	Deprecated. Here is where hbase-1.x used to default the lock for hbck1.
private org.apache.hadoop.fs.Path	HBCK_LOCK_PATH	Deprecated.
private String	hbckEphemeralNodePath	Deprecated.
private final AtomicBoolean	hbckLockCleanup	Deprecated.
private org.apache.hadoop.fs.FSDataOutputStream	hbckOutFd	Deprecated.
private boolean	hbckZodeCreated	Deprecated.
private HFileCorruptionChecker	hfcc	Deprecated.
private boolean	ignorePreCheckPermission	Deprecated.
private final RetryCounterFactory	lockFileRetryCounterFactory	Deprecated.
private static final org.slf4j.Logger	LOG	Deprecated. Internal resources
private static final int	MAX_NUM_THREADS	Deprecated.
private int	maxMerge	Deprecated.
private int	maxOverlapsToSideline	Deprecated.
private Table	meta	Deprecated.
private List<HbckRegionInfo>	orphanHdfsDirs	Deprecated. When initially looking at HDFS, we attempt to find any orphaned data.
private Map<TableName,Set<String>>	orphanTableDirs	Deprecated.
private TreeMap<String,HbckRegionInfo>	regionInfoMap	Deprecated. This map contains the state of all hbck items.
private boolean	removeParents	Deprecated.
private boolean	rerun	Deprecated.
private int	retcode	Deprecated.
private static boolean	rsSupportsOffline	Deprecated.
private boolean	sidelineBigOverlaps	Deprecated.
private org.apache.hadoop.fs.Path	sidelineDir	Deprecated.
private Map<TableName,Set<String>>	skippedRegions	Deprecated.
private long	startMillis	Deprecated.
private ClusterMetrics	status	Deprecated.
private static boolean	summary	Deprecated.
private Set<TableName>	tablesIncluded	Deprecated.
private SortedMap<TableName,HbckTableInfo>	tablesInfo	Deprecated. This map from Tablename -> TableInfo contains the structures necessary to detect table consistency problems (holes, dupes, overlaps).
private Map<TableName,TableState>	tableStates	Deprecated.
private long	timelag	Deprecated.
private static final Set<String>	unsupportedOptionsInV2	Deprecated.
private ZKWatcher	zkw	Deprecated.

Constructor Summary

Constructors

Constructor	Description
HBaseFsck(org.apache.hadoop.conf.Configuration conf)	Deprecated. Constructor
HBaseFsck(org.apache.hadoop.conf.Configuration conf, ExecutorService exec)	Deprecated. Constructor Configuration object if the master is not running if unable to connect to ZooKeeper

Method Summary

Modifier and Type	Method	Description
private void	addSkippedRegion(HbckRegionInfo hbi)	Deprecated.
private void	adoptHdfsOrphan(HbckRegionInfo hi)	Deprecated. Orphaned regions are regions without a .regioninfo file in them.
private void	adoptHdfsOrphans(Collection<HbckRegionInfo> orphanHdfsDirs)	Deprecated. Iterates through the list of all orphan/invalid regiondirs.
private void	assignMetaReplica(int replicaId)	Deprecated.
private void	checkAndFixConsistency()	Deprecated. Check consistency of all regions that have been found in previous phases.
private void	checkAndFixReplication()	Deprecated.
private void	checkAndFixTableStates()	Deprecated. Check and fix table states, assumes full info available: - tableInfos - empty tables loaded
static Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.FSDataOutputStream>	checkAndMarkRunningHbck(org.apache.hadoop.conf.Configuration conf, RetryCounter retryCounter)	Deprecated. This method maintains a lock using a file.
private SortedMap<TableName,HbckTableInfo>	checkHdfsIntegrity(boolean fixHoles, boolean fixOverlaps)	Deprecated.
(package private) SortedMap<TableName,HbckTableInfo>	checkIntegrity()	Deprecated. Checks tables integrity.
(package private) boolean	checkMetaRegion()	Deprecated. Check values in regionInfo for hbase:meta Check if zero or more than one regions with hbase:meta are found.
void	checkRegionBoundaries()	Deprecated.
private void	checkRegionConsistency(String key, HbckRegionInfo hbi)	Deprecated. Check a single region for consistency and correct deployment.
private void	checkRegionConsistencyConcurrently(List<HBaseFsck.CheckRegionConsistencyWorkItem> workItems)	Deprecated. Check consistency of all regions using multiple threads concurrently.
void	cleanReplicationBarrier()	Deprecated.
private void	cleanupHbckZnode()	Deprecated.
private void	clearState()	Deprecated. Clear the current state of hbck.
void	close()	Deprecated.
(package private) void	closeRegion(HbckRegionInfo hi)	Deprecated. Attempts to undeploy a region from a region server based in information in META.
void	connect()	Deprecated. To repair region consistency, one must call connect() in order to repair online state.
protected HFileCorruptionChecker	createHFileCorruptionChecker(boolean sidelineCorruptHFiles)	Deprecated.
static RetryCounterFactory	createLockRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)	Deprecated. Returns A retry counter factory configured for retrying lock file creation.
private static ExecutorService	createThreadPool(org.apache.hadoop.conf.Configuration conf)	Deprecated.
private static RetryCounterFactory	createZnodeRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)	Deprecated. Returns A retry counter factory configured for retrying znode creation.
private ZKWatcher	createZooKeeperWatcher()	Deprecated.
static void	debugLsr(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path p)	Deprecated. ls -r for debugging purposes
static void	debugLsr(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path p, HbckErrorReporter errors)	Deprecated. ls -r for debugging purposes
(package private) void	debugLsr(org.apache.hadoop.fs.Path p)	Deprecated. ls -r for debugging purposes
private void	deleteMetaRegion(byte[] metaKey)	Deprecated. Deletes region from meta table
private void	deleteMetaRegion(HbckRegionInfo hi)	Deprecated. Deletes region from meta table
HBaseFsck	exec(ExecutorService exec, String[] args)	Deprecated.
private boolean	fabricateTableInfo(FSTableDescriptors fstd, TableName tableName, Set<String> columns)	Deprecated. To fabricate a .tableinfo file with following contents 1.
void	fixEmptyMetaCells()	Deprecated. To fix the empty REGIONINFO_QUALIFIER rows from hbase:meta
void	fixOrphanTables()	Deprecated. To fix orphan table by creating a .tableinfo file under tableDir 1.
private Set<String>	getColumnFamilyList(Set<String> columns, HbckRegionInfo hbi)	Deprecated. To get the column family list according to the column family dirs
(package private) static HbckErrorReporter	getErrorReporter(org.apache.hadoop.conf.Configuration conf)	Deprecated.
HbckErrorReporter	getErrors()	Deprecated.
HFileCorruptionChecker	getHFilecorruptionChecker()	Deprecated.
(package private) Set<TableName>	getIncludedTables()	Deprecated.
int	getMaxMerge()	Deprecated.
int	getMaxOverlapsToSideline()	Deprecated.
private HbckRegionInfo	getOrCreateInfo(String name)	Deprecated. Gets the entry in regionInfo corresponding to the the given encoded region name.
int	getRetCode()	Deprecated.
(package private) org.apache.hadoop.fs.Path	getSidelineDir()	Deprecated.
(package private) TableDescriptor[]	getTableDescriptors(List<TableName> tableNames)	Deprecated.
(package private) TableDescriptor[]	getTables(AtomicInteger numSkipped)	Deprecated. Return a list of user-space table names whose metadata have not been modified in the last few milliseconds specified by timelag if any of the REGIONINFO_QUALIFIER, SERVER_QUALIFIER, STARTCODE_QUALIFIER, SPLITA_QUALIFIER, SPLITB_QUALIFIER have not changed in the last milliseconds specified by timelag, then the table is a candidate to be returned.
static org.apache.hadoop.fs.Path	getTmpDir(org.apache.hadoop.conf.Configuration conf)	Deprecated. Returns Return the tmp dir this tool writes too.
void	includeTable(TableName table)	Deprecated.
boolean	isExclusive()	Deprecated. Only one instance of hbck can modify HBase at a time.
private boolean	isOptionsSupported(String[] args)	Deprecated.
(package private) boolean	isTableDisabled(TableName tableName)	Deprecated. Check if the specified region's table is disabled.
(package private) boolean	isTableIncluded(TableName table)	Deprecated. Only check/fix tables specified by the list, Empty list means all tables are included.
static byte[]	keyOnly(byte[] b)	Deprecated.
private void	loadDeployedRegions()	Deprecated. Get deployed regions according to the region servers.
void	loadHdfsRegionDirs()	Deprecated. Scan HDFS for all regions, recording their information into regionInfoMap
private SortedMap<TableName,HbckTableInfo>	loadHdfsRegionInfos()	Deprecated. Populate hbi's from regionInfos loaded from file system.
(package private) boolean	loadMetaEntries()	Deprecated. Scan hbase:meta, adding all regions found to the regionInfo map.
private void	loadTableInfosForTablesWithNoRegion()	Deprecated. Loads table info's for tables that may not have been included, since there are no regions reported for the table, but table dir is there in hdfs
private void	loadTableStates()	Deprecated. Load the list of disabled tables in ZK into local set.
private void	logParallelMerge()	Deprecated. Log an appropriate message about whether or not overlapping merges are computed in parallel.
static void	main(String[] args)	Deprecated. Main program
int	mergeRegionDirs(org.apache.hadoop.fs.Path targetRegionDir, HbckRegionInfo contained)	Deprecated. Merge hdfs data by moving from contained HbckRegionInfo into targetRegionDir.
(package private) void	offline(byte[] regionName)	Deprecated. This backwards-compatibility wrapper for permanently offlining a region that should not be alive.
void	offlineHdfsIntegrityRepair()	Deprecated. This repair method analyzes hbase data in hdfs and repairs it to satisfy the table integrity rules.
private void	offlineHLinkFileRepair()	Deprecated. Scan all the store file names to find any lingering HFileLink files, which refer to some none-exiting files.
private void	offlineReferenceFileRepair()	Deprecated. Scan all the store file names to find any lingering reference files, which refer to some none-exiting files.
int	onlineConsistencyRepair()	Deprecated. This repair method requires the cluster to be online since it contacts region servers and the masters.
int	onlineHbck()	Deprecated. Contacts the master and prints out cluster-wide information
private void	preCheckPermission()	Deprecated.
private void	printTableSummary(SortedMap<TableName,HbckTableInfo> tablesInfo)	Deprecated. Prints summary of all tables found on the system.
protected HBaseFsck	printUsageAndExit()	Deprecated.
(package private) void	processRegionServers(Collection<ServerName> regionServerList)	Deprecated. Contacts each regionserver and fetches metadata about regions.
private boolean	recordMetaRegion()	Deprecated. Record the location of the hbase:meta region as found in ZooKeeper.
private void	reportEmptyMetaCells()	Deprecated. TODO -- need to add tests for this.
private void	reportTablesInFlux()	Deprecated. TODO -- need to add tests for this.
private void	reportUnknownServers()	Deprecated.
private void	resetSplitParent(HbckRegionInfo hi)	Deprecated. Reset the split parent region info in meta table
private int	restoreHdfsIntegrity()	Deprecated. This method determines if there are table integrity errors in HDFS.
void	setCheckHdfs(boolean checking)	Deprecated.
(package private) void	setCheckMetaOnly()	Deprecated. Set hbase:meta check mode.
void	setCleanReplicationBarrier(boolean shouldClean)	Deprecated.
void	setCleanReplicationBarrierTable(String cleanReplicationBarrierTable)	Deprecated.
static void	setDisplayFullReport()	Deprecated. Display the full report from fsck.
void	setFixAssignments(boolean shouldFix)	Deprecated. Fix inconsistencies found by fsck.
void	setFixEmptyMetaCells(boolean shouldFix)	Deprecated.
void	setFixHdfsHoles(boolean shouldFix)	Deprecated.
void	setFixHdfsOrphans(boolean shouldFix)	Deprecated.
void	setFixHdfsOverlaps(boolean shouldFix)	Deprecated.
void	setFixHFileLinks(boolean shouldFix)	Deprecated.
void	setFixMeta(boolean shouldFix)	Deprecated.
void	setFixReferenceFiles(boolean shouldFix)	Deprecated.
void	setFixReplication(boolean shouldFix)	Deprecated. Set replication fix mode.
void	setFixSplitParents(boolean shouldFix)	Deprecated.
void	setFixTableOrphans(boolean shouldFix)	Deprecated.
void	setFixVersionFile(boolean shouldFix)	Deprecated.
static void	setForceExclusive()	Deprecated. Set exclusive mode.
void	setHFileCorruptionChecker(HFileCorruptionChecker hfcc)	Deprecated.
void	setIgnorePreCheckPermission(boolean ignorePreCheckPermission)	Deprecated.
private boolean	setMasterInMaintenanceMode()	Deprecated. This method maintains an ephemeral znode.
void	setMaxMerge(int mm)	Deprecated.
void	setMaxOverlapsToSideline(int mo)	Deprecated.
(package private) void	setRegionBoundariesCheck()	Deprecated. Set region boundaries check mode.
void	setRemoveParents(boolean shouldFix)	Deprecated.
void	setRetCode(int code)	Deprecated.
(package private) void	setShouldRerun()	Deprecated. Check if we should rerun fsck again.
void	setSidelineBigOverlaps(boolean sbo)	Deprecated.
void	setSidelineDir(String sidelineDir)	Deprecated.
(package private) static void	setSummary()	Deprecated. Set summary mode.
void	setTimeLag(long seconds)	Deprecated. We are interested in only those tables that have not changed their state in hbase:meta during the last few seconds specified by hbase.admin.fsck.timelag
(package private) boolean	shouldCheckHdfs()	Deprecated.
static boolean	shouldDisplayFullReport()	Deprecated.
(package private) boolean	shouldFixAssignments()	Deprecated.
(package private) boolean	shouldFixEmptyMetaCells()	Deprecated.
(package private) boolean	shouldFixHdfsHoles()	Deprecated.
(package private) boolean	shouldFixHdfsOrphans()	Deprecated.
(package private) boolean	shouldFixHdfsOverlaps()	Deprecated.
(package private) boolean	shouldFixHFileLinks()	Deprecated.
(package private) boolean	shouldFixMeta()	Deprecated.
(package private) boolean	shouldFixReferenceFiles()	Deprecated.
(package private) boolean	shouldFixSplitParents()	Deprecated.
(package private) boolean	shouldFixTableOrphans()	Deprecated.
boolean	shouldFixVersionFile()	Deprecated.
boolean	shouldIgnorePreCheckPermission()	Deprecated.
(package private) boolean	shouldRemoveParents()	Deprecated.
boolean	shouldRerun()	Deprecated.
boolean	shouldSidelineBigOverlaps()	Deprecated.
private boolean	sidelineFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path hbaseRoot, org.apache.hadoop.fs.Path path)	Deprecated.
(package private) org.apache.hadoop.fs.Path	sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs, String parentDir, HbckRegionInfo hi)	Deprecated. Sideline a region dir (instead of deleting it)
(package private) org.apache.hadoop.fs.Path	sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs, HbckRegionInfo hi)	Deprecated. Sideline a region dir (instead of deleting it)
private void	tryAssignmentRepair(HbckRegionInfo hbi, String msg)	Deprecated.
private void	unassignMetaReplica(HbckRegionInfo hi)	Deprecated.
private void	undeployRegions(HbckRegionInfo hi)	Deprecated.
private void	undeployRegionsForHbi(HbckRegionInfo hi)	Deprecated.
private void	unlockHbck()	Deprecated.

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

DEFAULT_TIME_LAG

public static final long DEFAULT_TIME_LAG

Deprecated.

See Also:

• Constant Field Values

DEFAULT_SLEEP_BEFORE_RERUN

public static final long DEFAULT_SLEEP_BEFORE_RERUN

Deprecated.

See Also:

• Constant Field Values

MAX_NUM_THREADS

private static final int MAX_NUM_THREADS

Deprecated.

See Also:

• Constant Field Values

rsSupportsOffline

private static boolean rsSupportsOffline

Deprecated.

DEFAULT_OVERLAPS_TO_SIDELINE

private static final int DEFAULT_OVERLAPS_TO_SIDELINE

Deprecated.

See Also:

• Constant Field Values

DEFAULT_MAX_MERGE

private static final int DEFAULT_MAX_MERGE

Deprecated.

See Also:

• Constant Field Values

HBCK_LOCK_FILE

@Private
public static final String HBCK_LOCK_FILE

Deprecated.

Here is where hbase-1.x used to default the lock for hbck1. It puts in place a lock when it goes to write/make changes.

See Also:

• Constant Field Values

DEFAULT_MAX_LOCK_FILE_ATTEMPTS

private static final int DEFAULT_MAX_LOCK_FILE_ATTEMPTS

Deprecated.

See Also:

• Constant Field Values

DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL

private static final int DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL

Deprecated.

See Also:

• Constant Field Values

DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME

private static final int DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME

Deprecated.

See Also:

• Constant Field Values

DEFAULT_WAIT_FOR_LOCK_TIMEOUT

private static final int DEFAULT_WAIT_FOR_LOCK_TIMEOUT

Deprecated.

See Also:

• Constant Field Values

DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS

private static final int DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS

Deprecated.

See Also:

• Constant Field Values

DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL

private static final int DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL

Deprecated.

See Also:

• Constant Field Values

DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME

private static final int DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME

Deprecated.

See Also:

• Constant Field Values

LOG

private static final org.slf4j.Logger LOG

Deprecated.

Internal resources

status

private ClusterMetrics status

Deprecated.

connection

private ClusterConnection connection

Deprecated.

admin

private Admin admin

Deprecated.

meta

private Table meta

Deprecated.

executor

protected ExecutorService executor

Deprecated.

startMillis

private long startMillis

Deprecated.

hfcc

private HFileCorruptionChecker hfcc

Deprecated.

retcode

private int retcode

Deprecated.

HBCK_LOCK_PATH

private org.apache.hadoop.fs.Path HBCK_LOCK_PATH

Deprecated.

hbckOutFd

private org.apache.hadoop.fs.FSDataOutputStream hbckOutFd

Deprecated.

hbckLockCleanup

private final AtomicBoolean hbckLockCleanup

Deprecated.

unsupportedOptionsInV2

private static final Set<String> unsupportedOptionsInV2

Deprecated.

details

private static boolean details

Deprecated.

Options

timelag

private long timelag

Deprecated.

forceExclusive

private static boolean forceExclusive

Deprecated.

fixAssignments

private boolean fixAssignments

Deprecated.

fixMeta

private boolean fixMeta

Deprecated.

checkHdfs

private boolean checkHdfs

Deprecated.

fixHdfsHoles

private boolean fixHdfsHoles

Deprecated.

fixHdfsOverlaps

private boolean fixHdfsOverlaps

Deprecated.

fixHdfsOrphans

private boolean fixHdfsOrphans

Deprecated.

fixTableOrphans

private boolean fixTableOrphans

Deprecated.

fixVersionFile

private boolean fixVersionFile

Deprecated.

fixSplitParents

private boolean fixSplitParents

Deprecated.

removeParents

private boolean removeParents

Deprecated.

fixReferenceFiles

private boolean fixReferenceFiles

Deprecated.

fixHFileLinks

private boolean fixHFileLinks

Deprecated.

fixEmptyMetaCells

private boolean fixEmptyMetaCells

Deprecated.

fixReplication

private boolean fixReplication

Deprecated.

cleanReplicationBarrier

private boolean cleanReplicationBarrier

Deprecated.

fixAny

private boolean fixAny

Deprecated.

tablesIncluded

private Set<TableName> tablesIncluded

Deprecated.

cleanReplicationBarrierTable

private TableName cleanReplicationBarrierTable

Deprecated.

maxMerge

private int maxMerge

Deprecated.

maxOverlapsToSideline

private int maxOverlapsToSideline

Deprecated.

sidelineBigOverlaps

private boolean sidelineBigOverlaps

Deprecated.

sidelineDir

private org.apache.hadoop.fs.Path sidelineDir

Deprecated.

rerun

private boolean rerun

Deprecated.

summary

private static boolean summary

Deprecated.

checkMetaOnly

private boolean checkMetaOnly

Deprecated.

checkRegionBoundaries

private boolean checkRegionBoundaries

Deprecated.

ignorePreCheckPermission

private boolean ignorePreCheckPermission

Deprecated.

errors

private final HbckErrorReporter errors

Deprecated.

State

fixes

int fixes

Deprecated.

regionInfoMap

private TreeMap<String,HbckRegionInfo> regionInfoMap

Deprecated.

This map contains the state of all hbck items. It maps from encoded region name to HbckRegionInfo structure. The information contained in HbckRegionInfo is used to detect and correct consistency (hdfs/meta/deployment) problems.

emptyRegionInfoQualifiers

private Set<Result> emptyRegionInfoQualifiers

Deprecated.

tablesInfo

private SortedMap<TableName,HbckTableInfo> tablesInfo

Deprecated.

This map from Tablename -> TableInfo contains the structures necessary to detect table consistency problems (holes, dupes, overlaps). It is sorted to prevent dupes. If tablesIncluded is empty, this map contains all tables. Otherwise, it contains only meta tables and tables in tablesIncluded, unless checkMetaOnly is specified, in which case, it contains only the meta table

orphanHdfsDirs

private List<HbckRegionInfo> orphanHdfsDirs

Deprecated.

When initially looking at HDFS, we attempt to find any orphaned data.

orphanTableDirs

private Map<TableName,Set<String>> orphanTableDirs

Deprecated.

tableStates

private Map<TableName,TableState> tableStates

Deprecated.

lockFileRetryCounterFactory

private final RetryCounterFactory lockFileRetryCounterFactory

Deprecated.

createZNodeRetryCounterFactory

private final RetryCounterFactory createZNodeRetryCounterFactory

Deprecated.

skippedRegions

private Map<TableName,Set<String>> skippedRegions

Deprecated.

zkw

private ZKWatcher zkw

Deprecated.

hbckEphemeralNodePath

private String hbckEphemeralNodePath

Deprecated.

hbckZodeCreated

private boolean hbckZodeCreated

Deprecated.

Constructor Details

HBaseFsck

public HBaseFsck(org.apache.hadoop.conf.Configuration conf)
          throws IOException,
ClassNotFoundException

Deprecated.

Constructor

Parameters:

conf - Configuration object

Throws:

MasterNotRunningException - if the master is not running

ZooKeeperConnectionException - if unable to connect to ZooKeeper

IOException

ClassNotFoundException

HBaseFsck

public HBaseFsck(org.apache.hadoop.conf.Configuration conf,
 ExecutorService exec)
          throws MasterNotRunningException,
ZooKeeperConnectionException,
IOException,
ClassNotFoundException

Deprecated.

Constructor Configuration object if the master is not running if unable to connect to ZooKeeper

Throws:

MasterNotRunningException

ZooKeeperConnectionException

IOException

ClassNotFoundException

Method Details

createThreadPool

private static ExecutorService createThreadPool(org.apache.hadoop.conf.Configuration conf)

Deprecated.

createLockRetryCounterFactory

public static RetryCounterFactory createLockRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)

Deprecated.

Returns A retry counter factory configured for retrying lock file creation.

createZnodeRetryCounterFactory

private static RetryCounterFactory createZnodeRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)

Deprecated.

Returns A retry counter factory configured for retrying znode creation.

getTmpDir

@Private
public static org.apache.hadoop.fs.Path getTmpDir(org.apache.hadoop.conf.Configuration conf)
                                           throws IOException

Deprecated.

Returns Return the tmp dir this tool writes too.

Throws:

IOException

checkAndMarkRunningHbck

public static Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.FSDataOutputStream> checkAndMarkRunningHbck(org.apache.hadoop.conf.Configuration conf,
 RetryCounter retryCounter)
                                                                                                       throws IOException

Deprecated.

This method maintains a lock using a file. If the creation fails we return null

Returns:

FSDataOutputStream object corresponding to the newly opened lock file

Throws:

IOException - if IO failure occurs

unlockHbck

private void unlockHbck()

Deprecated.

connect

public void connect()
             throws IOException

Deprecated.

To repair region consistency, one must call connect() in order to repair online state.

Throws:

IOException

loadDeployedRegions

private void loadDeployedRegions()
                          throws IOException,
InterruptedException

Deprecated.

Get deployed regions according to the region servers.

Throws:

IOException

InterruptedException

clearState

private void clearState()

Deprecated.

Clear the current state of hbck.

offlineHdfsIntegrityRepair

public void offlineHdfsIntegrityRepair()
                                throws IOException,
InterruptedException

Deprecated.

This repair method analyzes hbase data in hdfs and repairs it to satisfy the table integrity rules. HBase doesn't need to be online for this operation to work.

Throws:

IOException

InterruptedException

onlineConsistencyRepair

public int onlineConsistencyRepair()
                            throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

This repair method requires the cluster to be online since it contacts region servers and the masters. It makes each region's state in HDFS, in hbase:meta, and deployments consistent.

Returns:

If > 0 , number of errors detected, if < 0 there was an unrecoverable error. If 0, we have a clean hbase.

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

reportUnknownServers

private void reportUnknownServers()
                           throws IOException

Deprecated.

Throws:

IOException

setMasterInMaintenanceMode

private boolean setMasterInMaintenanceMode()
                                    throws IOException

Deprecated.

This method maintains an ephemeral znode. If the creation fails we return false or throw exception

Returns:

true if creating znode succeeds; false otherwise

Throws:

IOException - if IO failure occurs

cleanupHbckZnode

private void cleanupHbckZnode()

Deprecated.

onlineHbck

public int onlineHbck()
               throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException,
ReplicationException

Deprecated.

Contacts the master and prints out cluster-wide information

Returns:

0 on success, non-zero on failure

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

ReplicationException

keyOnly

public static byte[] keyOnly(byte[] b)

Deprecated.

close

public void close()
           throws IOException

Deprecated.

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException

checkRegionBoundaries

public void checkRegionBoundaries()

Deprecated.

adoptHdfsOrphans

private void adoptHdfsOrphans(Collection<HbckRegionInfo> orphanHdfsDirs)
                       throws IOException

Deprecated.

Iterates through the list of all orphan/invalid regiondirs.

Throws:

IOException

adoptHdfsOrphan

private void adoptHdfsOrphan(HbckRegionInfo hi)
                      throws IOException

Deprecated.

Orphaned regions are regions without a .regioninfo file in them. We "adopt" these orphans by creating a new region, and moving the column families, recovered edits, WALs, into the new region dir. We determine the region startkey and endkeys by looking at all of the hfiles inside the column families to identify the min and max keys. The resulting region will likely violate table integrity but will be dealt with by merging overlapping regions.

Throws:

IOException

restoreHdfsIntegrity

private int restoreHdfsIntegrity()
                          throws IOException,
InterruptedException

Deprecated.

This method determines if there are table integrity errors in HDFS. If there are errors and the appropriate "fix" options are enabled, the method will first correct orphan regions making them into legit regiondirs, and then reload to merge potentially overlapping regions.

Returns:

number of table integrity errors found

Throws:

IOException

InterruptedException

offlineReferenceFileRepair

private void offlineReferenceFileRepair()
                                 throws IOException,
InterruptedException

Deprecated.

Scan all the store file names to find any lingering reference files, which refer to some none-exiting files. If "fix" option is enabled, any lingering reference file will be sidelined if found.

Lingering reference file prevents a region from opening. It has to be fixed before a cluster can start properly.

Throws:

IOException

InterruptedException

offlineHLinkFileRepair

private void offlineHLinkFileRepair()
                             throws IOException,
InterruptedException

Deprecated.

Scan all the store file names to find any lingering HFileLink files, which refer to some none-exiting files. If "fix" option is enabled, any lingering HFileLink file will be sidelined if found.

Throws:

IOException

InterruptedException

sidelineFile

private boolean sidelineFile(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path hbaseRoot,
 org.apache.hadoop.fs.Path path)
                      throws IOException

Deprecated.

Throws:

IOException

reportEmptyMetaCells

private void reportEmptyMetaCells()

Deprecated.

TODO -- need to add tests for this.

reportTablesInFlux

private void reportTablesInFlux()

Deprecated.

TODO -- need to add tests for this.

getErrors

public HbckErrorReporter getErrors()

Deprecated.

loadHdfsRegionInfos

private SortedMap<TableName,HbckTableInfo> loadHdfsRegionInfos()
                                                        throws IOException,
InterruptedException

Deprecated.

Populate hbi's from regionInfos loaded from file system.

Throws:

IOException

InterruptedException

getColumnFamilyList

private Set<String> getColumnFamilyList(Set<String> columns,
 HbckRegionInfo hbi)
                                 throws IOException

Deprecated.

To get the column family list according to the column family dirs

Returns:

a set of column families

Throws:

IOException

fabricateTableInfo

private boolean fabricateTableInfo(FSTableDescriptors fstd,
 TableName tableName,
 Set<String> columns)
                            throws IOException

Deprecated.

To fabricate a .tableinfo file with following contents
1. the correct tablename
2. the correct colfamily list
3. the default properties for both TableDescriptor and ColumnFamilyDescriptor

Throws:

IOException

fixEmptyMetaCells

public void fixEmptyMetaCells()
                       throws IOException

Deprecated.

To fix the empty REGIONINFO_QUALIFIER rows from hbase:meta

Throws:

IOException

fixOrphanTables

public void fixOrphanTables()
                     throws IOException

Deprecated.

To fix orphan table by creating a .tableinfo file under tableDir
1. if TableInfo is cached, to recover the .tableinfo accordingly
2. else create a default .tableinfo file with following items
2.1 the correct tablename
2.2 the correct colfamily list
2.3 the default properties for both TableDescriptor and ColumnFamilyDescriptor

Throws:

IOException

logParallelMerge

private void logParallelMerge()

Deprecated.

Log an appropriate message about whether or not overlapping merges are computed in parallel.

checkHdfsIntegrity

private SortedMap<TableName,HbckTableInfo> checkHdfsIntegrity(boolean fixHoles,
 boolean fixOverlaps)
                                                       throws IOException

Deprecated.

Throws:

IOException

getSidelineDir

org.apache.hadoop.fs.Path getSidelineDir()
                                  throws IOException

Deprecated.

Throws:

IOException

sidelineRegionDir

org.apache.hadoop.fs.Path sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs,
 HbckRegionInfo hi)
                                     throws IOException

Deprecated.

Sideline a region dir (instead of deleting it)

Throws:

IOException

sidelineRegionDir

org.apache.hadoop.fs.Path sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs,
 String parentDir,
 HbckRegionInfo hi)
                                     throws IOException

Deprecated.

Sideline a region dir (instead of deleting it)

Parameters:

parentDir - if specified, the region will be sidelined to folder like .../parentDir/<table name>/<region name>. The purpose is to group together similar regions sidelined, for example, those regions should be bulk loaded back later on. If NULL, it is ignored.

Throws:

IOException

loadTableStates

private void loadTableStates()
                      throws IOException

Deprecated.

Load the list of disabled tables in ZK into local set.

Throws:

IOException

isTableDisabled

boolean isTableDisabled(TableName tableName)

Deprecated.

Check if the specified region's table is disabled.

Parameters:

tableName - table to check status of

loadHdfsRegionDirs

public void loadHdfsRegionDirs()
                        throws IOException,
InterruptedException

Deprecated.

Scan HDFS for all regions, recording their information into regionInfoMap

Throws:

IOException

InterruptedException

recordMetaRegion

private boolean recordMetaRegion()
                          throws IOException

Deprecated.

Record the location of the hbase:meta region as found in ZooKeeper.

Throws:

IOException

createZooKeeperWatcher

private ZKWatcher createZooKeeperWatcher()
                                  throws IOException

Deprecated.

Throws:

IOException

processRegionServers

void processRegionServers(Collection<ServerName> regionServerList)
                   throws IOException,
InterruptedException

Deprecated.

Contacts each regionserver and fetches metadata about regions.

Parameters:

regionServerList - - the list of region servers to connect to

Throws:

IOException - if a remote or network exception occurs

InterruptedException

checkAndFixConsistency

private void checkAndFixConsistency()
                             throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

Check consistency of all regions that have been found in previous phases.

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

checkRegionConsistencyConcurrently

private void checkRegionConsistencyConcurrently(List<HBaseFsck.CheckRegionConsistencyWorkItem> workItems)
                                         throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

Check consistency of all regions using multiple threads concurrently.

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

addSkippedRegion

private void addSkippedRegion(HbckRegionInfo hbi)

Deprecated.

checkAndFixTableStates

private void checkAndFixTableStates()
                             throws IOException

Deprecated.

Check and fix table states, assumes full info available: - tableInfos - empty tables loaded

Throws:

IOException

preCheckPermission

private void preCheckPermission()
                         throws IOException

Deprecated.

Throws:

IOException

deleteMetaRegion

private void deleteMetaRegion(HbckRegionInfo hi)
                       throws IOException

Deprecated.

Deletes region from meta table

Throws:

IOException

deleteMetaRegion

private void deleteMetaRegion(byte[] metaKey)
                       throws IOException

Deprecated.

Deletes region from meta table

Throws:

IOException

resetSplitParent

private void resetSplitParent(HbckRegionInfo hi)
                       throws IOException

Deprecated.

Reset the split parent region info in meta table

Throws:

IOException

offline

void offline(byte[] regionName)
      throws IOException

Deprecated.

This backwards-compatibility wrapper for permanently offlining a region that should not be alive. If the region server does not support the "offline" method, it will use the closest unassign method instead. This will basically work until one attempts to disable or delete the affected table. The problem has to do with in-memory only master state, so restarting the HMaster or failing over to another should fix this.

Throws:

IOException

closeRegion

void closeRegion(HbckRegionInfo hi)
          throws IOException,
InterruptedException

Deprecated.

Attempts to undeploy a region from a region server based in information in META. Any operations that modify the file system should make sure that its corresponding region is not deployed to prevent data races. A separate call is required to update the master in-memory region state kept in the AssignementManager. Because disable uses this state instead of that found in META, we can't seem to cleanly disable/delete tables that have been hbck fixed. When used on a version of HBase that does not have the offline ipc call exposed on the master (<0.90.5, <0.92.0) a master restart or failover may be required.

Throws:

IOException

InterruptedException

undeployRegions

private void undeployRegions(HbckRegionInfo hi)
                      throws IOException,
InterruptedException

Deprecated.

Throws:

IOException

InterruptedException

undeployRegionsForHbi

private void undeployRegionsForHbi(HbckRegionInfo hi)
                            throws IOException,
InterruptedException

Deprecated.

Throws:

IOException

InterruptedException

tryAssignmentRepair

private void tryAssignmentRepair(HbckRegionInfo hbi,
 String msg)
                          throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

checkRegionConsistency

private void checkRegionConsistency(String key,
 HbckRegionInfo hbi)
                             throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

Check a single region for consistency and correct deployment.

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

checkIntegrity

SortedMap<TableName,HbckTableInfo> checkIntegrity()
                                           throws IOException

Deprecated.

Checks tables integrity. Goes over all regions and scans the tables. Collects all the pieces for each table and checks if there are missing, repeated or overlapping ones.

Throws:

IOException

loadTableInfosForTablesWithNoRegion

private void loadTableInfosForTablesWithNoRegion()
                                          throws IOException

Deprecated.

Loads table info's for tables that may not have been included, since there are no regions reported for the table, but table dir is there in hdfs

Throws:

IOException

mergeRegionDirs

public int mergeRegionDirs(org.apache.hadoop.fs.Path targetRegionDir,
 HbckRegionInfo contained)
                    throws IOException

Deprecated.

Merge hdfs data by moving from contained HbckRegionInfo into targetRegionDir.

Returns:

number of file move fixes done to merge regions.

Throws:

IOException

getTables

TableDescriptor[] getTables(AtomicInteger numSkipped)

Deprecated.

Return a list of user-space table names whose metadata have not been modified in the last few milliseconds specified by timelag if any of the REGIONINFO_QUALIFIER, SERVER_QUALIFIER, STARTCODE_QUALIFIER, SPLITA_QUALIFIER, SPLITB_QUALIFIER have not changed in the last milliseconds specified by timelag, then the table is a candidate to be returned.

Returns:

tables that have not been modified recently

Throws:

IOException - if an error is encountered

getTableDescriptors

TableDescriptor[] getTableDescriptors(List<TableName> tableNames)

Deprecated.

getOrCreateInfo

private HbckRegionInfo getOrCreateInfo(String name)

Deprecated.

Gets the entry in regionInfo corresponding to the the given encoded region name. If the region has not been seen yet, a new entry is added and returned.

checkAndFixReplication

private void checkAndFixReplication()
                             throws ReplicationException,
IOException

Deprecated.

Throws:

ReplicationException

IOException

checkMetaRegion

boolean checkMetaRegion()
                 throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

Check values in regionInfo for hbase:meta Check if zero or more than one regions with hbase:meta are found. If there are inconsistencies (i.e. zero or more than one regions pretend to be holding the hbase:meta) try to fix that and report an error.

Throws:

IOException - from HBaseFsckRepair functions

org.apache.zookeeper.KeeperException

InterruptedException

unassignMetaReplica

private void unassignMetaReplica(HbckRegionInfo hi)
                          throws IOException,
InterruptedException,
org.apache.zookeeper.KeeperException

Deprecated.

Throws:

IOException

InterruptedException

org.apache.zookeeper.KeeperException

assignMetaReplica

private void assignMetaReplica(int replicaId)
                        throws IOException,
org.apache.zookeeper.KeeperException,
InterruptedException

Deprecated.

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

loadMetaEntries

boolean loadMetaEntries()
                 throws IOException

Deprecated.

Scan hbase:meta, adding all regions found to the regionInfo map.

Throws:

IOException - if an error is encountered

printTableSummary

private void printTableSummary(SortedMap<TableName,HbckTableInfo> tablesInfo)

Deprecated.

Prints summary of all tables found on the system.

getErrorReporter

static HbckErrorReporter getErrorReporter(org.apache.hadoop.conf.Configuration conf)
                                   throws ClassNotFoundException

Deprecated.

Throws:

ClassNotFoundException

setDisplayFullReport

public static void setDisplayFullReport()

Deprecated.

Display the full report from fsck. This displays all live and dead region servers, and all known regions.

shouldDisplayFullReport

public static boolean shouldDisplayFullReport()

Deprecated.

setForceExclusive

public static void setForceExclusive()

Deprecated.

Set exclusive mode.

isExclusive

public boolean isExclusive()

Deprecated.

Only one instance of hbck can modify HBase at a time.

setSummary

static void setSummary()

Deprecated.

Set summary mode. Print only summary of the tables and status (OK or INCONSISTENT)

setCheckMetaOnly

void setCheckMetaOnly()

Deprecated.

Set hbase:meta check mode. Print only info about hbase:meta table deployment/state

setRegionBoundariesCheck

void setRegionBoundariesCheck()

Deprecated.

Set region boundaries check mode.

setFixReplication

public void setFixReplication(boolean shouldFix)

Deprecated.

Set replication fix mode.

setCleanReplicationBarrier

public void setCleanReplicationBarrier(boolean shouldClean)

Deprecated.

setShouldRerun

void setShouldRerun()

Deprecated.

Check if we should rerun fsck again. This checks if we've tried to fix something and we should rerun fsck tool again. Display the full report from fsck. This displays all live and dead region servers, and all known regions.

shouldRerun

public boolean shouldRerun()

Deprecated.

setFixAssignments

public void setFixAssignments(boolean shouldFix)

Deprecated.

Fix inconsistencies found by fsck. This should try to fix errors (if any) found by fsck utility.

shouldFixAssignments

boolean shouldFixAssignments()

Deprecated.

setFixMeta

public void setFixMeta(boolean shouldFix)

Deprecated.

shouldFixMeta

boolean shouldFixMeta()

Deprecated.

setFixEmptyMetaCells

public void setFixEmptyMetaCells(boolean shouldFix)

Deprecated.

shouldFixEmptyMetaCells

boolean shouldFixEmptyMetaCells()

Deprecated.

setCheckHdfs

public void setCheckHdfs(boolean checking)

Deprecated.

shouldCheckHdfs

boolean shouldCheckHdfs()

Deprecated.

setFixHdfsHoles

public void setFixHdfsHoles(boolean shouldFix)

Deprecated.

shouldFixHdfsHoles

boolean shouldFixHdfsHoles()

Deprecated.

setFixTableOrphans

public void setFixTableOrphans(boolean shouldFix)

Deprecated.

shouldFixTableOrphans

boolean shouldFixTableOrphans()

Deprecated.

setFixHdfsOverlaps

public void setFixHdfsOverlaps(boolean shouldFix)

Deprecated.

shouldFixHdfsOverlaps

boolean shouldFixHdfsOverlaps()

Deprecated.

setFixHdfsOrphans

public void setFixHdfsOrphans(boolean shouldFix)

Deprecated.

shouldFixHdfsOrphans

boolean shouldFixHdfsOrphans()

Deprecated.

setFixVersionFile

public void setFixVersionFile(boolean shouldFix)

Deprecated.

shouldFixVersionFile

public boolean shouldFixVersionFile()

Deprecated.

setSidelineBigOverlaps

public void setSidelineBigOverlaps(boolean sbo)

Deprecated.

shouldSidelineBigOverlaps

public boolean shouldSidelineBigOverlaps()

Deprecated.

setFixSplitParents

public void setFixSplitParents(boolean shouldFix)

Deprecated.

setRemoveParents

public void setRemoveParents(boolean shouldFix)

Deprecated.

shouldFixSplitParents

boolean shouldFixSplitParents()

Deprecated.

shouldRemoveParents

boolean shouldRemoveParents()

Deprecated.

setFixReferenceFiles

public void setFixReferenceFiles(boolean shouldFix)

Deprecated.

shouldFixReferenceFiles

boolean shouldFixReferenceFiles()

Deprecated.

setFixHFileLinks

public void setFixHFileLinks(boolean shouldFix)

Deprecated.

shouldFixHFileLinks

boolean shouldFixHFileLinks()

Deprecated.

shouldIgnorePreCheckPermission

public boolean shouldIgnorePreCheckPermission()

Deprecated.

setIgnorePreCheckPermission

public void setIgnorePreCheckPermission(boolean ignorePreCheckPermission)

Deprecated.

setMaxMerge

public void setMaxMerge(int mm)

Deprecated.

Parameters:

mm - maximum number of regions to merge into a single region.

getMaxMerge

public int getMaxMerge()

Deprecated.

setMaxOverlapsToSideline

public void setMaxOverlapsToSideline(int mo)

Deprecated.

getMaxOverlapsToSideline

public int getMaxOverlapsToSideline()

Deprecated.

isTableIncluded

boolean isTableIncluded(TableName table)

Deprecated.

Only check/fix tables specified by the list, Empty list means all tables are included.

includeTable

public void includeTable(TableName table)

Deprecated.

getIncludedTables

Set<TableName> getIncludedTables()

Deprecated.

setTimeLag

public void setTimeLag(long seconds)

Deprecated.

We are interested in only those tables that have not changed their state in hbase:meta during the last few seconds specified by hbase.admin.fsck.timelag

Parameters:

seconds - - the time in seconds

setSidelineDir

public void setSidelineDir(String sidelineDir)

Deprecated.

Parameters:

sidelineDir - - HDFS path to sideline data

createHFileCorruptionChecker

protected HFileCorruptionChecker createHFileCorruptionChecker(boolean sidelineCorruptHFiles)
                                                       throws IOException

Deprecated.

Throws:

IOException

getHFilecorruptionChecker

public HFileCorruptionChecker getHFilecorruptionChecker()

Deprecated.

setHFileCorruptionChecker

public void setHFileCorruptionChecker(HFileCorruptionChecker hfcc)

Deprecated.

setRetCode

public void setRetCode(int code)

Deprecated.

getRetCode

public int getRetCode()

Deprecated.

printUsageAndExit

protected HBaseFsck printUsageAndExit()

Deprecated.

main

public static void main(String[] args)
                 throws Exception

Deprecated.

Main program

Throws:

Exception

exec

public HBaseFsck exec(ExecutorService exec,
 String[] args)
               throws org.apache.zookeeper.KeeperException,
IOException,
InterruptedException,
ReplicationException

Deprecated.

Throws:

org.apache.zookeeper.KeeperException

IOException

InterruptedException

ReplicationException

isOptionsSupported

private boolean isOptionsSupported(String[] args)

Deprecated.

setCleanReplicationBarrierTable

public void setCleanReplicationBarrierTable(String cleanReplicationBarrierTable)

Deprecated.

cleanReplicationBarrier

public void cleanReplicationBarrier()
                             throws IOException

Deprecated.

Throws:

IOException

debugLsr

void debugLsr(org.apache.hadoop.fs.Path p)
       throws IOException

Deprecated.

ls -r for debugging purposes

Throws:

IOException

debugLsr

public static void debugLsr(org.apache.hadoop.conf.Configuration conf,
 org.apache.hadoop.fs.Path p)
                     throws IOException

Deprecated.

ls -r for debugging purposes

Throws:

IOException

debugLsr

public static void debugLsr(org.apache.hadoop.conf.Configuration conf,
 org.apache.hadoop.fs.Path p,
 HbckErrorReporter errors)
                     throws IOException

Deprecated.

ls -r for debugging purposes

Throws:

IOException