Package org.apache.hadoop.hbase.snapshot

Class SnapshotInfo.SnapshotStats

java.lang.Object

org.apache.hadoop.hbase.snapshot.SnapshotInfo.SnapshotStats

Enclosing class:

SnapshotInfo

public static class SnapshotInfo.SnapshotStats
extends Object

Statistics about the snapshot

1. How many store files and logs are in the archive
2. How many store files and logs are shared with the table
3. Total store files and logs size and shared amount

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) static class	SnapshotInfo.SnapshotStats.FileInfo	Information about the file referenced by the snapshot

Field Summary

Fields

Modifier and Type	Field	Description
private final org.apache.hadoop.conf.Configuration	conf
private final org.apache.hadoop.fs.FileSystem	fs
private AtomicInteger	hfilesArchiveCount
private AtomicLong	hfilesArchiveSize
private AtomicInteger	hfilesCorrupted
private AtomicInteger	hfilesCount
private AtomicInteger	hfilesMissing
private AtomicInteger	hfilesMobCount
private AtomicLong	hfilesMobSize
private AtomicLong	hfilesSize
private AtomicInteger	logsCount
private AtomicLong	logSize
private AtomicInteger	logsMissing
private AtomicLong	nonSharedHfilesArchiveSize
private final org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription	snapshot
private final TableName	snapshotTable

Constructor Summary

Constructors

Constructor	Description
SnapshotStats(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, SnapshotDescription snapshot)
SnapshotStats(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription snapshot)

Method Summary

Modifier and Type	Method	Description
(package private) SnapshotInfo.SnapshotStats.FileInfo	addLogFile(String server, String logfile)	Add the specified log file to the stats
(package private) SnapshotInfo.SnapshotStats.FileInfo	addStoreFile(RegionInfo region, String family, org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotRegionManifest.StoreFile storeFile, Map<org.apache.hadoop.fs.Path,Integer> filesMap)	Add the specified store file to the stats
int	getArchivedStoreFilesCount()	Returns the number of available store files in the archive
long	getArchivedStoreFileSize()	Returns the total size of the store files in the archive
int	getCorruptedStoreFilesCount()	Returns the number of corrupted store files
int	getLogsCount()	Returns the number of available log files
long	getLogsSize()	Returns the total log size
int	getMissingLogsCount()	Returns the number of missing log files
int	getMissingStoreFilesCount()	Returns the number of missing store files
float	getMobStoreFilePercentage()	Returns the percentage of the mob store files
int	getMobStoreFilesCount()	Returns the number of available store files in the mob dir
long	getMobStoreFilesSize()	Returns the total size of the store files in the mob store
long	getNonSharedArchivedStoreFilesSize()
float	getSharedStoreFilePercentage()	Returns the percentage of the shared store files
long	getSharedStoreFilesSize()	Returns the total size of the store files shared
SnapshotDescription	getSnapshotDescription()	Returns the snapshot descriptor
int	getStoreFilesCount()	Returns the number of available store files
long	getStoreFilesSize()	Returns the total size of the store files referenced by the snapshot
private boolean	isArchivedFileStillReferenced(org.apache.hadoop.fs.Path filePath, Map<org.apache.hadoop.fs.Path,Integer> snapshotFilesMap)	Check if for a give file in archive, if there are other snapshots/tables still reference it.
boolean	isSnapshotCorrupted()	Returns true if the snapshot is corrupted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

hfilesArchiveCount

private AtomicInteger hfilesArchiveCount

hfilesCorrupted

private AtomicInteger hfilesCorrupted

hfilesMissing

private AtomicInteger hfilesMissing

hfilesCount

private AtomicInteger hfilesCount

hfilesMobCount

private AtomicInteger hfilesMobCount

logsMissing

private AtomicInteger logsMissing

logsCount

private AtomicInteger logsCount

hfilesArchiveSize

private AtomicLong hfilesArchiveSize

hfilesSize

private AtomicLong hfilesSize

hfilesMobSize

private AtomicLong hfilesMobSize

nonSharedHfilesArchiveSize

private AtomicLong nonSharedHfilesArchiveSize

logSize

private AtomicLong logSize

snapshot

private final org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription snapshot

snapshotTable

private final TableName snapshotTable

conf

private final org.apache.hadoop.conf.Configuration conf

fs

private final org.apache.hadoop.fs.FileSystem fs

Constructor Details

SnapshotStats

SnapshotStats(org.apache.hadoop.conf.Configuration conf,
 org.apache.hadoop.fs.FileSystem fs,
 SnapshotDescription snapshot)

SnapshotStats

SnapshotStats(org.apache.hadoop.conf.Configuration conf,
 org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription snapshot)

Method Details

getSnapshotDescription

public SnapshotDescription getSnapshotDescription()

Returns the snapshot descriptor

isSnapshotCorrupted

public boolean isSnapshotCorrupted()

Returns true if the snapshot is corrupted

getStoreFilesCount

public int getStoreFilesCount()

Returns the number of available store files

getArchivedStoreFilesCount

public int getArchivedStoreFilesCount()

Returns the number of available store files in the archive

getMobStoreFilesCount

public int getMobStoreFilesCount()

Returns the number of available store files in the mob dir

getLogsCount

public int getLogsCount()

Returns the number of available log files

getMissingStoreFilesCount

public int getMissingStoreFilesCount()

Returns the number of missing store files

getCorruptedStoreFilesCount

public int getCorruptedStoreFilesCount()

Returns the number of corrupted store files

getMissingLogsCount

public int getMissingLogsCount()

Returns the number of missing log files

getStoreFilesSize

public long getStoreFilesSize()

Returns the total size of the store files referenced by the snapshot

getSharedStoreFilesSize

public long getSharedStoreFilesSize()

Returns the total size of the store files shared

getArchivedStoreFileSize

public long getArchivedStoreFileSize()

Returns the total size of the store files in the archive

getMobStoreFilesSize

public long getMobStoreFilesSize()

Returns the total size of the store files in the mob store

getNonSharedArchivedStoreFilesSize

public long getNonSharedArchivedStoreFilesSize()

Returns:

the total size of the store files in the archive which is not shared with other snapshots and tables This is only calculated when SnapshotInfo.getSnapshotStats(Configuration, SnapshotProtos.SnapshotDescription, Map) is called with a non-null Map

getSharedStoreFilePercentage

public float getSharedStoreFilePercentage()

Returns the percentage of the shared store files

getMobStoreFilePercentage

public float getMobStoreFilePercentage()

Returns the percentage of the mob store files

getLogsSize

public long getLogsSize()

Returns the total log size

isArchivedFileStillReferenced

private boolean isArchivedFileStillReferenced(org.apache.hadoop.fs.Path filePath,
 Map<org.apache.hadoop.fs.Path,Integer> snapshotFilesMap)

Check if for a give file in archive, if there are other snapshots/tables still reference it.

Parameters:

filePath - file path in archive

snapshotFilesMap - a map for store files in snapshots about how many snapshots refer to it.

Returns:

true or false

addStoreFile

SnapshotInfo.SnapshotStats.FileInfo addStoreFile(RegionInfo region,
 String family,
 org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotRegionManifest.StoreFile storeFile,
 Map<org.apache.hadoop.fs.Path,Integer> filesMap)
                                          throws IOException

Add the specified store file to the stats

Parameters:

region - region encoded Name

family - family name

storeFile - store file name

filesMap - store files map for all snapshots, it may be null

Returns:

the store file information

Throws:

IOException

addLogFile

SnapshotInfo.SnapshotStats.FileInfo addLogFile(String server,
 String logfile)
                                        throws IOException

Add the specified log file to the stats

Parameters:

server - server name

logfile - log file name

Returns:

the log information

Throws:

IOException