Package org.apache.hadoop.hbase.replication.regionserver

Class MetricsReplicationGlobalSourceSourceImpl

java.lang.Object

org.apache.hadoop.hbase.replication.regionserver.MetricsReplicationGlobalSourceSourceImpl

All Implemented Interfaces:

BaseSource, MetricsReplicationGlobalSourceSource, MetricsReplicationSourceSource

@Private
public class MetricsReplicationGlobalSourceSourceImpl
extends Object
implements MetricsReplicationGlobalSourceSource

Field Summary

Fields

Modifier and Type	Field	Description
private final MutableHistogram	ageOfLastShippedOpHist
private final MutableFastCounter	completedRecoveryQueue
private final MutableFastCounter	completedWAL
private final MutableFastCounter	failedBatchesCounter
private final MutableFastCounter	failedRecoveryQueue
private static final String	KEY_PREFIX
private final MutableFastCounter	logReadInBytesCounter
private final MutableFastCounter	logReadInEditsCounter
private final MutableFastCounter	repeatedFileBytes
private final MutableFastCounter	restartWALReading
private final MetricsReplicationSourceImpl	rms
private final MutableFastCounter	shippedBatchesCounter
private final MutableFastCounter	shippedBytesCounter
private final MutableFastCounter	shippedHFilesCounter
private final MutableFastCounter	shippedKBsCounter	Deprecated. since 1.3.0.
private final MutableFastCounter	shippedOpsCounter
private final org.apache.hadoop.metrics2.lib.MutableGaugeLong	sizeOfHFileRefsQueueGauge
private final org.apache.hadoop.metrics2.lib.MutableGaugeLong	sizeOfLogQueueGauge
private final org.apache.hadoop.metrics2.lib.MutableGaugeInt	sourceInitializing
private final MutableFastCounter	uncleanlyClosedSkippedBytes
private final MutableFastCounter	uncleanlyClosedWAL
private final MutableFastCounter	unknownFileLengthForClosedWAL
private final MutableFastCounter	walEditsFilteredCounter
private final org.apache.hadoop.metrics2.lib.MutableGaugeLong	walReaderBufferUsageBytes

Fields inherited from interface org.apache.hadoop.hbase.metrics.BaseSource

HBASE_METRICS_SYSTEM_NAME

Fields inherited from interface org.apache.hadoop.hbase.replication.regionserver.MetricsReplicationGlobalSourceSource

SOURCE_WAL_READER_EDITS_BUFFER

Fields inherited from interface org.apache.hadoop.hbase.replication.regionserver.MetricsReplicationSourceSource

SOURCE_AGE_OF_LAST_SHIPPED_OP, SOURCE_CLOSED_LOGS_WITH_UNKNOWN_LENGTH, SOURCE_COMPLETED_LOGS, SOURCE_COMPLETED_RECOVERY_QUEUES, SOURCE_FAILED_BATCHES, SOURCE_FAILED_RECOVERY_QUEUES, SOURCE_INITIALIZING, SOURCE_LOG_EDITS_FILTERED, SOURCE_LOG_READ_IN_BYTES, SOURCE_LOG_READ_IN_EDITS, SOURCE_REPEATED_LOG_FILE_BYTES, SOURCE_RESTARTED_LOG_READING, SOURCE_SHIPPED_BATCHES, SOURCE_SHIPPED_BYTES, SOURCE_SHIPPED_HFILES, SOURCE_SHIPPED_KBS, SOURCE_SHIPPED_OPS, SOURCE_SIZE_OF_HFILE_REFS_QUEUE, SOURCE_SIZE_OF_LOG_QUEUE, SOURCE_UNCLEANLY_CLOSED_IGNORED_IN_BYTES, SOURCE_UNCLEANLY_CLOSED_LOGS

Constructor Summary

Constructors

Constructor	Description
MetricsReplicationGlobalSourceSourceImpl(MetricsReplicationSourceImpl rms)

Method Summary

Modifier and Type	Method	Description
void	clear()
void	decGauge(String gaugeName, long delta)	Subtract some amount from a gauge.
void	decrSizeOfHFileRefsQueue(long size)
void	decrSizeOfLogQueue(int size)
void	decrSourceInitializing()
long	getEditsFiltered()
long	getLastShippedAge()
String	getMetricsContext()	Get the metrics context.
String	getMetricsDescription()	Get the description of what this source exposes.
String	getMetricsJmxContext()	Get the name of the context in JMX that this source will be exposed through.
String	getMetricsName()	Get the name of the metrics that are being exported by this source.
long	getOldestWalAge()
long	getShippedOps()
int	getSizeOfLogQueue()
int	getSourceInitializing()
long	getUncleanlyClosedWALs()
long	getWALEditsRead()
long	getWALReaderEditsBufferBytes()	Returns the size, in bytes, of edits held in memory to be replicated across all peers.
void	incCounters(String counterName, long delta)	Add some amount to a counter.
void	incGauge(String gaugeName, long delta)	Add some amount to a gauge.
void	incrBatchesShipped(int batches)
void	incrBytesSkippedInUncleanlyClosedWALs(long bytes)
void	incrCompletedRecoveryQueue()
void	incrCompletedWAL()
(package private) static void	incrementKBsCounter(MutableFastCounter bytesCounter, MutableFastCounter kbsCounter)
void	incrFailedBatches()
void	incrFailedRecoveryQueue()
void	incrHFilesShipped(long hfiles)
void	incrLogEditsFiltered(long size)
void	incrLogReadInBytes(long size)
void	incrLogReadInEdits(long size)
void	incrOpsShipped(long ops)
void	incrRepeatedFileBytes(long bytes)
void	incrRestartedWALReading()
void	incrShippedBytes(long size)
void	incrSizeOfHFileRefsQueue(long size)
void	incrSizeOfLogQueue(int size)
void	incrSourceInitializing()
void	incrUncleanlyClosedWALs()
void	incrUnknownFileLengthForClosedWAL()
void	init()	Clear out the metrics and re-prepare the source.
void	removeMetric(String key)	Remove a metric and no longer announce it.
void	setGauge(String gaugeName, long value)	Set a gauge to a specific value.
void	setLastShippedAge(long age)
void	setOldestWalAge(long age)
void	setWALReaderEditsBufferBytes(long usage)	Sets the total usage of memory used by edits in memory read from WALs.
void	updateHistogram(String name, long value)	Add some value to a histogram.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.metrics.BaseSource

getMetricRegistryInfo

Field Details

KEY_PREFIX

private static final String KEY_PREFIX

See Also:

• Constant Field Values

rms

private final MetricsReplicationSourceImpl rms

ageOfLastShippedOpHist

private final MutableHistogram ageOfLastShippedOpHist

sizeOfLogQueueGauge

private final org.apache.hadoop.metrics2.lib.MutableGaugeLong sizeOfLogQueueGauge

logReadInEditsCounter

private final MutableFastCounter logReadInEditsCounter

walEditsFilteredCounter

private final MutableFastCounter walEditsFilteredCounter

shippedBatchesCounter

private final MutableFastCounter shippedBatchesCounter

failedBatchesCounter

private final MutableFastCounter failedBatchesCounter

shippedOpsCounter

private final MutableFastCounter shippedOpsCounter

shippedBytesCounter

private final MutableFastCounter shippedBytesCounter

shippedKBsCounter

@Deprecated
private final MutableFastCounter shippedKBsCounter

Deprecated.

since 1.3.0. Use shippedBytesCounter instead.

logReadInBytesCounter

private final MutableFastCounter logReadInBytesCounter

shippedHFilesCounter

private final MutableFastCounter shippedHFilesCounter

sizeOfHFileRefsQueueGauge

private final org.apache.hadoop.metrics2.lib.MutableGaugeLong sizeOfHFileRefsQueueGauge

unknownFileLengthForClosedWAL

private final MutableFastCounter unknownFileLengthForClosedWAL

uncleanlyClosedWAL

private final MutableFastCounter uncleanlyClosedWAL

uncleanlyClosedSkippedBytes

private final MutableFastCounter uncleanlyClosedSkippedBytes

restartWALReading

private final MutableFastCounter restartWALReading

repeatedFileBytes

private final MutableFastCounter repeatedFileBytes

completedWAL

private final MutableFastCounter completedWAL

completedRecoveryQueue

private final MutableFastCounter completedRecoveryQueue

failedRecoveryQueue

private final MutableFastCounter failedRecoveryQueue

walReaderBufferUsageBytes

private final org.apache.hadoop.metrics2.lib.MutableGaugeLong walReaderBufferUsageBytes

sourceInitializing

private final org.apache.hadoop.metrics2.lib.MutableGaugeInt sourceInitializing

Constructor Details

MetricsReplicationGlobalSourceSourceImpl

public MetricsReplicationGlobalSourceSourceImpl(MetricsReplicationSourceImpl rms)

Method Details

setLastShippedAge

public void setLastShippedAge(long age)

Specified by:

setLastShippedAge in interface MetricsReplicationSourceSource

incrSizeOfLogQueue

public void incrSizeOfLogQueue(int size)

Specified by:

incrSizeOfLogQueue in interface MetricsReplicationSourceSource

decrSizeOfLogQueue

public void decrSizeOfLogQueue(int size)

Specified by:

decrSizeOfLogQueue in interface MetricsReplicationSourceSource

incrLogReadInEdits

public void incrLogReadInEdits(long size)

Specified by:

incrLogReadInEdits in interface MetricsReplicationSourceSource

incrLogEditsFiltered

public void incrLogEditsFiltered(long size)

Specified by:

incrLogEditsFiltered in interface MetricsReplicationSourceSource

incrBatchesShipped

public void incrBatchesShipped(int batches)

Specified by:

incrBatchesShipped in interface MetricsReplicationSourceSource

incrFailedBatches

public void incrFailedBatches()

Specified by:

incrFailedBatches in interface MetricsReplicationSourceSource

incrOpsShipped

public void incrOpsShipped(long ops)

Specified by:

incrOpsShipped in interface MetricsReplicationSourceSource

incrShippedBytes

public void incrShippedBytes(long size)

Specified by:

incrShippedBytes in interface MetricsReplicationSourceSource

incrementKBsCounter

static void incrementKBsCounter(MutableFastCounter bytesCounter,
 MutableFastCounter kbsCounter)

incrLogReadInBytes

public void incrLogReadInBytes(long size)

Specified by:

incrLogReadInBytes in interface MetricsReplicationSourceSource

clear

public void clear()

Specified by:

clear in interface MetricsReplicationSourceSource

getLastShippedAge

public long getLastShippedAge()

Specified by:

getLastShippedAge in interface MetricsReplicationSourceSource

incrHFilesShipped

public void incrHFilesShipped(long hfiles)

Specified by:

incrHFilesShipped in interface MetricsReplicationSourceSource

incrSizeOfHFileRefsQueue

public void incrSizeOfHFileRefsQueue(long size)

Specified by:

incrSizeOfHFileRefsQueue in interface MetricsReplicationSourceSource

decrSizeOfHFileRefsQueue

public void decrSizeOfHFileRefsQueue(long size)

Specified by:

decrSizeOfHFileRefsQueue in interface MetricsReplicationSourceSource

getSizeOfLogQueue

public int getSizeOfLogQueue()

Specified by:

getSizeOfLogQueue in interface MetricsReplicationSourceSource

incrUnknownFileLengthForClosedWAL

public void incrUnknownFileLengthForClosedWAL()

Specified by:

incrUnknownFileLengthForClosedWAL in interface MetricsReplicationSourceSource

incrUncleanlyClosedWALs

public void incrUncleanlyClosedWALs()

Specified by:

incrUncleanlyClosedWALs in interface MetricsReplicationSourceSource

getUncleanlyClosedWALs

public long getUncleanlyClosedWALs()

Specified by:

getUncleanlyClosedWALs in interface MetricsReplicationSourceSource

incrBytesSkippedInUncleanlyClosedWALs

public void incrBytesSkippedInUncleanlyClosedWALs(long bytes)

Specified by:

incrBytesSkippedInUncleanlyClosedWALs in interface MetricsReplicationSourceSource

incrRestartedWALReading

public void incrRestartedWALReading()

Specified by:

incrRestartedWALReading in interface MetricsReplicationSourceSource

incrRepeatedFileBytes

public void incrRepeatedFileBytes(long bytes)

Specified by:

incrRepeatedFileBytes in interface MetricsReplicationSourceSource

incrCompletedWAL

public void incrCompletedWAL()

Specified by:

incrCompletedWAL in interface MetricsReplicationSourceSource

incrCompletedRecoveryQueue

public void incrCompletedRecoveryQueue()

Specified by:

incrCompletedRecoveryQueue in interface MetricsReplicationSourceSource

incrFailedRecoveryQueue

public void incrFailedRecoveryQueue()

Specified by:

incrFailedRecoveryQueue in interface MetricsReplicationSourceSource

setOldestWalAge

public void setOldestWalAge(long age)

Specified by:

setOldestWalAge in interface MetricsReplicationSourceSource

getOldestWalAge

public long getOldestWalAge()

Specified by:

getOldestWalAge in interface MetricsReplicationSourceSource

incrSourceInitializing

public void incrSourceInitializing()

Specified by:

incrSourceInitializing in interface MetricsReplicationSourceSource

decrSourceInitializing

public void decrSourceInitializing()

Specified by:

decrSourceInitializing in interface MetricsReplicationSourceSource

getSourceInitializing

public int getSourceInitializing()

Specified by:

getSourceInitializing in interface MetricsReplicationSourceSource

init

public void init()

Description copied from interface: BaseSource

Clear out the metrics and re-prepare the source.

Specified by:

init in interface BaseSource

setGauge

public void setGauge(String gaugeName,
 long value)

Description copied from interface: BaseSource

Set a gauge to a specific value.

Specified by:

setGauge in interface BaseSource

Parameters:

gaugeName - the name of the gauge

value - the value

incGauge

public void incGauge(String gaugeName,
 long delta)

Description copied from interface: BaseSource

Add some amount to a gauge.

Specified by:

incGauge in interface BaseSource

Parameters:

gaugeName - the name of the gauge

delta - the amount to change the gauge by.

decGauge

public void decGauge(String gaugeName,
 long delta)

Description copied from interface: BaseSource

Subtract some amount from a gauge.

Specified by:

decGauge in interface BaseSource

Parameters:

gaugeName - the name of the gauge

delta - the amount to change the gauge by.

removeMetric

public void removeMetric(String key)

Description copied from interface: BaseSource

Remove a metric and no longer announce it.

Specified by:

removeMetric in interface BaseSource

Parameters:

key - Name of the gauge to remove.

incCounters

public void incCounters(String counterName,
 long delta)

Description copied from interface: BaseSource

Add some amount to a counter.

Specified by:

incCounters in interface BaseSource

Parameters:

counterName - the name of the counter

delta - the amount to change the counter by.

updateHistogram

public void updateHistogram(String name,
 long value)

Description copied from interface: BaseSource

Add some value to a histogram.

Specified by:

updateHistogram in interface BaseSource

Parameters:

name - the name of the histogram

value - the value to add to the histogram

getMetricsContext

public String getMetricsContext()

Description copied from interface: BaseSource

Get the metrics context. For hadoop metrics2 system this is usually an all lowercased string. eg. regionserver, master, thriftserver

Specified by:

getMetricsContext in interface BaseSource

Returns:

The string context used to register this source to hadoop's metrics2 system.

getMetricsDescription

public String getMetricsDescription()

Description copied from interface: BaseSource

Get the description of what this source exposes.

Specified by:

getMetricsDescription in interface BaseSource

getMetricsJmxContext

public String getMetricsJmxContext()

Description copied from interface: BaseSource

Get the name of the context in JMX that this source will be exposed through. This is in ObjectName format. With the default context being Hadoop -> HBase

Specified by:

getMetricsJmxContext in interface BaseSource

getMetricsName

public String getMetricsName()

Description copied from interface: BaseSource

Get the name of the metrics that are being exported by this source. Eg. IPC, GC, WAL

Specified by:

getMetricsName in interface BaseSource

getWALEditsRead

public long getWALEditsRead()

Specified by:

getWALEditsRead in interface MetricsReplicationSourceSource

getShippedOps

public long getShippedOps()

Specified by:

getShippedOps in interface MetricsReplicationSourceSource

getEditsFiltered

public long getEditsFiltered()

Specified by:

getEditsFiltered in interface MetricsReplicationSourceSource

setWALReaderEditsBufferBytes

public void setWALReaderEditsBufferBytes(long usage)

Description copied from interface: MetricsReplicationGlobalSourceSource

Sets the total usage of memory used by edits in memory read from WALs. The memory represented by this usage measure is across peers/sources. For example, we may batch the same WAL edits multiple times for the sake of replicating them to multiple peers..

Specified by:

setWALReaderEditsBufferBytes in interface MetricsReplicationGlobalSourceSource

Parameters:

usage - The memory used by edits in bytes

getWALReaderEditsBufferBytes

public long getWALReaderEditsBufferBytes()

Description copied from interface: MetricsReplicationGlobalSourceSource

Returns the size, in bytes, of edits held in memory to be replicated across all peers.

Specified by:

getWALReaderEditsBufferBytes in interface MetricsReplicationGlobalSourceSource