Package org.apache.hadoop.hbase.ipc

Class FifoRpcScheduler

java.lang.Object

org.apache.hadoop.hbase.ipc.RpcScheduler

org.apache.hadoop.hbase.ipc.FifoRpcScheduler

Direct Known Subclasses:

MasterFifoRpcScheduler

@Private
public class FifoRpcScheduler
extends RpcScheduler

A very simple RpcScheduler} that serves incoming requests in order. This can be used for HMaster, where no prioritization is needed.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	FifoRpcScheduler.FifoCallRunner

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.ipc.RpcScheduler

RpcScheduler.Context

Field Summary

Fields

Modifier and Type	Field	Description
protected ThreadPoolExecutor	executor
protected final int	handlerCount
private static final org.slf4j.Logger	LOG
protected final int	maxQueueLength
protected final AtomicInteger	queueSize

Fields inherited from class org.apache.hadoop.hbase.ipc.RpcScheduler

IPC_SERVER_BULKLOAD_MAX_CALLQUEUE_LENGTH, IPC_SERVER_MAX_CALLQUEUE_LENGTH, IPC_SERVER_PRIORITY_MAX_CALLQUEUE_LENGTH, IPC_SERVER_REPLICATION_MAX_CALLQUEUE_LENGTH

Constructor Summary

Constructors

Constructor	Description
FifoRpcScheduler(org.apache.hadoop.conf.Configuration conf, int handlerCount)

Method Summary

Modifier and Type	Method	Description
boolean	dispatch(CallRunner task)	Dispatches an RPC request asynchronously.
protected boolean	executeRpcCall(ThreadPoolExecutor executor, AtomicInteger queueSize, CallRunner task)
int	getActiveBulkLoadRpcHandlerCount()	Retrieves the number of active bulkload handler.
int	getActiveGeneralRpcHandlerCount()	Retrieves the number of active general handler.
int	getActiveMetaPriorityRpcHandlerCount()	Retrieves the number of active meta priority handler.
int	getActivePriorityRpcHandlerCount()	Retrieves the number of active priority handler.
int	getActiveReadRpcHandlerCount()	Retrieves the number of active write rpc handler when use RWQueueRpcExecutor.
int	getActiveReplicationRpcHandlerCount()	Retrieves the number of active replication handler.
int	getActiveRpcHandlerCount()	Retrieves the total number of active handler.
int	getActiveScanRpcHandlerCount()	Retrieves the number of active write rpc handler when use RWQueueRpcExecutor.
int	getActiveWriteRpcHandlerCount()	Retrieves the number of active write rpc handler when use RWQueueRpcExecutor.
int	getBulkLoadQueueLength()	Retrieves length of the bulkload queue for metrics.
protected String	getCallMethod(CallRunner task)
CallQueueInfo	getCallQueueInfo()	Get call queue information
int	getGeneralQueueLength()	Retrieves length of the general queue for metrics.
int	getMetaPriorityQueueLength()	Retrieves length of the meta priority queue for metrics.
long	getNumGeneralCallsDropped()	If CoDel-based RPC executors are used, retrieves the number of Calls that were dropped from general queue because RPC executor is under high load; returns 0 otherwise.
long	getNumLifoModeSwitches()	If CoDel-based RPC executors are used, retrieves the number of Calls that were picked from the tail of the queue (indicating adaptive LIFO mode, when in the period of overloade we serve last requests first); returns 0 otherwise.
int	getPriorityQueueLength()	Retrieves length of the priority queue for metrics.
int	getReadQueueLength()	Retrieves length of the read queue for metrics when use RWQueueRpcExecutor.
int	getReplicationQueueLength()	Retrieves length of the replication queue for metrics.
int	getScanQueueLength()	Retrieves length of the scan queue for metrics when use RWQueueRpcExecutor.
int	getWriteQueueLength()	Retrieves length of the write queue for metrics when use RWQueueRpcExecutor.
void	init(RpcScheduler.Context context)	Does some quick initialization.
void	start()	Prepares for request serving.
void	stop()	Stops serving new requests.
protected void	updateMethodCountAndSizeByQueue(BlockingQueue<Runnable> queue, HashMap<String,Long> methodCount, HashMap<String,Long> methodSize)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

handlerCount

protected final int handlerCount

maxQueueLength

protected final int maxQueueLength

queueSize

protected final AtomicInteger queueSize

executor

protected ThreadPoolExecutor executor

Constructor Details

FifoRpcScheduler

public FifoRpcScheduler(org.apache.hadoop.conf.Configuration conf,
 int handlerCount)

Method Details

init

public void init(RpcScheduler.Context context)

Description copied from class: RpcScheduler

Does some quick initialization. Heavy tasks (e.g. starting threads) should be done in RpcScheduler.start(). This method is called before start.

Specified by:

init in class RpcScheduler

Parameters:

context - provides methods to retrieve runtime information from

start

public void start()

Description copied from class: RpcScheduler

Prepares for request serving. An implementation may start some handler threads here.

Specified by:

start in class RpcScheduler

stop

public void stop()

Description copied from class: RpcScheduler

Stops serving new requests.

Specified by:

stop in class RpcScheduler

dispatch

public boolean dispatch(CallRunner task)

Description copied from class: RpcScheduler

Dispatches an RPC request asynchronously. An implementation is free to choose to process the request immediately or delay it for later processing.

Specified by:

dispatch in class RpcScheduler

Parameters:

task - the request to be dispatched

executeRpcCall

protected boolean executeRpcCall(ThreadPoolExecutor executor,
 AtomicInteger queueSize,
 CallRunner task)

getGeneralQueueLength

public int getGeneralQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the general queue for metrics.

Specified by:

getGeneralQueueLength in class RpcScheduler

getPriorityQueueLength

public int getPriorityQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the priority queue for metrics.

Specified by:

getPriorityQueueLength in class RpcScheduler

getReplicationQueueLength

public int getReplicationQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the replication queue for metrics.

Specified by:

getReplicationQueueLength in class RpcScheduler

getBulkLoadQueueLength

public int getBulkLoadQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the bulkload queue for metrics.

Specified by:

getBulkLoadQueueLength in class RpcScheduler

getActiveRpcHandlerCount

public int getActiveRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the total number of active handler.

Specified by:

getActiveRpcHandlerCount in class RpcScheduler

getActiveGeneralRpcHandlerCount

public int getActiveGeneralRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active general handler.

Specified by:

getActiveGeneralRpcHandlerCount in class RpcScheduler

getActivePriorityRpcHandlerCount

public int getActivePriorityRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active priority handler.

Specified by:

getActivePriorityRpcHandlerCount in class RpcScheduler

getActiveReplicationRpcHandlerCount

public int getActiveReplicationRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active replication handler.

Specified by:

getActiveReplicationRpcHandlerCount in class RpcScheduler

getActiveBulkLoadRpcHandlerCount

public int getActiveBulkLoadRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active bulkload handler.

Specified by:

getActiveBulkLoadRpcHandlerCount in class RpcScheduler

getActiveMetaPriorityRpcHandlerCount

public int getActiveMetaPriorityRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active meta priority handler.

Specified by:

getActiveMetaPriorityRpcHandlerCount in class RpcScheduler

getNumGeneralCallsDropped

public long getNumGeneralCallsDropped()

Description copied from class: RpcScheduler

If CoDel-based RPC executors are used, retrieves the number of Calls that were dropped from general queue because RPC executor is under high load; returns 0 otherwise.

Specified by:

getNumGeneralCallsDropped in class RpcScheduler

getNumLifoModeSwitches

public long getNumLifoModeSwitches()

Description copied from class: RpcScheduler

If CoDel-based RPC executors are used, retrieves the number of Calls that were picked from the tail of the queue (indicating adaptive LIFO mode, when in the period of overloade we serve last requests first); returns 0 otherwise.

Specified by:

getNumLifoModeSwitches in class RpcScheduler

getWriteQueueLength

public int getWriteQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the write queue for metrics when use RWQueueRpcExecutor.

Specified by:

getWriteQueueLength in class RpcScheduler

getReadQueueLength

public int getReadQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the read queue for metrics when use RWQueueRpcExecutor.

Specified by:

getReadQueueLength in class RpcScheduler

getScanQueueLength

public int getScanQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the scan queue for metrics when use RWQueueRpcExecutor.

Specified by:

getScanQueueLength in class RpcScheduler

getActiveWriteRpcHandlerCount

public int getActiveWriteRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active write rpc handler when use RWQueueRpcExecutor.

Specified by:

getActiveWriteRpcHandlerCount in class RpcScheduler

getActiveReadRpcHandlerCount

public int getActiveReadRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active write rpc handler when use RWQueueRpcExecutor.

Specified by:

getActiveReadRpcHandlerCount in class RpcScheduler

getActiveScanRpcHandlerCount

public int getActiveScanRpcHandlerCount()

Description copied from class: RpcScheduler

Retrieves the number of active write rpc handler when use RWQueueRpcExecutor.

Specified by:

getActiveScanRpcHandlerCount in class RpcScheduler

getMetaPriorityQueueLength

public int getMetaPriorityQueueLength()

Description copied from class: RpcScheduler

Retrieves length of the meta priority queue for metrics.

Specified by:

getMetaPriorityQueueLength in class RpcScheduler

getCallQueueInfo

public CallQueueInfo getCallQueueInfo()

Description copied from class: RpcScheduler

Get call queue information

Specified by:

getCallQueueInfo in class RpcScheduler

updateMethodCountAndSizeByQueue

protected void updateMethodCountAndSizeByQueue(BlockingQueue<Runnable> queue,
 HashMap<String,Long> methodCount,
 HashMap<String,Long> methodSize)

getCallMethod

protected String getCallMethod(CallRunner task)