Package org.apache.hadoop.hbase.wal

Class IOTestProvider.IOTestWAL

java.lang.Object

org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL<org.apache.hadoop.hbase.wal.WALProvider.Writer>

org.apache.hadoop.hbase.regionserver.wal.FSHLog

org.apache.hadoop.hbase.wal.IOTestProvider.IOTestWAL

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.hbase.replication.regionserver.WALFileLengthProvider, org.apache.hadoop.hbase.wal.WAL

Enclosing class:

IOTestProvider

private static class IOTestProvider.IOTestWAL
extends org.apache.hadoop.hbase.regionserver.wal.FSHLog

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.wal.WAL

org.apache.hadoop.hbase.wal.WAL.Entry

Field Summary

Fields

Modifier and Type	Field	Description
private final boolean	doFileRolls
private final boolean	initialized
private org.apache.hadoop.hbase.wal.WALProvider.Writer	noRollsWriter

Fields inherited from class org.apache.hadoop.hbase.regionserver.wal.FSHLog

FIXED_OVERHEAD

Fields inherited from class org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL

abortable, blocksize, closed, closeExecutor, conf, consumeExecutor, consumer, coprocessorHost, DEFAULT_ROLL_ON_SYNC_TIME_MS, DEFAULT_SLOW_SYNC_ROLL_INTERVAL_MS, DEFAULT_SLOW_SYNC_ROLL_THRESHOLD, DEFAULT_SLOW_SYNC_TIME_MS, DEFAULT_WAL_BATCH_SIZE, DEFAULT_WAL_SHUTDOWN_WAIT_TIMEOUT_MS, DEFAULT_WAL_SYNC_TIMEOUT_MS, filenum, fs, hasConsumerTask, highestProcessedAppendTxid, highestSyncedTxid, highestUnsyncedTxid, implClassName, inflightWALClosures, listeners, logrollsize, MAX_LOGS, maxLogs, numEntries, ourFiles, prefixPathStr, RING_BUFFER_SLOT_COUNT, ROLL_ON_SYNC_TIME_MS, rollOnSyncNs, rollRequested, rollWriterLock, sequenceIdAccounting, shouldShutDownConsumeExecutorWhenClose, shutdown, SLOW_SYNC_ROLL_INTERVAL_MS, SLOW_SYNC_ROLL_THRESHOLD, SLOW_SYNC_TIME_MS, slowSyncCheckInterval, slowSyncCount, slowSyncNs, slowSyncRollThreshold, syncFutureCache, syncFutures, totalLogSize, toWriteAppends, unackedAppends, useHsync, WAL_AVOID_LOCAL_WRITES_DEFAULT, WAL_AVOID_LOCAL_WRITES_KEY, WAL_BATCH_SIZE, WAL_ROLL_MULTIPLIER, WAL_SHUTDOWN_WAIT_TIMEOUT_MS, WAL_SYNC_TIMEOUT_MS, walArchiveDir, walDir, walFile2Props, walFilePrefix, walFileSuffix, walShutdownTimeout

Constructor Summary

Constructors

Constructor	Description
IOTestWAL(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path rootDir, String logDir, String archiveDir, org.apache.hadoop.conf.Configuration conf, List<org.apache.hadoop.hbase.regionserver.wal.WALActionsListener> listeners, boolean failIfWALExists, String prefix, String suffix)	Create an edit log at the given dir location.

Method Summary

Modifier and Type	Method	Description
protected org.apache.hadoop.hbase.wal.WALProvider.Writer	createWriterInstance(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)

Methods inherited from class org.apache.hadoop.hbase.regionserver.wal.FSHLog

checkSlowSyncCount, createCombinedWriter, doAppend, doCheckLogLowReplication, doCleanUpResources, doWriterSync, init, onWriterReplaced

Methods inherited from class org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL

abortCacheFlush, append, appendData, appendEntry, appendMarker, archive, archiveLogFile, atHeadOfRingBufferEventHandlerAppend, blockOnSync, checkLogLowReplication, close, closeWriter, completeCacheFlush, computeFilename, createSingleThreadPoolConsumeExecutor, doCheckSlowSync, doReplaceWriter, doShutdown, doSync, doSync, getCoprocessorHost, getCurrentFileName, getEarliestMemStoreSeqNum, getFilenum, getFileNumFromFileName, getInflightWALCloseCount, getLogFileSize, getLogFileSizeIfBeingWritten, getNumLogFiles, getNumRolledLogFiles, getOldPath, getPreallocatedEventCount, getSequenceIdAccounting, getSyncedTxid, getSyncFuture, getWALArchivePath, isLogRollRequested, isWriterBroken, logRollAndSetupWalProps, main, markFutureDoneAndOffer, postSync, registerWALActionsListener, requestLogRoll, requestLogRoll, rollWriter, rollWriter, setWaitOnShutdownInSeconds, shutdown, skipRemoteWAL, stampSequenceIdAndPublishToRingBuffer, startCacheFlush, startCacheFlush, sync, sync, sync, sync, toString, unregisterWALActionsListener, updateStore, waitForSafePoint

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

doFileRolls

private final boolean doFileRolls

initialized

private final boolean initialized

noRollsWriter

private org.apache.hadoop.hbase.wal.WALProvider.Writer noRollsWriter

Constructor Details

IOTestWAL

public IOTestWAL(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path rootDir,
 String logDir,
 String archiveDir,
 org.apache.hadoop.conf.Configuration conf,
 List<org.apache.hadoop.hbase.regionserver.wal.WALActionsListener> listeners,
 boolean failIfWALExists,
 String prefix,
 String suffix)
          throws IOException

Create an edit log at the given dir location. You should never have to load an existing log. If there is a log at startup, it should have already been processed and deleted by the time the WAL object is started up.

Parameters:

fs - filesystem handle

rootDir - path to where logs and oldlogs

logDir - dir where wals are stored

archiveDir - dir where wals are archived

conf - configuration to use

listeners - Listeners on WAL events. Listeners passed here will be registered before we do anything else; e.g. the Constructor AbstractFSWAL.rollWriter().

failIfWALExists - If true IOException will be thrown if files related to this wal already exist.

prefix - should always be hostname and port in distributed env and it will be URL encoded before being used. If prefix is null, "wal" will be used

suffix - will be url encoded. null is treated as empty. non-empty must start with AbstractFSWALProvider.WAL_FILE_NAME_DELIMITER

Throws:

IOException

Method Details

createWriterInstance

protected org.apache.hadoop.hbase.wal.WALProvider.Writer createWriterInstance(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path path)
                                                                       throws IOException

Overrides:

createWriterInstance in class org.apache.hadoop.hbase.regionserver.wal.FSHLog

Throws:

IOException