Uses of Package
org.apache.hadoop.hbase.io.hfile
Package
Description
Provides HBase Client
Table of Contents
Provides implementations of
HFile
and HFile
BlockCache
.Provides
BucketCache
, an implementation of
BlockCache
.Provides HBase MapReduce
Input/OutputFormats, a table indexing MapReduce job, and utility methods.
-
-
-
ClassDescriptionStores all of the cache objects and configuration for a single HFile.Metadata Map of attributes for HFile written out as HFile Trailer.A scanner allows you to position yourself within a HFile and scan through it.Carries the information on some of the meta data about the HFile Reader
-
ClassDescriptionVarious types of HFile blocks.Read-only HFile Context Information.
-
ClassDescriptionSnapshot of block cache age in cache.Block cache interface.Enum of all built in external block caches.Cache Key for use with implementations of
BlockCache
Use one of these to keep a running account of cached blocks by file.Allows for defining different compression rate predicates on its implementing classes.Various types of HFile blocks.BlockWithScanInfo is wrapper class for HFileBlock with other attributes.Cacheable is an interface that allows for an object to be cached.Interface for a deserializer.Stores all of the cache objects and configuration for a single HFile.Class that implements cache metrics.CombinedBlockCache is an abstraction layer that combinesFirstLevelBlockCache
andBucketCache
.A Bloom filter chunk enqueued for writingThis exception is thrown when attempts to read an HFile fail due to corruption or truncation issues.TheByteBuffAllocator
won't allocate pooled heapByteBuff
now; at the same time, if allocate an off-heapByteBuff
from allocator, then it must be a pooled one.In-memory BlockCache that may be backed by secondary layer(s).TheHFile
has a fixed trailer which contains offsets to other variable parts of the file.An abstraction used by the block index.An interface used by clients to open and iterate anHFile
.API required to write anHFile
This variety of ways to construct writers is used throughout the code, and we want to be able to swap writer implementations.Cacheable Blocks of anHFile
version 2 file.Iterator for readingHFileBlock
s in load-on-open-section, such as root data index block, meta index block, file info block etc.Something that can be written into a block.An HFile block reader with iteration ability.Data-structure to use caching the header of the NEXT block.Unified version 2HFile
block writer.The reader will always hold the root level index in the memory.Writes the block index into the output stream.An implementation of the BlockIndexReader that deals with block keys which are plain byte[] like MetaBlock or the Bloom Block for ROW bloom.An implementation of the BlockIndexReader that deals with block keys which are the key part of a cell like the Data block index or the ROW_COL bloom blocks This needs a comparator to work with the CellsRead-only HFile Context Information.A builder that helps in building up the HFileContextControls what kind of data block encoding is used.Controls what kind of index block encoding is used.Metadata Map of attributes for HFile written out as HFile Trailer.Holds a Histogram and supporting min/max and range buckets for analyzing distribution of key bytes, value bytes, row bytes, and row columns.Simple reporter which collects registered histograms for printing to an output stream inHFilePrettyPrinter.SimpleReporter.report()
.A builder forHFilePrettyPrinter.SimpleReporter
instances.Implementation that can handle all hfile versions ofHFile.Reader
.A scanner allows you to position yourself within a HFile and scan through it.A way to write "inline" blocks into anHFile
.This realisation improve performance of classical LRU cache up to 3 times via reduce GC job.Used to group blocks into priority buckets.A block cache implementation that is memory-aware usingHeapSize
, memory-bound using an LRU eviction algorithm, and concurrent: backed by aConcurrentHashMap
and with a non-blocking eviction thread giving constant-timeLruBlockCache.cacheBlock(org.apache.hadoop.hbase.io.hfile.BlockCacheKey, org.apache.hadoop.hbase.io.hfile.Cacheable, boolean)
andLruBlockCache.getBlock(org.apache.hadoop.hbase.io.hfile.BlockCacheKey, boolean, boolean, boolean)
operations.Used to group blocks into priority buckets.Represents an entry in theLruBlockCache
.A memory-bound queue that will grow until an element brings total size >= maxSize.Class to store blocks into memcached.Class to encode and decode an HFileBlock to and from memecached's resulting byte arrays.Does not perform any kind of encoding/decoding.Does not perform any kind of encoding/decoding.Carries the information on some of the meta data about the HFile ReaderA builder that helps in building up the ReaderContextBlockCache which is resizable. -
ClassDescriptionBlock cache interface.Cache Key for use with implementations of
BlockCache
Various types of HFile blocks.Cacheable is an interface that allows for an object to be cached.Interface for a deserializer.Stores all of the cache objects and configuration for a single HFile.Class that implements cache metrics.Cacheable Blocks of anHFile
version 2 file. -
-
ClassDescriptionAn interface used by clients to open and iterate an
HFile
.A scanner allows you to position yourself within a HFile and scan through it. -
-
ClassDescriptionBlock cache interface.Various types of HFile blocks.Stores all of the cache objects and configuration for a single HFile.Class that implements cache metrics.An interface used by clients to open and iterate an
HFile
.API required to write anHFile
Read-only HFile Context Information.Controls what kind of data block encoding is used.Metadata Map of attributes for HFile written out as HFile Trailer.A scanner allows you to position yourself within a HFile and scan through it.Carries the information on some of the meta data about the HFile ReaderBlockCache which is resizable. -
-
-