Package org.apache.hadoop.hbase.io.compress.aircompressor

Class ZstdCodec

java.lang.Object
org.apache.hadoop.hbase.io.compress.aircompressor.ZstdCodec
All Implemented Interfaces:
org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.compress.CompressionCodec
@Private public class ZstdCodec extends Object implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.compress.CompressionCodec
Hadoop codec implementation for Zstandard, implemented with aircompressor.

Unlike the other codecs this one should be considered as under development and unstable (as in changing), reflecting the status of aircompressor's zstandard implementation.

NOTE: This codec is NOT data format compatible with the Hadoop native zstandard codec. There are issues with both framing and limitations of the aircompressor zstandard compressor. This codec can be used as an alternative to the native codec, if the native codec cannot be made available and/or an eventual migration will never be necessary (i.e. this codec's performance meets anticipated requirements). Once you begin using this alternative you will be locked into it.

  • Field Details

  • Constructor Details

  • Method Details

    • setConf

      public void setConf(org.apache.hadoop.conf.Configuration conf)
      Specified by:
      setConf in interface org.apache.hadoop.conf.Configurable

    • getConf

      public org.apache.hadoop.conf.Configuration getConf()
      Specified by:
      getConf in interface org.apache.hadoop.conf.Configurable

    • createCompressor

      public org.apache.hadoop.io.compress.Compressor createCompressor()
      Specified by:
      createCompressor in interface org.apache.hadoop.io.compress.CompressionCodec

    • createDecompressor

      public org.apache.hadoop.io.compress.Decompressor createDecompressor()
      Specified by:
      createDecompressor in interface org.apache.hadoop.io.compress.CompressionCodec

    • createInputStream

      public org.apache.hadoop.io.compress.CompressionInputStream createInputStream(InputStream in) throws IOException
      Specified by:
      createInputStream in interface org.apache.hadoop.io.compress.CompressionCodec
      Throws:
      IOException

    • createInputStream

      public org.apache.hadoop.io.compress.CompressionInputStream createInputStream(InputStream in, org.apache.hadoop.io.compress.Decompressor d) throws IOException
      Specified by:
      createInputStream in interface org.apache.hadoop.io.compress.CompressionCodec
      Throws:
      IOException

    • createOutputStream

      public org.apache.hadoop.io.compress.CompressionOutputStream createOutputStream(OutputStream out) throws IOException
      Specified by:
      createOutputStream in interface org.apache.hadoop.io.compress.CompressionCodec
      Throws:
      IOException

    • createOutputStream

      public org.apache.hadoop.io.compress.CompressionOutputStream createOutputStream(OutputStream out, org.apache.hadoop.io.compress.Compressor c) throws IOException
      Specified by:
      createOutputStream in interface org.apache.hadoop.io.compress.CompressionCodec
      Throws:
      IOException

    • getCompressorType

      public Class<? extends org.apache.hadoop.io.compress.Compressor> getCompressorType()
      Specified by:
      getCompressorType in interface org.apache.hadoop.io.compress.CompressionCodec

    • getDecompressorType

      public Class<? extends org.apache.hadoop.io.compress.Decompressor> getDecompressorType()
      Specified by:
      getDecompressorType in interface org.apache.hadoop.io.compress.CompressionCodec

    • getDefaultExtension

      public String getDefaultExtension()
      Specified by:
      getDefaultExtension in interface org.apache.hadoop.io.compress.CompressionCodec

    • getBufferSize

      static int getBufferSize(org.apache.hadoop.conf.Configuration conf)