Developer API

org.apache.spark.io

Class LZ4CompressionCodec

java.lang.Object

org.apache.spark.io.LZ4CompressionCodec

All Implemented Interfaces:

CompressionCodec

public class LZ4CompressionCodec
extends java.lang.Object
implements CompressionCodec

LZ4 implementation of CompressionCodec. Block size can be configured by spark.io.compression.lz4.blockSize.

Note: The wire protocol for this codec is not guaranteed to be compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

Constructor Summary

Constructors

Constructor and Description
LZ4CompressionCodec(SparkConf conf)

Method Summary

Methods

Modifier and Type	Method and Description
java.io.InputStream	compressedInputStream(java.io.InputStream s)
java.io.OutputStream	compressedOutputStream(java.io.OutputStream s)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LZ4CompressionCodec

public LZ4CompressionCodec(SparkConf conf)

Method Detail

compressedOutputStream

public java.io.OutputStream compressedOutputStream(java.io.OutputStream s)

Specified by:

compressedOutputStream in interface CompressionCodec

compressedInputStream

public java.io.InputStream compressedInputStream(java.io.InputStream s)

Specified by:

compressedInputStream in interface CompressionCodec