org.apache.lens.lib.query

Class LensFileOutputFormat

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

org.apache.lens.lib.query.LensFileOutputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

public class LensFileOutputFormat
extends org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

File output format which would write Text values in the charset enconding passed.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LensFileOutputFormat.LensRowWriter The Class LensRowWriter.

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Field Summary

Fields

Modifier and Type	Field and Description
static String	NEWLINE The Constant NEWLINE.
static String	UTF16LE The Constant UTF16LE.
static String	UTF8 The Constant UTF8.
static Pattern	VALID_PATTERN Regex pattern for valid file path name characters

Constructor Summary

Constructors

Constructor and Description
LensFileOutputFormat()

Method Summary

Modifier and Type	Method and Description
static LensFileOutputFormat.LensRowWriter	createRecordWriter(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path tmpWorkPath, org.apache.hadoop.util.Progressable progress, boolean isCompressed, String extn, String encoding) Creates the record writer.
static boolean	getCompressOutput(org.apache.hadoop.conf.Configuration conf) Gets the compress output.
String	getOuptutFileExtn(org.apache.hadoop.conf.Configuration conf) Gets the ouptut file extn.
static Class<? extends org.apache.hadoop.io.compress.CompressionCodec>	getOutputCompressorClass(org.apache.hadoop.conf.Configuration conf) Gets the output compressor class.
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)
String	getResultEncoding(org.apache.hadoop.conf.Configuration conf) Gets the result encoding.
static String	getValidOutputFileName(String name) Generates a valid output file name from the given name

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

UTF8

public static final String UTF8

The Constant UTF8.

See Also:

Constant Field Values

UTF16LE

public static final String UTF16LE

The Constant UTF16LE.

See Also:

Constant Field Values

NEWLINE

public static final String NEWLINE

The Constant NEWLINE.

See Also:

Constant Field Values

VALID_PATTERN

public static final Pattern VALID_PATTERN

Regex pattern for valid file path name characters

Constructor Detail

LensFileOutputFormat

public LensFileOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                                                                                          org.apache.hadoop.mapred.JobConf job,
                                                                                                                          String name,
                                                                                                                          org.apache.hadoop.util.Progressable progress)
                                                                                                                   throws IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Specified by:

getRecordWriter in class org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Throws:

IOException

createRecordWriter

public static LensFileOutputFormat.LensRowWriter createRecordWriter(org.apache.hadoop.conf.Configuration conf,
                                                                    org.apache.hadoop.fs.Path tmpWorkPath,
                                                                    org.apache.hadoop.util.Progressable progress,
                                                                    boolean isCompressed,
                                                                    String extn,
                                                                    String encoding)
                                                             throws IOException

Creates the record writer.

Parameters:

conf - the conf

tmpWorkPath - the tmp work path

progress - the progress

isCompressed - the is compressed

extn - the extn

encoding - the encoding

Returns:

the lens row writer

Throws:

IOException - Signals that an I/O exception has occurred.

getResultEncoding

public String getResultEncoding(org.apache.hadoop.conf.Configuration conf)

Gets the result encoding.

Parameters:

conf - the conf

Returns:

the result encoding

getOuptutFileExtn

public String getOuptutFileExtn(org.apache.hadoop.conf.Configuration conf)

Gets the ouptut file extn.

Parameters:

conf - the conf

Returns:

the ouptut file extn

getOutputCompressorClass

public static Class<? extends org.apache.hadoop.io.compress.CompressionCodec> getOutputCompressorClass(org.apache.hadoop.conf.Configuration conf)

Gets the output compressor class.

Parameters:

conf - the conf

Returns:

the output compressor class

getCompressOutput

public static boolean getCompressOutput(org.apache.hadoop.conf.Configuration conf)

Gets the compress output.

Parameters:

conf - the conf

Returns:

the compress output

getValidOutputFileName

public static String getValidOutputFileName(String name)

Generates a valid output file name from the given name

Parameters:

name - name to be converted

Returns:

Valid output file name