org.apache.datasketches.pig.frequencies

Class DataToFrequentItemsSketchAlgebraicIntermediateFinal<T>

java.lang.Object

org.apache.pig.EvalFunc<org.apache.pig.data.Tuple>

org.apache.datasketches.pig.frequencies.DataToFrequentItemsSketchAlgebraicIntermediateFinal<T>

Type Parameters:

T - Type of the item

Direct Known Subclasses:

DataToFrequentStringsSketch.IntermediateFinal

public abstract class DataToFrequentItemsSketchAlgebraicIntermediateFinal<T>
extends org.apache.pig.EvalFunc<org.apache.pig.data.Tuple>

Class used to calculate the intermediate pass (combiner) or the final pass (reducer) of an Algebraic sketch operation. This may be called multiple times (from the mapper and from the reducer). It will receive a bag of values returned by either the Intermediate stage or the Initial stages, so it needs to be able to differentiate between and interpret both types.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.EvalFunc

org.apache.pig.EvalFunc.SchemaType

Field Summary

Fields inherited from class org.apache.pig.EvalFunc

log, pigLogger, reporter, returnType

Constructor Summary

Constructors

Constructor and Description
DataToFrequentItemsSketchAlgebraicIntermediateFinal() Default constructor to make pig validation happy.
DataToFrequentItemsSketchAlgebraicIntermediateFinal(int sketchSize, org.apache.datasketches.ArrayOfItemsSerDe<T> serDe)

Method Summary

Modifier and Type	Method and Description
org.apache.pig.data.Tuple	exec(org.apache.pig.data.Tuple inputTuple)

Methods inherited from class org.apache.pig.EvalFunc

allowCompileTimeCalculation, finish, getArgToFuncMapping, getCacheFiles, getInputSchema, getLoadCaster, getLogger, getPigLogger, getReporter, getReturnType, getSchemaName, getSchemaType, getShipFiles, isAsynchronous, needEndOfAllInputProcessing, outputSchema, progress, setEndOfAllInput, setInputSchema, setPigLogger, setReporter, setUDFContextSignature, warn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataToFrequentItemsSketchAlgebraicIntermediateFinal

public DataToFrequentItemsSketchAlgebraicIntermediateFinal()

Default constructor to make pig validation happy.

DataToFrequentItemsSketchAlgebraicIntermediateFinal

public DataToFrequentItemsSketchAlgebraicIntermediateFinal(int sketchSize,
                                                           org.apache.datasketches.ArrayOfItemsSerDe<T> serDe)

Method Detail

exec

public org.apache.pig.data.Tuple exec(org.apache.pig.data.Tuple inputTuple)
                               throws IOException

Specified by:

exec in class org.apache.pig.EvalFunc<org.apache.pig.data.Tuple>

Throws:

IOException