org.apache.datasketches.pig.quantiles

Class UnionItemsSketch.UnionItemsSketchIntermediateFinal<T>

java.lang.Object

org.apache.pig.EvalFunc<org.apache.pig.data.Tuple>

org.apache.datasketches.pig.quantiles.UnionItemsSketch.UnionItemsSketchIntermediateFinal<T>

Type Parameters:

T - type of item

Direct Known Subclasses:

UnionStringsSketch.UnionStringsSketchIntermediateFinal

Enclosing class:

UnionItemsSketch<T>

public abstract static class UnionItemsSketch.UnionItemsSketchIntermediateFinal<T>
extends org.apache.pig.EvalFunc<org.apache.pig.data.Tuple>

Class used to calculate the intermediate or final combiner pass of an Algebraic union operation. This is called from the combiner, and may be called multiple times (from the mapper and from the reducer). It will receive a bag of values returned by either the Intermediate stage or the Initial stages, so it needs to be able to differentiate between and interpret both types.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.EvalFunc

org.apache.pig.EvalFunc.SchemaType

Field Summary

Fields inherited from class org.apache.pig.EvalFunc

log, pigLogger, reporter, returnType

Constructor Summary

Constructors

Constructor and Description
UnionItemsSketchIntermediateFinal(int k, Comparator<T> comparator, org.apache.datasketches.ArrayOfItemsSerDe<T> serDe) Constructor for the intermediate and final passes of an Algebraic function.

Method Summary

Modifier and Type	Method and Description
org.apache.pig.data.Tuple	exec(org.apache.pig.data.Tuple inputTuple)

Methods inherited from class org.apache.pig.EvalFunc

allowCompileTimeCalculation, finish, getArgToFuncMapping, getCacheFiles, getInputSchema, getLoadCaster, getLogger, getPigLogger, getReporter, getReturnType, getSchemaName, getSchemaType, getShipFiles, isAsynchronous, needEndOfAllInputProcessing, outputSchema, progress, setEndOfAllInput, setInputSchema, setPigLogger, setReporter, setUDFContextSignature, warn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UnionItemsSketchIntermediateFinal

public UnionItemsSketchIntermediateFinal(int k,
                                         Comparator<T> comparator,
                                         org.apache.datasketches.ArrayOfItemsSerDe<T> serDe)

Constructor for the intermediate and final passes of an Algebraic function.

Parameters:

k - parameter that determines the accuracy and size of the sketch.

comparator - for items of type T

serDe - an instance of ArrayOfItemsSerDe for type T

Method Detail

exec

public org.apache.pig.data.Tuple exec(org.apache.pig.data.Tuple inputTuple)
                               throws IOException

Specified by:

exec in class org.apache.pig.EvalFunc<org.apache.pig.data.Tuple>

Throws:

IOException