org.apache.datasketches.hive.hll

Class UnionSketchUDAF.UnionSketchUDAFEvaluator

java.lang.Object

org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

org.apache.datasketches.hive.hll.UnionSketchUDAF.UnionSketchUDAFEvaluator

All Implemented Interfaces:

Closeable, AutoCloseable

Enclosing class:

UnionSketchUDAF

public static class UnionSketchUDAF.UnionSketchUDAFEvaluator
extends org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Evaluator class, main logic of our UDAF.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AbstractAggregationBuffer, org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer, org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationType, org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.Mode

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	HLL_TYPE_FIELD
protected org.apache.hadoop.hive.serde2.objectinspector.PrimitiveObjectInspector	hllTypeInspector_
protected org.apache.hadoop.hive.serde2.objectinspector.PrimitiveObjectInspector	inputInspector_
protected org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector	intermediateInspector_
protected static String	LG_K_FIELD
protected org.apache.hadoop.hive.serde2.objectinspector.PrimitiveObjectInspector	lgKInspector_
protected static String	SKETCH_FIELD

Fields inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

partitionEvaluator

Constructor Summary

Constructors

Constructor and Description
UnionSketchUDAFEvaluator()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer	getNewAggregationBuffer()
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector	init(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.Mode mode, org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector[] parameters) Receives the passed in argument object inspectors and returns the desired return type's object inspector to inform hive of return type of UDAF.
void	iterate(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf, Object[] parameters) Add the incoming sketch into the internal state.
void	merge(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf, Object data)
void	reset(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf)
Object	terminate(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf)
Object	terminatePartial(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf)

Methods inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

aggregate, close, configure, createPartitionEvaluator, evaluate, getExprString, getPartitionWindowingEvaluator, getWindowingEvaluator, isEstimable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LG_K_FIELD

protected static final String LG_K_FIELD

See Also:

Constant Field Values

HLL_TYPE_FIELD

protected static final String HLL_TYPE_FIELD

See Also:

Constant Field Values

SKETCH_FIELD

protected static final String SKETCH_FIELD

See Also:

Constant Field Values

inputInspector_

protected org.apache.hadoop.hive.serde2.objectinspector.PrimitiveObjectInspector inputInspector_

lgKInspector_

protected org.apache.hadoop.hive.serde2.objectinspector.PrimitiveObjectInspector lgKInspector_

hllTypeInspector_

protected org.apache.hadoop.hive.serde2.objectinspector.PrimitiveObjectInspector hllTypeInspector_

intermediateInspector_

protected org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector intermediateInspector_

Constructor Detail

UnionSketchUDAFEvaluator

public UnionSketchUDAFEvaluator()

Method Detail

getNewAggregationBuffer

public org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer getNewAggregationBuffer()
                                                                                                     throws org.apache.hadoop.hive.ql.metadata.HiveException

Specified by:

getNewAggregationBuffer in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

init

public org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector init(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.Mode mode,
                                                                          org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector[] parameters)
                                                                   throws org.apache.hadoop.hive.ql.metadata.HiveException

Receives the passed in argument object inspectors and returns the desired return type's object inspector to inform hive of return type of UDAF.

Overrides:

init in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Parameters:

mode - Mode (i.e. PARTIAL 1, COMPLETE...) for determining input and output object inspector type.

parameters - List of object inspectors for input arguments.

Returns:

The object inspector type indicates the UDAF return type (i.e. returned type of terminate(...)).

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

iterate

public void iterate(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf,
                    Object[] parameters)
             throws org.apache.hadoop.hive.ql.metadata.HiveException

Add the incoming sketch into the internal state.

Specified by:

iterate in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Parameters:

buf - aggregation buffer storing intermediate results.

parameters - sketches in the form of Object passed in to be merged.

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

terminatePartial

public Object terminatePartial(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf)
                        throws org.apache.hadoop.hive.ql.metadata.HiveException

Specified by:

terminatePartial in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

merge

public void merge(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf,
                  Object data)
           throws org.apache.hadoop.hive.ql.metadata.HiveException

Specified by:

merge in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

terminate

public Object terminate(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf)
                 throws org.apache.hadoop.hive.ql.metadata.HiveException

Specified by:

terminate in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

reset

public void reset(org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.AggregationBuffer buf)
           throws org.apache.hadoop.hive.ql.metadata.HiveException

Specified by:

reset in class org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException