Support Forums : DataStax

DataStax Support Forums » DataStax Enterprise

Strange error with Hive queries

(3 posts) (2 voices)

Started 6 months ago by pierantonio.merlino
Latest reply from pierantonio.merlino
This topic is not a support question

Tags:

No tags yet.

pierantonio.merlino
Member

Hi,
I wrote a custom serde for Hive in order to manage the column composite types in my application.
Some fields in the composite are binary types.

All works, but when I perform queries with a WHERE clause like SELECT * FROM MyTable WHERE col1.a = XXX; where col1.a is a binary field, I get the following error:

2012-11-12 15:14:38,008 FATAL ExecMapper: org.apache.hadoop.hive.ql.metadata.
HiveException: Hive Runtime Error while processing row {...
...
Caused by: java.lang.RuntimeException: Hive 2 Internal error: unknown type: binary
	at org.apache.hadoop.hive.serde2.objectinspector.primitive.
PrimitiveObjectInspectorUtils.getDouble(PrimitiveObjectInspectorUtils.java:651)
	at org.apache.hadoop.hive.serde2.objectinspector.primitive.
PrimitiveObjectInspectorConverter$DoubleConverter.convert
(PrimitiveObjectInspectorConverter.java:232)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPEqual.evaluate
(GenericUDFOPEqual.java:73)
	at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate
(ExprNodeGenericFuncEvaluator.java:163)
	at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp
(FilterOperator.java:118)
	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
	at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp
(TableScanOperator.java:83)
	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:531)
	... 9 more

The method org.apache.hadoop.hive.serde2.objectinspector.primitive.
PrimitiveObjectInspectorUtils.getDouble indeed does not support binary types, but I don't understand how to solve the problem.

Can someone help me?
Thank you in advance

Posted 6 months ago #

sam
Member

when I've come across that error its been because the Hive query parser can't determine the Hive type of the operand in the comparision. So, for in this case it can't infer that XXX needs to be of type binary even though col1.a is binary. Does casting the value to Binary help at all?

Posted 6 months ago #

pierantonio.merlino
Member

Thank you for the answer.
I tried with SELECT * FROM MyTable WHERE col1.a = cast("XXX" as binary); but the result is:

FAILED: Hive Internal Error: java.lang.RuntimeException(Internal error:
Cannot find ConstantObjectInspector for BINARY)
java.lang.RuntimeException: Internal error: Cannot find ConstantObjectInspector
for BINARY
	at org.apache.hadoop.hive.serde2.objectinspector.primitive.
PrimitiveObjectInspectorFactory.getPrimitiveWritableConstantObjectInspector
(PrimitiveObjectInspectorFactory.java:196)

Posted 6 months ago #

RSS feed for this topic

Reply

You must log in to post.