DataStax Support Forums » Topic: Simple Hive Queries Failing

DataStax Support Forums » Topic: Simple Hive Queries Failing http://www.datastax.com/support-forums/topic/simple-hive-queries-failing Software, Support, and Training for Apache Cassandra en-US Sun, 19 May 2013 21:51:27 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php zznate on "Simple Hive Queries Failing" http://www.datastax.com/support-forums/topic/simple-hive-queries-failing#post-245 Thu, 30 Jun 2011 16:51:07 +0000 zznate 245@http://www.datastax.com/support-forums/ In combination with BRISK-230, yes. We are working to resolve this right now and should have a fix available in master and brisk1 branches shortly. efalcao on "Simple Hive Queries Failing" http://www.datastax.com/support-forums/topic/simple-hive-queries-failing#post-241 Wed, 29 Jun 2011 14:01:02 +0000 efalcao 241@http://www.datastax.com/support-forums/ anything else? are all the 3 issues above stemming from int/bigint issues? Yewei on "Simple Hive Queries Failing" http://www.datastax.com/support-forums/topic/simple-hive-queries-failing#post-239 Tue, 28 Jun 2011 21:13:03 +0000 Yewei 239@http://www.datastax.com/support-forums/ Hi, I believe this is a bug in our system. I will create a ticket for this. The issue of using BigInt and query returning NULL has been reported and worked on, please refer to Brisk-227. <a href="https://datastax.jira.com/browse/BRISK-227" rel="nofollow">https://datastax.jira.com/browse/BRISK-227</a> Thanks. Yewei efalcao on "Simple Hive Queries Failing" http://www.datastax.com/support-forums/topic/simple-hive-queries-failing#post-237 Tue, 28 Jun 2011 20:23:26 +0000 efalcao 237@http://www.datastax.com/support-forums/ Finally, I can't seem to get any CounterColumn data from cassandra into hive...here is my last effort: ubuntu@ip-10-88-197-147:~$ brisk hive Hive history file=/tmp/ubuntu/hive_job_log_ubuntu_201106282022_587940389.txt hive> drop table Metrics1m; OK Time taken: 0.678 seconds hive> CREATE EXTERNAL TABLE Metrics1m > (row_key string, column_name int, value int) > STORED BY 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' > WITH SERDEPROPERTIES ("cassandra.ks.name" = "TRProd"); OK Time taken: 0.544 seconds hive> select * from Metrics1m; OK Failed with exception java.io.IOException:java.lang.NullPointerException Time taken: 0.89 seconds hive> efalcao on "Simple Hive Queries Failing" http://www.datastax.com/support-forums/topic/simple-hive-queries-failing#post-236 Tue, 28 Jun 2011 19:37:16 +0000 efalcao 236@http://www.datastax.com/support-forums/ I've gotten the portfolio demo running before and now i've set up a 4 node (2 Cassandra, 2 Brisk) cluster running inside of EC2. Things seem to be working well, but I'm running into problems with simple hive queries, here is an example session: <code> ubuntu@ip-10-88-197-147:/tmp/ubuntu$ brisk hive Hive history file=/tmp/ubuntu/hive_job_log_ubuntu_201106281921_318487041.txt hive> drop table Timelines; OK Time taken: 0.714 seconds hive> CREATE EXTERNAL TABLE Timelines > (row_key string, column_name string, value string) > STORED BY 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' > WITH SERDEPROPERTIES ("cassandra.ks.name" = "TRProd"); OK Time taken: 0.855 seconds hive> select * from Timelines limit=10; FAILED: Parse Error: line 1:29 mismatched input '=' expecting Number in limit clause hive> select * from Timelines limit 10; OK s:1116:0 <@�~�5��@Ɩ6� 85546918847070208 s:1116:0 gXuB�7��YKr�O�> 85549591134617601 s:1116:0 ��7��}��a 85550274655174656 s:1116:0 �H��7��JQ�ç 85550611818496000 s:1116:0 6ν�8��:�e�q� 85552055397253120 s:1116:0 Hc��:��O��A 85555894108176384 s:1116:0 �i�:�� 85557110934474752 s:1116:0 ��<��l�^�� 85559776351748096 s:1116:0 p4�=��~��] 85561406514135040 s:1116:0 }K�.�>��m^��@ 85563216570228736 Time taken: 4.166 seconds hive> select * from Timelines limit 10; OK Failed with exception java.io.IOException:java.lang.NullPointerException Time taken: 0.19 seconds </code> What amusing is that the second query fails (hrm). Also, Any query that causes a mapreduce job to be created fails. Here is a backtrace I see on the JobTracker Page: <code> java.util.NoSuchElementException at java.util.TreeMap$PrivateEntryIterator.nextEntry(TreeMap.java:1115) at java.util.TreeMap$EntryIterator.next(TreeMap.java:1153) at java.util.TreeMap$EntryIterator.next(TreeMap.java:1148) at org.apache.hadoop.hive.cassandra.input.HiveCassandraStandardColumnInputFormat$2.next(HiveCassandraStandardColumnInputFormat.java:168) at org.apache.hadoop.hive.cassandra.input.HiveCassandraStandardColumnInputFormat$2.next(HiveCassandraStandardColumnInputFormat.java:111) at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:66) at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:32) at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:67) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:236) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:216) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:435) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371) at org.apache.hadoop.mapred.Child$4.run(Child.java:259) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:416) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:253) </code> Also, I'm curious to find out how best to represent cassandra UUID's when doing hive jobs...That's a vague question, but yeah, just wondering. I've tried making it a bigint and it just comes back as NULL