http://www.datastax.com/support-forums/topic/outofmemoryerrors-when-querying-a-hive-table-that-is-backed-by-a-cassandra-column-family Software, Support, and Training for Apache Cassandra en-US Wed, 19 Jun 2013 02:13:03 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/outofmemoryerrors-when-querying-a-hive-table-that-is-backed-by-a-cassandra-column-family#post-343 Mon, 25 Jul 2011 20:08:20 +0000 SVBridget 343@http://www.datastax.com/support-forums/ <p>From the IRC: the solution is to set TBLPROPERTIES: cassandra.range.size - MapReduce range batch size - default 1000 - when creating the hive table. Hive does not respect limit 100 at this point. </p> http://www.datastax.com/support-forums/topic/outofmemoryerrors-when-querying-a-hive-table-that-is-backed-by-a-cassandra-column-family#post-342 Mon, 25 Jul 2011 19:47:39 +0000 SVBridget 342@http://www.datastax.com/support-forums/ <p>Hello,<br /> We are getting OOM errors when querying a hive table that is backed by a cassandra column family (see below). Querying this cassandra column family from cassandra-cli works fine. I am assuming we have something configured wrong (we have a fairly vanilla brisk install). I saw some info on how to configure Cassandra to avoid OOM, but since the error is only on the hive side, I wasn't sure if that's where we need to change things. Could anyone offer some advice?</p> <p>Thanks,<br /> -B</p> <p>(note that we get an OOM with or without the "limit 100":</p> <p>hive&gt; select * from idx_logs limit 100;<br /> OK<br /> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space<br /> at org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:140)<br /> at org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:101)<br /> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)<br /> at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)<br /> at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)<br /> at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)<br /> at org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassandra.java:752)<br /> at org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.java:734)<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit(ColumnFamilyRecordReader.java:243)<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNext(ColumnFamilyRecordReader.java:279)<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNext(ColumnFamilyRecordReader.java:177) </p>