DataStax Support Forums » Topic: using cassandra with cdh hadoop

DataStax Support Forums » Topic: using cassandra with cdh hadoop http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop Software, Support, and Training for Apache Cassandra en-US Wed, 19 Jun 2013 18:24:14 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php koert on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-463 Mon, 22 Aug 2011 15:01:24 +0000 koert 463@http://www.datastax.com/support-forums/ i believe it is a thrift version issue. hive 0.7 that ships with cdh3u1 relies on thrift 0.5, while cassandra uses thrift 0.6. since they are not compatible (i think?) i cannot just replace thrift 0.5 with version 0.6, so i am stuck. i did try to swap both thrift and fb303, which resulted in: java.lang.NoClassDefFoundError: com/facebook/fb303/FacebookService$Iface koert on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-461 Fri, 19 Aug 2011 17:37:27 +0000 koert 461@http://www.datastax.com/support-forums/ i replaced file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar with file://usr/share/brisk/hive/lib/hive-cassandra-handler-0.7.0-brisk1-beta2.jar What i am worried about is that this version of the CassandraStorageHandler will try to use the cassandra metastore for hive, instead of the mysql metastore that we use... Results: hive> set hive.aux.jars.path; hive.aux.jars.path=file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/hive/lib/hive-cassandra-handler-0.7.0-brisk1-beta2.jar hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2"); 11/08/19 13:32:03 DEBUG parse.VariableSubstitution: Substitution is on: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2") 11/08/19 13:32:03 INFO parse.ParseDriver: Parsing command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2") 11/08/19 13:32:03 INFO parse.ParseDriver: Parse Completed 11/08/19 13:32:03 INFO parse.SemanticAnalyzer: Starting Semantic Analysis 11/08/19 13:32:03 INFO parse.SemanticAnalyzer: Creating table cass_test position=22 11/08/19 13:32:03 INFO ql.Driver: Semantic Analysis Completed 11/08/19 13:32:03 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 11/08/19 13:32:03 INFO ql.Driver: Starting command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2") 11/08/19 13:32:03 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.cassandra.serde.StandardColumnSerDe for table cass_test 11/08/19 13:32:03 INFO hive.log: DDL: struct cass_test { string row_key, string col1, string col2} 11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: table column string: row_key,col1,col2 11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: Auto-created mapping string: :key,col1,col2 11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: CassandraSerDe initialized with : columnNames = row_key,col1,col2 columnTypes = string,string,string cassandraColumnMapping = [:key, col1, col2] 11/08/19 13:32:03 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with SOFT 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:mysql://node01/metastore 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with checked 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateConstraints value null from jpox.properties with false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.autoCreateSchema value null from jpox.properties with false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with hive 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with DBCP 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.fixedDatastore value null from jpox.properties with true 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with com.mysql.jdbc.Driver 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateColumns value null from jpox.properties with false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateTables value null from jpox.properties with false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.jdo.JDOPersistenceManagerFactory 11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.autoStartMechanismMode = checked 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.identifierFactory = datanucleus 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.transactionIsolation = read-committed 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateTables = false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:mysql://node01/metastore 11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true 11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.fixedDatastore = true 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateConstraints = false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = com.mysql.jdbc.Driver 11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionUserName = hive 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateColumns = false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.cache.level2 = false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.cache.level2.type = SOFT 11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.jdo.JDOPersistenceManagerFactory 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.autoCreateSchema = false 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.storeManagerType = rdbms 11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.connectionPoolingType = DBCP 11/08/19 13:32:03 INFO metastore.ObjectStore: ObjectStore, initialize called 11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved. 11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved. 11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved. 11/08/19 13:32:04 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 11/08/19 13:32:04 INFO metastore.ObjectStore: Initialized ObjectStore 11/08/19 13:32:05 DEBUG cassandra.CassandraProxyClient: Connected to cassandra at 192.168.1.51:9160 java.lang.NoSuchMethodError: org.apache.thrift.meta_data.FieldValueMetaData.<init>(BZ)V at org.apache.cassandra.thrift.CfDef.<clinit>(CfDef.java:299) at org.apache.cassandra.thrift.KsDef.read(KsDef.java:753) at org.apache.cassandra.thrift.Cassandra$describe_keyspaces_result.read(Cassandra.java:20970) at org.apache.cassandra.thrift.Cassandra$Client.recv_describe_keyspaces(Cassandra.java:1153) at org.apache.cassandra.thrift.Cassandra$Client.describe_keyspaces(Cassandra.java:1129) at org.apache.hadoop.hive.cassandra.CassandraProxyClient.initializeConnection(CassandraProxyClient.java:165) at org.apache.hadoop.hive.cassandra.CassandraProxyClient.<init>(CassandraProxyClient.java:103) at org.apache.hadoop.hive.cassandra.CassandraManager.openConnection(CassandraManager.java:88) at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:143) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask 11/08/19 13:32:05 ERROR ql.Driver: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask hive> koert on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-460 Fri, 19 Aug 2011 15:22:46 +0000 koert 460@http://www.datastax.com/support-forums/ another try with different jars got me farther: hive> set hive.aux.jars.path; hive.aux.jars.path=file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar,file:///usr/share/java/hive-cassandra-handler-0.7.0-beta1.jar hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2"); 11/08/19 11:20:26 DEBUG parse.VariableSubstitution: Substitution is on: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2") 11/08/19 11:20:26 INFO parse.ParseDriver: Parsing command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2") 11/08/19 11:20:26 INFO parse.ParseDriver: Parse Completed 11/08/19 11:20:26 INFO parse.SemanticAnalyzer: Starting Semantic Analysis 11/08/19 11:20:26 INFO parse.SemanticAnalyzer: Creating table cass_test position=22 11/08/19 11:20:26 INFO ql.Driver: Semantic Analysis Completed 11/08/19 11:20:26 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 11/08/19 11:20:26 INFO ql.Driver: Starting command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2") 11/08/19 11:20:26 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.cassandra.serde.StandardColumnSerDe for table cass_test 11/08/19 11:20:26 INFO hive.log: DDL: struct cass_test { string row_key, string col1, string col2} 11/08/19 11:20:26 DEBUG serde.StandardColumnSerDe: CassandraSerDe initialized with : columnNames = row_key,col1,col2 columnTypes = string,string,string cassandraColumnMapping = [:key, col1, col2] 11/08/19 11:20:26 DEBUG cassandra.CassandraManager: open connection to host:port - 192.168.1.51:9160 11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: Use randomized connection for 192.168.1.51:9160 11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: socke is opened: false trans is opened: false 11/08/19 11:20:26 DEBUG cassandra.CassandraClientHolder: Transport is open true 11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: Connected to cassandra at 192.168.1.51:9160 11/08/19 11:20:26 DEBUG cassandra.CassandraManager: close connection to host:port - 192.168.1.51:9160 FAILED: Error in metadata: java.lang.NullPointerException 11/08/19 11:20:26 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.NullPointerException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:476) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) Caused by: java.lang.NullPointerException at org.apache.hadoop.hive.cassandra.CassandraManager.closeConnection(CassandraManager.java:110) at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:146) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470) ... 15 more 11/08/19 11:20:26 DEBUG exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:476) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) Caused by: java.lang.NullPointerException at org.apache.hadoop.hive.cassandra.CassandraManager.closeConnection(CassandraManager.java:110) at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:146) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470) ... 15 more FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask 11/08/19 11:20:26 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask hive> tjake on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-459 Fri, 19 Aug 2011 14:55:56 +0000 tjake 459@http://www.datastax.com/support-forums/ Try replacing file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar with the jar from usr/share/brisk/hive/lib koert on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-458 Fri, 19 Aug 2011 14:47:54 +0000 koert 458@http://www.datastax.com/support-forums/ i tried the following: hive> set hive.aux.jars.path; hive.aux.jars.path=file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u1.jar,file:///usr/lib/hbase/hbase-0.90.3-cdh3u1.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar,file:///usr/share/brisk/cassandra/lib/guava-r08.jar,file:///usr/share/brisk/cassandra/lib/commons-lang-2.4.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler'; java.lang.NoClassDefFoundError: org/apache/cassandra/thrift/NotFoundException at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.hadoop.hive.ql.metadata.HiveUtils.getStorageHandler(HiveUtils.java:144) at org.apache.hadoop.hive.ql.metadata.Table.getStorageHandler(Table.java:268) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3027) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) Caused by: java.lang.ClassNotFoundException: org.apache.cassandra.thrift.NotFoundException at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 19 more FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask tjake on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-457 Fri, 19 Aug 2011 14:23:23 +0000 tjake 457@http://www.datastax.com/support-forums/ It should still work just modify the classpath to use the hive driver and cassandra that you have from beta2 koert on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-456 Fri, 19 Aug 2011 14:19:51 +0000 koert 456@http://www.datastax.com/support-forums/ thanks for that. it makes sense. however i am not running cassandra 7 but the cassandra that came with the latest brisk (apache-cassandra-0.8.1-brisk1-beta2.jar). does this mean i am out of luck? tjake on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-454 Fri, 19 Aug 2011 02:44:28 +0000 tjake 454@http://www.datastax.com/support-forums/ Yes you can. Take a look at <a href="https://github.com/riptano/hive/wiki/Cassandra-Handler-usage-in-Hive-0.7-with-Cassandra-0.7" rel="nofollow">https://github.com/riptano/hive/wiki/Cassandra-Handler-usage-in-Hive-0.7-with-Cassandra-0.7</a> koert on "using cassandra with cdh hadoop" http://www.datastax.com/support-forums/topic/using-cassandra-with-cdh-hadoop#post-453 Fri, 19 Aug 2011 00:47:30 +0000 koert 453@http://www.datastax.com/support-forums/ for some projects brisk is not an option and i use cloudera's cdh distro. however i would still like to use cassandra. is there an easy way to get cassandra connected to my hive in cdh? is the CassandraStorageHandler somehow available as a separate project that i can compile and add to my hive? thanks! koert