using cassandra with cdh hadoop

(9 posts) (2 voices)

• Started 1 year ago by koert
• Latest reply from koert
• This topic is not a support question

Tags:

No tags yet.

1. 

   koert
   Member

   for some projects brisk is not an option and i use cloudera's cdh distro. however i would still like to use cassandra. is there an easy way to get cassandra connected to my hive in cdh? is the CassandraStorageHandler somehow available as a separate project that i can compile and add to my hive?
   thanks! koert

   Posted 1 year ago #
2. 

   tjake
   Moderator

   Yes you can. Take a look at https://github.com/riptano/hive/wiki/Cassandra-Handler-usage-in-Hive-0.7-with-Cassandra-0.7

   Posted 1 year ago #
3. 

   koert
   Member

   thanks for that. it makes sense. however i am not running cassandra 7 but the cassandra that came with the latest brisk (apache-cassandra-0.8.1-brisk1-beta2.jar). does this mean i am out of luck?

   Posted 1 year ago #
4. 

   tjake
   Moderator

   It should still work just modify the classpath to use the hive driver and cassandra that you have from beta2

   Posted 1 year ago #
5. 

   koert
   Member

   i tried the following:
   hive> set hive.aux.jars.path;
   hive.aux.jars.path=file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u1.jar,file:///usr/lib/hbase/hbase-0.90.3-cdh3u1.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar,file:///usr/share/brisk/cassandra/lib/guava-r08.jar,file:///usr/share/brisk/cassandra/lib/commons-lang-2.4.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar

   hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler';
   java.lang.NoClassDefFoundError: org/apache/cassandra/thrift/NotFoundException
   at java.lang.Class.forName0(Native Method)
   at java.lang.Class.forName(Class.java:247)
   at org.apache.hadoop.hive.ql.metadata.HiveUtils.getStorageHandler(HiveUtils.java:144)
   at org.apache.hadoop.hive.ql.metadata.Table.getStorageHandler(Table.java:268)
   at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3027)
   at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
   at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
   Caused by: java.lang.ClassNotFoundException: org.apache.cassandra.thrift.NotFoundException
   at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
   ... 19 more
   FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask

   Posted 1 year ago #
6. 

   tjake
   Moderator

   Try replacing file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar with the jar from usr/share/brisk/hive/lib

   Posted 1 year ago #
7. 

   koert
   Member

   another try with different jars got me farther:

   hive> set hive.aux.jars.path;
   hive.aux.jars.path=file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar,file:///usr/share/java/hive-cassandra-handler-0.7.0-beta1.jar
   hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2");
   11/08/19 11:20:26 DEBUG parse.VariableSubstitution: Substitution is on: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
   11/08/19 11:20:26 INFO parse.ParseDriver: Parsing command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
   11/08/19 11:20:26 INFO parse.ParseDriver: Parse Completed
   11/08/19 11:20:26 INFO parse.SemanticAnalyzer: Starting Semantic Analysis
   11/08/19 11:20:26 INFO parse.SemanticAnalyzer: Creating table cass_test position=22
   11/08/19 11:20:26 INFO ql.Driver: Semantic Analysis Completed
   11/08/19 11:20:26 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
   11/08/19 11:20:26 INFO ql.Driver: Starting command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
   11/08/19 11:20:26 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.cassandra.serde.StandardColumnSerDe for table cass_test
   11/08/19 11:20:26 INFO hive.log: DDL: struct cass_test { string row_key, string col1, string col2}
   11/08/19 11:20:26 DEBUG serde.StandardColumnSerDe: CassandraSerDe initialized with : columnNames = row_key,col1,col2 columnTypes = string,string,string cassandraColumnMapping = [:key, col1, col2]
   11/08/19 11:20:26 DEBUG cassandra.CassandraManager: open connection to host:port - 192.168.1.51:9160
   11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: Use randomized connection for 192.168.1.51:9160
   11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: socke is opened: false trans is opened: false
   11/08/19 11:20:26 DEBUG cassandra.CassandraClientHolder: Transport is open true
   11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: Connected to cassandra at 192.168.1.51:9160
   11/08/19 11:20:26 DEBUG cassandra.CassandraManager: close connection to host:port - 192.168.1.51:9160
   FAILED: Error in metadata: java.lang.NullPointerException
   11/08/19 11:20:26 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.NullPointerException
   org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:476)
   at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
   at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
   at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
   Caused by: java.lang.NullPointerException
   at org.apache.hadoop.hive.cassandra.CassandraManager.closeConnection(CassandraManager.java:110)
   at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:146)
   at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
   ... 15 more

   11/08/19 11:20:26 DEBUG exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:476)
   at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
   at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
   at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
   Caused by: java.lang.NullPointerException
   at org.apache.hadoop.hive.cassandra.CassandraManager.closeConnection(CassandraManager.java:110)
   at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:146)
   at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
   ... 15 more

   FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
   11/08/19 11:20:26 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
   hive>

   Posted 1 year ago #
8. 

   koert
   Member

   i replaced file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar with file://usr/share/brisk/hive/lib/hive-cassandra-handler-0.7.0-brisk1-beta2.jar

   What i am worried about is that this version of the CassandraStorageHandler will try to use the cassandra metastore for hive, instead of the mysql metastore that we use...

   Results:
   hive> set hive.aux.jars.path;
   hive.aux.jars.path=file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/hive/lib/hive-cassandra-handler-0.7.0-brisk1-beta2.jar
   hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2");
   11/08/19 13:32:03 DEBUG parse.VariableSubstitution: Substitution is on: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
   11/08/19 13:32:03 INFO parse.ParseDriver: Parsing command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
   11/08/19 13:32:03 INFO parse.ParseDriver: Parse Completed
   11/08/19 13:32:03 INFO parse.SemanticAnalyzer: Starting Semantic Analysis
   11/08/19 13:32:03 INFO parse.SemanticAnalyzer: Creating table cass_test position=22
   11/08/19 13:32:03 INFO ql.Driver: Semantic Analysis Completed
   11/08/19 13:32:03 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
   11/08/19 13:32:03 INFO ql.Driver: Starting command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
   11/08/19 13:32:03 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.cassandra.serde.StandardColumnSerDe for table cass_test
   11/08/19 13:32:03 INFO hive.log: DDL: struct cass_test { string row_key, string col1, string col2}
   11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: table column string: row_key,col1,col2
   11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: Auto-created mapping string: :key,col1,col2
   11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: CassandraSerDe initialized with : columnNames = row_key,col1,col2 columnTypes = string,string,string cassandraColumnMapping = [:key, col1, col2]
   11/08/19 13:32:03 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with SOFT
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:mysql://node01/metastore
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with checked
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateConstraints value null from jpox.properties with false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.autoCreateSchema value null from jpox.properties with false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with hive
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with DBCP
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.fixedDatastore value null from jpox.properties with true
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with com.mysql.jdbc.Driver
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateColumns value null from jpox.properties with false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateTables value null from jpox.properties with false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.jdo.JDOPersistenceManagerFactory
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.autoStartMechanismMode = checked
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.identifierFactory = datanucleus
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.transactionIsolation = read-committed
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateTables = false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:mysql://node01/metastore
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.fixedDatastore = true
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateConstraints = false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = com.mysql.jdbc.Driver
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionUserName = hive
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateColumns = false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.cache.level2 = false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.cache.level2.type = SOFT
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.jdo.JDOPersistenceManagerFactory
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.autoCreateSchema = false
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.storeManagerType = rdbms
   11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.connectionPoolingType = DBCP
   11/08/19 13:32:03 INFO metastore.ObjectStore: ObjectStore, initialize called
   11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
   11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
   11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
   11/08/19 13:32:04 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
   11/08/19 13:32:04 INFO metastore.ObjectStore: Initialized ObjectStore
   11/08/19 13:32:05 DEBUG cassandra.CassandraProxyClient: Connected to cassandra at 192.168.1.51:9160
   java.lang.NoSuchMethodError: org.apache.thrift.meta_data.FieldValueMetaData.<init>(BZ)V
   at org.apache.cassandra.thrift.CfDef.<clinit>(CfDef.java:299)
   at org.apache.cassandra.thrift.KsDef.read(KsDef.java:753)
   at org.apache.cassandra.thrift.Cassandra$describe_keyspaces_result.read(Cassandra.java:20970)
   at org.apache.cassandra.thrift.Cassandra$Client.recv_describe_keyspaces(Cassandra.java:1153)
   at org.apache.cassandra.thrift.Cassandra$Client.describe_keyspaces(Cassandra.java:1129)
   at org.apache.hadoop.hive.cassandra.CassandraProxyClient.initializeConnection(CassandraProxyClient.java:165)
   at org.apache.hadoop.hive.cassandra.CassandraProxyClient.<init>(CassandraProxyClient.java:103)
   at org.apache.hadoop.hive.cassandra.CassandraManager.openConnection(CassandraManager.java:88)
   at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:143)
   at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
   at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
   at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
   at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
   FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask
   11/08/19 13:32:05 ERROR ql.Driver: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask
   hive>

   Posted 1 year ago #
9. 

   koert
   Member

   i believe it is a thrift version issue. hive 0.7 that ships with cdh3u1 relies on thrift 0.5, while cassandra uses thrift 0.6. since they are not compatible (i think?) i cannot just replace thrift 0.5 with version 0.6, so i am stuck.

   i did try to swap both thrift and fb303, which resulted in:
   java.lang.NoClassDefFoundError: com/facebook/fb303/FacebookService$Iface

   Posted 1 year ago #

RSS feed for this topic