for some projects brisk is not an option and i use cloudera's cdh distro. however i would still like to use cassandra. is there an easy way to get cassandra connected to my hive in cdh? is the CassandraStorageHandler somehow available as a separate project that i can compile and add to my hive?
thanks! koert
using cassandra with cdh hadoop
(9 posts) (2 voices)-
Posted 1 year ago #
-
Yes you can. Take a look at https://github.com/riptano/hive/wiki/Cassandra-Handler-usage-in-Hive-0.7-with-Cassandra-0.7
Posted 1 year ago # -
thanks for that. it makes sense. however i am not running cassandra 7 but the cassandra that came with the latest brisk (apache-cassandra-0.8.1-brisk1-beta2.jar). does this mean i am out of luck?
Posted 1 year ago # -
It should still work just modify the classpath to use the hive driver and cassandra that you have from beta2
Posted 1 year ago # -
i tried the following:
hive> set hive.aux.jars.path;
hive.aux.jars.path=file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u1.jar,file:///usr/lib/hbase/hbase-0.90.3-cdh3u1.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar,file:///usr/share/brisk/cassandra/lib/guava-r08.jar,file:///usr/share/brisk/cassandra/lib/commons-lang-2.4.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jarhive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler';
java.lang.NoClassDefFoundError: org/apache/cassandra/thrift/NotFoundException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.hive.ql.metadata.HiveUtils.getStorageHandler(HiveUtils.java:144)
at org.apache.hadoop.hive.ql.metadata.Table.getStorageHandler(Table.java:268)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3027)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Caused by: java.lang.ClassNotFoundException: org.apache.cassandra.thrift.NotFoundException
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 19 more
FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTaskPosted 1 year ago # -
Try replacing file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar with the jar from usr/share/brisk/hive/lib
Posted 1 year ago # -
another try with different jars got me farther:
hive> set hive.aux.jars.path;
hive.aux.jars.path=file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar,file:///usr/share/java/hive-cassandra-handler-0.7.0-beta1.jar
hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2");
11/08/19 11:20:26 DEBUG parse.VariableSubstitution: Substitution is on: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
11/08/19 11:20:26 INFO parse.ParseDriver: Parsing command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
11/08/19 11:20:26 INFO parse.ParseDriver: Parse Completed
11/08/19 11:20:26 INFO parse.SemanticAnalyzer: Starting Semantic Analysis
11/08/19 11:20:26 INFO parse.SemanticAnalyzer: Creating table cass_test position=22
11/08/19 11:20:26 INFO ql.Driver: Semantic Analysis Completed
11/08/19 11:20:26 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
11/08/19 11:20:26 INFO ql.Driver: Starting command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
11/08/19 11:20:26 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.cassandra.serde.StandardColumnSerDe for table cass_test
11/08/19 11:20:26 INFO hive.log: DDL: struct cass_test { string row_key, string col1, string col2}
11/08/19 11:20:26 DEBUG serde.StandardColumnSerDe: CassandraSerDe initialized with : columnNames = row_key,col1,col2 columnTypes = string,string,string cassandraColumnMapping = [:key, col1, col2]
11/08/19 11:20:26 DEBUG cassandra.CassandraManager: open connection to host:port - 192.168.1.51:9160
11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: Use randomized connection for 192.168.1.51:9160
11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: socke is opened: false trans is opened: false
11/08/19 11:20:26 DEBUG cassandra.CassandraClientHolder: Transport is open true
11/08/19 11:20:26 DEBUG cassandra.CassandraProxyClient: Connected to cassandra at 192.168.1.51:9160
11/08/19 11:20:26 DEBUG cassandra.CassandraManager: close connection to host:port - 192.168.1.51:9160
FAILED: Error in metadata: java.lang.NullPointerException
11/08/19 11:20:26 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.NullPointerException
org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:476)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.cassandra.CassandraManager.closeConnection(CassandraManager.java:110)
at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:146)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
... 15 more11/08/19 11:20:26 DEBUG exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:476)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.cassandra.CassandraManager.closeConnection(CassandraManager.java:110)
at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:146)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
... 15 moreFAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
11/08/19 11:20:26 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
hive>Posted 1 year ago # -
i replaced file:///usr/lib/hive/lib/hive-cassandra-handler-0.7.0-beta1.jar with file://usr/share/brisk/hive/lib/hive-cassandra-handler-0.7.0-brisk1-beta2.jar
What i am worried about is that this version of the CassandraStorageHandler will try to use the cassandra metastore for hive, instead of the mysql metastore that we use...
Results:
hive> set hive.aux.jars.path;
hive.aux.jars.path=file:///usr/share/brisk/cassandra/lib/apache-cassandra-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/cassandra/lib/apache-cassandra-thrift-0.8.1-brisk1-beta2.jar,file:///usr/share/brisk/hive/lib/hive-cassandra-handler-0.7.0-brisk1-beta2.jar
hive> create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2");
11/08/19 13:32:03 DEBUG parse.VariableSubstitution: Substitution is on: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
11/08/19 13:32:03 INFO parse.ParseDriver: Parsing command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
11/08/19 13:32:03 INFO parse.ParseDriver: Parse Completed
11/08/19 13:32:03 INFO parse.SemanticAnalyzer: Starting Semantic Analysis
11/08/19 13:32:03 INFO parse.SemanticAnalyzer: Creating table cass_test position=22
11/08/19 13:32:03 INFO ql.Driver: Semantic Analysis Completed
11/08/19 13:32:03 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
11/08/19 13:32:03 INFO ql.Driver: Starting command: create external table cass_test(row_key string, col1 string, col2 string) stored by 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler' with SERDEPROPERTIES("cassandra.host"="192.168.1.51","cassandra.port"="9160","cassandra.ks.name"="test","cassandra.ks.repfactor"="2")
11/08/19 13:32:03 INFO exec.DDLTask: Use StorageHandler-supplied org.apache.hadoop.hive.cassandra.serde.StandardColumnSerDe for table cass_test
11/08/19 13:32:03 INFO hive.log: DDL: struct cass_test { string row_key, string col1, string col2}
11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: table column string: row_key,col1,col2
11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: Auto-created mapping string: :key,col1,col2
11/08/19 13:32:03 DEBUG serde.StandardColumnSerDe: CassandraSerDe initialized with : columnNames = row_key,col1,col2 columnTypes = string,string,string cassandraColumnMapping = [:key, col1, col2]
11/08/19 13:32:03 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.cache.level2.type value null from jpox.properties with SOFT
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:mysql://node01/metastore
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with checked
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateConstraints value null from jpox.properties with false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.autoCreateSchema value null from jpox.properties with false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.cache.level2 value null from jpox.properties with false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with hive
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.connectionPoolingType value null from jpox.properties with DBCP
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.fixedDatastore value null from jpox.properties with true
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with com.mysql.jdbc.Driver
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateColumns value null from jpox.properties with false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.validateTables value null from jpox.properties with false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.jdo.JDOPersistenceManagerFactory
11/08/19 13:32:03 DEBUG metastore.ObjectStore: Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.autoStartMechanismMode = checked
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.identifierFactory = datanucleus
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.transactionIsolation = read-committed
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateTables = false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionURL = jdbc:mysql://node01/metastore
11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.DetachAllOnCommit = true
11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.NonTransactionalRead = true
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.fixedDatastore = true
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateConstraints = false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionDriverName = com.mysql.jdbc.Driver
11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.option.ConnectionUserName = hive
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.validateColumns = false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.cache.level2 = false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.plugin.pluginRegistryBundleCheck = LOG
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.cache.level2.type = SOFT
11/08/19 13:32:03 DEBUG metastore.ObjectStore: javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.jdo.JDOPersistenceManagerFactory
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.autoCreateSchema = false
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.storeManagerType = rdbms
11/08/19 13:32:03 DEBUG metastore.ObjectStore: datanucleus.connectionPoolingType = DBCP
11/08/19 13:32:03 INFO metastore.ObjectStore: ObjectStore, initialize called
11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved.
11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved.
11/08/19 13:32:04 ERROR DataNucleus.Plugin: Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved.
11/08/19 13:32:04 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
11/08/19 13:32:04 INFO metastore.ObjectStore: Initialized ObjectStore
11/08/19 13:32:05 DEBUG cassandra.CassandraProxyClient: Connected to cassandra at 192.168.1.51:9160
java.lang.NoSuchMethodError: org.apache.thrift.meta_data.FieldValueMetaData.<init>(BZ)V
at org.apache.cassandra.thrift.CfDef.<clinit>(CfDef.java:299)
at org.apache.cassandra.thrift.KsDef.read(KsDef.java:753)
at org.apache.cassandra.thrift.Cassandra$describe_keyspaces_result.read(Cassandra.java:20970)
at org.apache.cassandra.thrift.Cassandra$Client.recv_describe_keyspaces(Cassandra.java:1153)
at org.apache.cassandra.thrift.Cassandra$Client.describe_keyspaces(Cassandra.java:1129)
at org.apache.hadoop.hive.cassandra.CassandraProxyClient.initializeConnection(CassandraProxyClient.java:165)
at org.apache.hadoop.hive.cassandra.CassandraProxyClient.<init>(CassandraProxyClient.java:103)
at org.apache.hadoop.hive.cassandra.CassandraManager.openConnection(CassandraManager.java:88)
at org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:143)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:344)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:470)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:513)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask
11/08/19 13:32:05 ERROR ql.Driver: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask
hive>Posted 1 year ago # -
i believe it is a thrift version issue. hive 0.7 that ships with cdh3u1 relies on thrift 0.5, while cassandra uses thrift 0.6. since they are not compatible (i think?) i cannot just replace thrift 0.5 with version 0.6, so i am stuck.
i did try to swap both thrift and fb303, which resulted in:
java.lang.NoClassDefFoundError: com/facebook/fb303/FacebookService$IfacePosted 1 year ago #
