1. 

   Anonymous
   Unregistered

   Hadoop User Experience (HUE) is a nice GUI front-end for the Hadoop ecosystem, especially for DFS browsing and Hive:
   http://www.cloudera.com/blog/2010/07/whats-new-in-cdh3b2-hue/

   I attempted to install HUE on my Brisk cluster, but couldn't get it to work. It seems that HUE depends on some special modifications that Cloudera made to their Hadoop distro (CDH).

   Since Cloudera's distro (including HUE), is open source, is there any way (or plans to develop a way) to make a version on HUE + DataStax Enterprise that work together?

   Or any plans for an OpsCenter funtionality for similar tasks, such as running Hive Queries?

   I found an article online that claimed : "[VP of Product, Ben] Werther noted that the Cloudera Hue browser-based interface for Hadoop works with Brisk. http://www.infoq.com/news/2011/03/structure_big_data , so maybe HUE already works on Brisk/DSE with proper configuration, or worked in the past?

   Posted 1 year ago #
2. 

   Anonymous
   Unregistered

   I dug a little deeper into this issue...

   I installed HUE on one of my Brisk/DSE machines. With some config/classpath/jar fiddling, I got HUE to start up and launch the web interface.

   However, I can't interact with DSE/Hadoop through HUE.

   The blocker seems to be this:

   When Beeswax (The HUE Hive connector) starts up, it reports an error:

   Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/thrift/server/TThreadPoolServer$Options
           at com.cloudera.beeswax.Server.serveBeeswax(Server.java:190)
           at com.cloudera.beeswax.Server.main(Server.java:151)
           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
           at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
   Caused by: java.lang.ClassNotFoundException: org.apache.thrift.server.TThreadPoolServer$Options
           at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
           at java.security.AccessController.doPrivileged(Native Method)
           at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
           at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
           at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
           ... 7 more

   That missing class: org.apache.thrift.server.TThreadPoolServer$Options was defined in thrift 0.5 [1], but was removed for thrift 0.6 [2] (which is the version that ships with DSE). In fact, you can see that hue depends on libthrift 0.5 by inspecting the hue pom.xml [3]

   I filed an issue with the HUE project to ask about this.[4]

   References:

   [1] https://svn.apache.org/repos/asf/thrift/branches/0.5.x/lib/java/src/org/apache/thrift/server/TThreadPoolServer.java

   [2]
   https://svn.apache.org/repos/asf/thrift/branches/0.6.x/lib/java/src/org/apache/thrift/server/TThreadPoolServer.java

   [3] https://github.com/cloudera/hue/blob/master/maven/pom.xml

   [4]
   https://github.com/cloudera/hue/issues/6

   Posted 1 year ago #

RSS feed for this topic

Reply

You must log in to post.