start up trouble on analytics

(7 posts) (2 voices)

• Started 2 months ago by bezgoan
• Latest reply from bezgoan
• This topic is resolved

Tags:

No tags yet.

1. 

   bezgoan
   Member

   Few questions troubling me at moment with setup of Datastax Enterprise 2.2.2 are
   Have started dse as service in Analytic mode. Below is the screen read.

   bezgoan@bezgoan-E6221:~$ sudo service dse status
   xss = -ea -javaagent:/usr/share/dse/cassandra/lib/jamm-0.2.5.jar -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -Xms1024M -Xmx1024M -Xmn256M -XX:+HeapDumpOnOutOfMemoryError -Xss180k
   * DSE daemon is running
   bezgoan@bezgoan-E6221:~$ nodetool ring -h localhost
   Note: Ownership information does not include topology, please specify a keyspace.
   Address DC Rack Status State Load Owns Token
   127.0.0.1 Analytics rack1 Up Normal 107.95 KB 100.00% 86135169699852918591630819044025820615

   a) Question is this analytic doesn't show up on opscenter screen.
   b) dont have any files in /etc/dse/hadoop. I have purposefully deleted all. Now which is the default distributed file system port ? What would be the DFS folder structure ?

   c) Is DFS using cassandraFS / HDFS ?
   d) how can I make sure hadoop analytic node is up and running, ready for running a MR program.

   TIA
   Shashank.

   Posted 2 months ago #
2. 

   alexliu
   Member

   a) You may need check your opscenter setup. If the nodetool shows the node, opscenter should show it as well.

   b)Default distributed file system is CassandraFS which is stored in C*, which should be found in /var/lib/cassandra/data or similar folder. check this link http://www.datastax.com/docs/datastax_enterprise2.2/solutions/about_hadoop#connecting-to-external-addresses

   c)CassandraFS

   d) follow the demo, e.g. http://www.datastax.com/docs/datastax_enterprise2.2/solutions/about_hive#hive-demo

   Posted 2 months ago #
3. 

   bezgoan
   Member

   Thanks Alexliu.
   finally able to setup the environment post 3.0 upgrade.

   Now have another problem:
   The reducer seems to be not working on Portfolio Manager demo that is bundled with the 3.0 package. The reducer doesn't work even with a custom MR job, but I was under assumption that it is due to FileSystem used in custom MR job.

   2013-03-08 20:08:56,793 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 346.86 sec

   statement keeps repeating for more than an hour now, same is the status shown in jobTracker.

   Appreciate any help.

   TIA
   Shashank.

   Posted 2 months ago #
4. 

   bezgoan
   Member

   Now get the same HIVE example at HIVE examples

   to load data into insert is also stuck at reduce job :-(.

   any advice appreciated.

   TIA
   Shashank.

   Posted 2 months ago #
5. 

   bezgoan
   Member

   Editing my comments:

   Now reduce is stuck even for HIVE examples.
   Was trying to LOADDATA INTO invities example, which is stuck at reduce job.

   any advice appreciated
   TIA
   Shashank.

   Posted 2 months ago #
6. 

   alexliu
   Member

   Can you post the hadoop logs and Cassandra system logs, so we can debug it. Reducer moves data among the nodes, so we need check whether there is any issue with the node communication.

   Posted 2 months ago #
7. 

   bezgoan
   Member

   hi alexliu,

   got this resolved after configuring ssh.
   Can you please help on other thread I started.
   http://www.datastax.com/support-forums/topic/error-while-trying-to-insert-records-into-cassandra-using-mapreduce-program

   Appreciate your response.

   Thanks
   Shashank.

   Posted 1 month ago #

RSS feed for this topic

Reply

You must log in to post.