http://www.datastax.com/support-forums/topic/jobtracker-problems-in-dse-21-running-on-debian-servers-in-aws Software, Support, and Training for Apache Cassandra en-US Thu, 23 May 2013 03:55:10 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/jobtracker-problems-in-dse-21-running-on-debian-servers-in-aws#post-6873 Thu, 11 Oct 2012 16:33:49 +0000 rk 6873@http://www.datastax.com/support-forums/ <p>I finally figured it out. The ip addresses in the cassandra.yaml should be the AWS local ip addresses, and not the external ips, as I was using. Once I made this switch, it resolved my JobTracker problems. </p> http://www.datastax.com/support-forums/topic/jobtracker-problems-in-dse-21-running-on-debian-servers-in-aws#post-6872 Thu, 11 Oct 2012 15:50:52 +0000 rk 6872@http://www.datastax.com/support-forums/ <p>the output of dsetool ring is as shown below:</p> <p>10.242.159.111 Cassandra rack1 Cassandra Up Normal 40.23 MB 25.00% 0<br /> 10.204.11.168 Analytics rack1 Analytics(tt) Up Normal 25.28 MB 25.00% 42535295865117307932921825928971026432<br /> 10.76.174.178 Solr rack1 Search Up Normal 41.34 MB 25.00% 85070591730234615865843651857942052864<br /> 10.194.82.63 Analytics rack1 Analytics(tt) Up Normal 22.85 MB 25.00% 127605887595351923798765477786913079296</p> <p>It is showing the AWS local ips for each of the nodes. I have been using the external IPs for these nodes in Cassandra.yaml and setting up the jobtracker ips.</p> <p>Here is the output of the dsetool listjt command:</p> <p>DC JobTracker<br /> -- --<br /> Analytics-Analytics 50.17.205.200<br /> ------<br /> Reserve-JT = 50.17.205.214 </p> http://www.datastax.com/support-forums/topic/jobtracker-problems-in-dse-21-running-on-debian-servers-in-aws#post-6867 Thu, 11 Oct 2012 14:41:34 +0000 Piotr Kołaczkowski 6867@http://www.datastax.com/support-forums/ <p>Are all nodes up? What is the output of dsetool ring? </p> http://www.datastax.com/support-forums/topic/jobtracker-problems-in-dse-21-running-on-debian-servers-in-aws#post-6856 Thu, 11 Oct 2012 00:55:32 +0000 rk 6856@http://www.datastax.com/support-forums/ <p>I have a 4 node cluster out of which 2 are Hadoop (analytics) nodes. While trying the Portfolio demo, it fails at the hive execution with the following exception:</p> <p>java.net.ConnectException: Call to 50.17.205.200/50.17.205.200:8012 failed on connection exception: java.net.ConnectException: Connection refused<br /> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095)<br /> at org.apache.hadoop.ipc.Client.call(Client.java:1071)<br /> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)<br /> at org.apache.hadoop.mapred.$Proxy10.getProtocolVersion(Unknown Source)<br /> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)<br /> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)<br /> at org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:480)<br /> at org.apache.hadoop.mapred.JobClient.init(JobClient.java:474)<br /> at org.apache.hadoop.mapred.JobClient.&lt;init&gt;(JobClient.java:457)<br /> at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:435)<br /> at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)<br /> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)<br /> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)<br /> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)<br /> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)<br /> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)<br /> at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)<br /> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)<br /> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)<br /> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:338)<br /> at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:436)<br /> at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:446)<br /> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:642)<br /> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)<br /> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<br /> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)<br /> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)<br /> at java.lang.reflect.Method.invoke(Method.java:597)<br /> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)<br /> Caused by: java.net.ConnectException: Connection refused<br /> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)<br /> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)<br /> at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)<br /> at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:489)<br /> at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434)<br /> at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)<br /> at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)<br /> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202)<br /> at org.apache.hadoop.ipc.Client.call(Client.java:1046)<br /> ... 27 more<br /> Job Submission failed with exception 'java.net.ConnectException(Call to 50.17.205.200/50.17.205.200:8012 failed on connection exception: java.net.ConnectException: Connection refused)'<br /> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask</p> <p>I also tried to access the JobTracker site using the url <a href="http://50.17.205.200:50030/jobtracker.jsp" rel="nofollow">http://50.17.205.200:50030/jobtracker.jsp</a> with no success</p> <p>I have checked the jobtracker ip by running the dsetool jobtracker command, and it returns 50.17.205.200. I also made this ip as the first seed node in the cassandra.yaml</p> <p>I am running the following hive command:</p> <p>dse hive -f /usr/share/dse-demos/portfolio_manager/10_day_loss.q</p> <p>any ideas???? </p>