http://www.datastax.com/support-forums/topic/exception-when-running-pig-mapreduce-job-written-in-java Software, Support, and Training for Apache Cassandra en-US Sun, 19 May 2013 15:10:50 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/exception-when-running-pig-mapreduce-job-written-in-java#post-1747 Mon, 23 Apr 2012 23:38:54 +0000 Anonymous 1747@http://www.datastax.com/support-forums/ <p>You need to run with using ./bin/dse script otherwise you won't have "dse.job.tracker" variable (and probably other important ones) set. </p> http://www.datastax.com/support-forums/topic/exception-when-running-pig-mapreduce-job-written-in-java#post-1654 Tue, 17 Apr 2012 16:39:54 +0000 Anonymous 1654@http://www.datastax.com/support-forums/ <p>From the command-line on one of the nodes in the cluster. This is the command I am running:</p> <p>java -cp .:./bin:/opt/datastax/dse-2.0-1/resources/hadoop/conf/:/opt/datastax/dse-2.0-1/resources/pig/pig-0.8.3.jar:/opt/datastax/dse-2.0-1/resources/pig/lib/*:/opt/datastax/dse-2.0-1/resources/hadoop/lib/*:/opt/datastax/dse-2.0-1/resources/hadoop/*:/opt/datastax/dse-2.0-1/resources/dse/lib/*:/opt/datastax/dse-2.0-1/lib/dse-2.0-1.jar:/opt/datastax/dse-2.0-1/resources/cassandra/lib/*:/opt/datastax/dse-2.0-1/resources/cassandra/conf/:/opt/datastax/dse-2.0-1/resources/dse/conf/ idmapreduce </p> http://www.datastax.com/support-forums/topic/exception-when-running-pig-mapreduce-job-written-in-java#post-1653 Tue, 17 Apr 2012 16:26:01 +0000 tjake 1653@http://www.datastax.com/support-forums/ <p>How are you running this job? </p> http://www.datastax.com/support-forums/topic/exception-when-running-pig-mapreduce-job-written-in-java#post-1652 Tue, 17 Apr 2012 16:24:36 +0000 Anonymous 1652@http://www.datastax.com/support-forums/ <p>I am trying to run an example Pig MapReduce job written in Java against a multi-node DataStax Enterprise cluster, but I am getting an exception. The example code I am using is found here, in the "Mapreduce Mode" section: <a href="http://pig.apache.org/docs/r0.9.1/cont.html" rel="nofollow">http://pig.apache.org/docs/r0.9.1/cont.html</a>.</p> <p>The exception I am getting is:</p> <p>org.apache.pig.PigException: ERROR 1002: Unable to store alias B<br /> at org.apache.pig.PigServer.storeEx(PigServer.java:889)<br /> at org.apache.pig.PigServer.store(PigServer.java:827)<br /> at org.apache.pig.PigServer.store(PigServer.java:795)<br /> at idmapreduce.runIdQuery(idmapreduce.java:16)<br /> at idmapreduce.main(idmapreduce.java:7)<br /> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2043: Unexpected error during execution.<br /> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:403)<br /> at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1209)<br /> at org.apache.pig.PigServer.storeEx(PigServer.java:885)<br /> ... 4 more<br /> Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: ${dse.job.tracker}:50020<br /> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:170)<br /> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:151)<br /> at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2567)<br /> at org.apache.hadoop.mapred.JobClient.init(JobClient.java:474)<br /> at org.apache.hadoop.mapred.JobClient.&lt;init&gt;(JobClient.java:457)<br /> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:122)<br /> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:378)<br /> ... 6 more</p> <p>I think the problem has to do with this line:</p> <p>Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: ${dse.job.tracker}:50020</p> <p>but I don't know what it means exactly. Are there some configurations I could be missing in the setup? </p>