Error Running Pig

(7 posts) (3 voices)

• Started 10 months ago by adang
• Latest reply from adang
• This topic is not resolved

Tags:

• nick@datastax.com

1. 

   adang
   Member

   I'm trying to setup and run simple pig scripts on the Cassandra data that I have. I referred to http://www.datastax.com/docs/datastax_enterprise2.1/analytics/about_pig#run-pig-mr this page; however, I'm getting a strange error that I couldn't find much documentation about.

   grunt> test = LOAD 'cassandra://<one of my keyspaces>/<my column family>' USING CassandraStorage();

   What I end up receiving is this:

   
2012-07-13 10:50:00,760 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 6007: Unable to check name cfs:/user/root
Details at logfile: /root/datastax/dse-2.1/pig_1342201428643.log


   I also looked at the log file that it specified, and I receive this:

   
================================================================================
Pig Stack Trace
---------------
ERROR 6007: Unable to check name cfs:/user/root

   java.lang.Error: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name cfs:/user/root
   at org.apache.pig.impl.logicalLayer.parser.QueryParser.LoadClause(QueryParser.java:1630)
   at org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:1366)
   at org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:1013)
   at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:800)
   at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuildg Stack Trace
   ---------------
   ERROR 6007: Unable to check name cfs:/user/root

   java.lang.Error: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name cfs:/user/root
at org.apache.pig.impl.logicalLayer.parser.QueryParser.LoadClause(QueryParser.java:1630)
at org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:1366)
at org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:1013)
at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:800)
at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:63)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1612)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1562)
at org.apache.pig.PigServer.registerQuery(PigServer.java:534)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:871)
at org.apache.pig.Ser.java:63)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1612)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1562)
at org.apache.pig.PigServer.registerQuery(PigServer.java:534)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:871)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:388)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:168)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:76)
at org.apache.pig.Main.run(Main.java:455)
at org.apache.pig.Main.main(Main.java:107)
Caused by: org.apache.pig.backend.datastorage.DataStorageException: ERROR 6007: Unable to check name cfs:/user/root
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:210)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:131)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.asElement(HDataStorage.java:141)
at org.apache.pig.impl.logicalLayer.parser.QueryParser.getCurrentDir(QueryParser.java:175)
at org.apache.pig.impl.logicalLayer.parser.QueryParser.LoadClause(QueryParser.java:1615)
... 14 more
Caused by: java.io.IOException: UnavailableException()
at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.readSlice(CassandraFileSystemThriftStore.java:688)
at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.readINodeColumns(CassandraFileSystemThriftStore.java:619)
at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.retrieveINode(CassandraFileSystemThriftStore.java:571)
at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.retrieveINode(CassandraFileSystemThriftStore.java:563)
at com.datastax.bdp.hadoop.cfs.CassandraFileSystem.getFileStatus(CassandraFileSystem.java:520)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:768)
at org.apache.pig.backend.hadoop.datastorage.HDataStorage.isContainer(HDataStorage.java:203)
... 18 more
Caused by: UnavailableException()
at org.apache.cassandra.thrift.Cassandra$get_slice_result.read(Cassandra.java:7764)
at org.apache.cassandra.thrift.Cassandra$Client.recv_get_slice(Cassandra.java:570)
at org.apache.cassandra.thrift.Cassandra$Client.get_slice(Cassandra.java:542)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at com.datastax.bdp.util.CassandraProxyClient.invoke(CassandraProxyClient.java:407)
at $Proxy1.get_slice(Unknown Source)


   I checked that my column family and keyspace existed with the list command in this cli, so I'm not exactly sure what the issue is here.

   If anyone could provide help, it'd be much appreciated.

   Posted 10 months ago #
2. 

   thobbs
   Administrator

   The UnavailableException that's the original cause means that not enough nodes are up to satisfy the consistency level. Check nodetool ring on each your nodes to make sure they're all up.

   Posted 10 months ago #
3. 

   adang
   Member

   They are all up. We only have 3 nodes, though (1 single cassandra node cluster, 2 analytics nodes). Is that going to be an issue?

   Posted 10 months ago #
4. 

   nickmbailey
   Key Master

   If all of your nodes are up and you are getting an UnavailableExeption, that would indicate your replication settings are misconfigured, and it is impossible for Cassandra to satisfy them.

   What are the replication settings for the keyspace you are using.

   Posted 10 months ago #
5. 

   adang
   Member

   I'm using a NetworkTopologyStrategy with a replication factor of 2 for the analytics nodes and 1 for the single cassandra node.

   Posted 10 months ago #
6. 

   nickmbailey
   Key Master

   What is the actual strategy options you used though? And what are your DC names? My guess is that there is a slight mismatch between your strategy options and your datacenter names which would cause this.

   Posted 10 months ago #
7. 

   adang
   Member

   Hm. I actually reconfigured my cluster and everything and the LOAD seems to work now; however, when I try to dump the pig relation I store it in, I end up getting:

   ERROR 1000: Error during parsing. Encountered " <IDENTIFIER> "PuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY "" at line 3, column 1.

   This occurs after a decent amount of data was being read out. I'm not sure if that has to do with the data that I'm dealing with or if this is a Pig thing.

   Posted 10 months ago #

RSS feed for this topic

Reply

You must log in to post.