CFS is not accessable

(2 posts) (2 voices)

• Started 5 months ago by cloneman
• Latest reply from khahn
• This topic is not a support question

Tags:

No tags yet.

1. 

   cloneman
   Member

   I think that I might miss some configuration.

   when I tried to run hadoop fs on top of CFS, got the following error:
   >dse hadoop fs -ls /
   Exception in thread "main" java.lang.NullPointerException
   at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.initConsistencyLevels(CassandraFileSystemThriftStore.java:263)
   at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.initialize(CassandraFileSystemThriftStore.java:202)
   at com.datastax.bdp.hadoop.cfs.CassandraFileSystem.initialize(CassandraFileSystem.java:67)
   at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
   at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
   at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
   at org.apache.hadoop.fs.FsShell.init(FsShell.java:82)
   at org.apache.hadoop.fs.FsShell.run(FsShell.java:1745)
   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
   at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895)

   In addition to the regular multi-nodes DataStax Enterprise installation (my cassandra works well), I only changed core-site.xml under $DSE_HOME/resources/hadoop/conf, as following,
   <property>
   <name>fs.default.name</name>
   <value>cfs://9.21.55.151:9160/</value>
   </property>

   What I installed is dse-2.2.1 using a tar ball.

   any idea about the error?

   Posted 5 months ago #
2. 

   khahn
   Member

   Are you trying to connect to an external address? If so, and you don't mind experimenting, try this:

   In the core-site.xml file, change the property fs.default.name from file:/// to cfs:<listen_address>:<rpc_port>.

   This eliminates the need to specify the IP address or hostname for MapReduce jobs and all other calls to Hadoop.

   For more information, see http://www.datastax.com/docs/datastax_enterprise2.2/solutions/about_hadoop#connecting-to-external-addresses.

   To create a new Cassandra File System (CassandraFS), try this:

   <property>
            <name>fs.cfs-<filesystem name>.impl</name>
            <value>com.datastax.bdp.hadoop.cfs.CassandraFileSystem</value>
          </property>

   For more information see http://www.datastax.com/docs/datastax_enterprise2.2/solutions/hadoop_multiple_cfs.

   Posted 4 months ago #

RSS feed for this topic

Reply

You must log in to post.