http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working Software, Support, and Training for Apache Cassandra en-US Wed, 22 May 2013 02:54:48 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working#post-6902 Fri, 12 Oct 2012 14:30:01 +0000 tambalavanar 6902@http://www.datastax.com/support-forums/ <p>Thank you!<br /> Finally it worked.<br /> I missed file:/ in the URI.</p> <blockquote><p>Code Changes</p></blockquote> <p><code><br /> System.setProperty("cassandra.config", "file:/C:/Data/Java/EDS-CFS-Util/conf/cassandra.yaml");<br /> System.setProperty("dse.config", "file:/C:/Data/Java/EDS-CFS-Util/conf/dse.yaml");</p> <p>Configuration conf = new Configuration();<br /> conf.addResource(new Path(URI.create("file:/C:/Data/Java/EDS-CFS-Util/conf/core-site.xml")));<br /> </code> </p> http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working#post-6899 Fri, 12 Oct 2012 12:41:10 +0000 vsavkov 6899@http://www.datastax.com/support-forums/ <p>Adding paths to "conf/cassandra.yaml" and "conf/dse.yaml" to java -cp switch also works.<br /> If yaml files locations are /path/to/cassandra-conf/conf/cassandra.yaml and /path/to/dse-conf/conf/dse.yaml then</p> <p>$ java -cp &lt;existing paths&gt;:/path/to/cassandra-conf:/path/to/dse-conf </p> http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working#post-6896 Fri, 12 Oct 2012 10:43:40 +0000 Piotr Kołaczkowski 6896@http://www.datastax.com/support-forums/ <p>You need to specify URL to the file:</p> <pre><code>System.setProperty(&quot;cassandra.config&quot;, &quot;file:/absolute/path/conf/cassandra.yaml&quot;); System.setProperty(&quot;dse.config&quot;, &quot;file:/absolute/path/conf/dse.yaml&quot;);</code></pre> <p>After changing to absolute paths, your code works for me. </p> http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working#post-6878 Thu, 11 Oct 2012 19:16:57 +0000 tambalavanar 6878@http://www.datastax.com/support-forums/ <p>The below error gets display in the console while running "<code>o = cfs.create(new Path("/folder/testfile.txt"), true);</code>"</p> <p><code><br /> Cannot locate conf/cassandra.yaml<br /> Fatal configuration error; unable to start server. See log for stacktrace.<br /> </code> </p> http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working#post-6874 Thu, 11 Oct 2012 16:41:36 +0000 Piotr Kołaczkowski 6874@http://www.datastax.com/support-forums/ <p>The approach is correct. Currently connecting to CFS from remote machines is not officially supported, but generally copying the config files and appropriate jars should work.</p> <p>Where do you get that "unable to start server" error from? </p> http://www.datastax.com/support-forums/topic/java-code-to-perform-cfs-file-operations-from-remote-system-is-not-working#post-6851 Wed, 10 Oct 2012 19:03:34 +0000 tambalavanar 6851@http://www.datastax.com/support-forums/ <p>I'm writing a java program to read &amp; write files to CFS from a remote system (non DSE machine). As suggested in the <a href="http://www.datastax.com/dev/blog/new-in-datastax-enterprise-2-0-support-for-appending-files-in-cassandra-file-system">DataStax Site</a>, I wrote the following piece of code.</p> <p><code><br /> import java.net.URI;<br /> import org.apache.hadoop.conf.Configuration;<br /> import org.apache.hadoop.fs.*;<br /> import org.apache.hadoop.security.UserGroupInformation;</p> <p>import com.datastax.bdp.hadoop.cfs.CassandraFileSystem;</p> <p>public class CassandraFileHelper {</p> <p> public static void main(String[] args) throws Exception {</p> <p> FSDataOutputStream o = null;<br /> CassandraFileSystem cfs = null;<br /> String content = "some text content..";</p> <p> try {<br /> System.setProperty("cassandra.config", "conf/cassandra.yaml");<br /> System.setProperty("dse.config", "conf/dse.yaml");</p> <p> Configuration conf = new Configuration();<br /> conf.addResource(new Path("conf/core-site.xml"));</p> <p> UserGroupInformation.createUserForTesting("unixuserid", new String[] { "usergroupname" });<br /> UserGroupInformation.setConfiguration(conf);</p> <p> cfs = new CassandraFileSystem();<br /> cfs.initialize(URI.create("cfs://hostname:9160/"), conf);</p> <p> o = cfs.create(new Path("/folder/testfile.txt"), true);<br /> o.write(content.getBytes());<br /> o.flush();</p> <p> } catch (Exception err) {<br /> System.out.println("Error: " + err.toString());<br /> } finally {<br /> if (o != null)<br /> o.close();<br /> if (cfs != null)<br /> cfs.close();<br /> }<br /> }<br /> }<br /> </code><br /> <br /> I've included the listed configuration files and jar from DSE package.</p> <ul> <li>cassandra.yaml </li> <li>core-site.xml </li> <li>dse.yaml </li> </ul> <ul> <li>cassandra-all-1.0.10.jar </li> <li>cassandra-clientutil-1.0.10.jar </li> <li>cassandra-thrift-1.0.10.jar </li> <li>commons-cli-1.1.jar </li> <li>commons-codec-1.2.jar </li> <li>commons-configuration-1.6.jar </li> <li>commons-lang-2.4.jar </li> <li>commons-logging-1.1.1.jar </li> <li>compress-lzf-0.8.4.jar </li> <li>dse.jar </li> <li>guava-r08.jar </li> <li>hadoop-core-1.0.2-dse-20120707.200359-5.jar </li> <li>libthrift-0.6.1.jar </li> <li>log4j-1.2.16.jar </li> <li>slf4j-api-1.6.1.jar </li> <li>snakeyaml-1.6.jar </li> <li>snappy-java-1.0.4.1.jar </li> <li>speed4j-0.9.jar </li> </ul> <p> When I run the program, I get the following error<br /> <code><br /> org.apache.thrift.TApplicationException: Internal error processing batch_mutate<br /> </code><br /> </p> <p>I copied all the config files from a DSE machine and when I added them I get the following error.<br /> <code><br /> Cannot locate conf/cassandra.yaml<br /> Fatal configuration error; unable to start server. See log for stacktrace.<br /> </code><br /> </p> <p>Could anyone please validate my approach and let me know whether this is possible?<br /> Thanks. </p>