http://www.datastax.com/support-forums/topic/suggestions-for-moving-har-files-in-hdfs-to-cfs Software, Support, and Training for Apache Cassandra en-US Fri, 24 May 2013 11:02:02 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/suggestions-for-moving-har-files-in-hdfs-to-cfs#post-119 Thu, 26 May 2011 01:04:29 +0000 matt 119@http://www.datastax.com/support-forums/ <p>OK, my solution for this is to first copy the .har files to CFS using hftp from the source cluster. Then I do a $BRISK_HOME/bin/brisk hadoop cp 'har://cfs-brisk000:9160/stuff/my.har/*' /user/cassandra/exploded_har</p> <p>Now I have all of the files from the .har in /user/cassandra/exploded_har and can delete the source .har. This is going to result in one hell of a compaction, but at least I can plan for it.</p> <p>I suspect that if I had first upgraded the source cluster to hadoop 20.203, I'd have been able to do a regular "har://hdfs-" style distcp from the source cluster. </p> http://www.datastax.com/support-forums/topic/suggestions-for-moving-har-files-in-hdfs-to-cfs#post-105 Wed, 25 May 2011 13:47:50 +0000 tjake 105@http://www.datastax.com/support-forums/ <p>Hmm I don't really know... You can try asking on #datastax-brisk on freenode irc </p> http://www.datastax.com/support-forums/topic/suggestions-for-moving-har-files-in-hdfs-to-cfs#post-94 Mon, 23 May 2011 22:21:17 +0000 matt 94@http://www.datastax.com/support-forums/ <p>Please pardon the cross-post with the google group, but I could really use a suggestion or two on this problem.</p> <p>I have data in .har files on a CDH2 Hadoop cluster. I'd like to transfer the contents of the .har archive into CFS. It appears as though hftp doesn't have the ability to read .har files. As far as I can tell that means I have to copy them to local storage, and then upload them. Does anybody have any ideas for how to make this work using distcp? distcp works great with hftp to copy non-.har files, but the .har files are a no-go.</p> <p>Thanks,<br /> Matt </p>