http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector Software, Support, and Training for Apache Cassandra en-US Tue, 21 May 2013 22:45:37 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3739 Wed, 25 Jul 2012 15:07:54 +0000 datastaxtesting 3739@http://www.datastax.com/support-forums/ <p>Thanks xedin!! </p> http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3709 Wed, 25 Jul 2012 09:12:56 +0000 xedin 3709@http://www.datastax.com/support-forums/ <p>The idea is, in your while loop instead of pushing data to the C* you can just write it down to the CLI compatible file where every line would be "set &lt;cf&gt;..." instead of doing that manually. </p> http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3653 Wed, 25 Jul 2012 01:13:17 +0000 datastaxtesting 3653@http://www.datastax.com/support-forums/ <p>I have to put this command "set &lt;cf&gt;[&lt;key&gt;][&lt;column&gt;] = 'value';" 1 million times right?? I wrote the script for injecting data using set but using set 1 million times I am finding difficult. Is there any alternate way to parse csv inside script?? </p> http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3643 Tue, 24 Jul 2012 20:49:19 +0000 xedin 3643@http://www.datastax.com/support-forums/ <p>If you ask me if that is difficult, then I would have to tell no, it's not. Because you can check the file selectively and after you have loaded it into cassandra using CLI you can use 'count' command to check the number of inserted rows and do a selective "get" by key to check if all required columns are present. There is no need to check whole dataset by hand, at the last step you can modify your script to parse csv file and do get operations from C*, validate returned values to make sure that all of the data is there. </p> http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3642 Tue, 24 Jul 2012 20:43:34 +0000 datastaxtesting 3642@http://www.datastax.com/support-forums/ <p>i have 1 million data....using set for 1 million data is very difficult?? </p> http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3640 Tue, 24 Jul 2012 20:11:45 +0000 xedin 3640@http://www.datastax.com/support-forums/ <p>I suggest you instead of sending it to the cassandra directly, first write spitted data to the CLI compatible file which would contain commands like "set &lt;cf&gt;[&lt;key&gt;][&lt;column&gt;] = 'value';" and see if file has all the data you want, after that you can insert it into C* using ./bin/cassandra-cli --host &lt;ip&gt; --keyspace &lt;your-ks&gt; &lt; &lt;file-with-cli-formatted-data&gt; and check if C* then would have all of your data using 'list' command. </p> http://www.datastax.com/support-forums/topic/loading-data-into-cassandra-database-using-hector#post-3637 Tue, 24 Jul 2012 19:41:57 +0000 datastaxtesting 3637@http://www.datastax.com/support-forums/ <p>I am trying to load csv file: Its working perfectly fine but I cannot see the full data:</p> <p>// Read File<br /> String fileLocation = "/usr/local/tomcat/webapps/analytics-project/docs/examples/OSHA-data/Mapping_sheet_long.csv";<br /> BufferedReader reader;<br /> reader = new BufferedReader(new InputStreamReader(new FileInputStream(fileLocation)));<br /> List&lt;String[]&gt; rows = new ArrayList&lt;String[]&gt;();<br /> String line = null;<br /> int numRows = 0;<br /> while((line = reader.readLine()) != null){<br /> numRows = numRows + 1;<br /> rows.add(line.split(",", -1));<br /> }</p> <p> // Insert rows<br /> StringSerializer stringSerializer = StringSerializer.get();<br /> int count = 0;<br /> int len = numRows;<br /> while(len-- &gt; 0){<br /> String key = rows.get(count)[0];<br /> System.out.println(key);<br /> Mutator&lt;String&gt; mutator = HFactory.createMutator(myKeyspace, stringSerializer);<br /> mutator.addInsertion(key, "oshachemicals", HFactory.createStringColumn("chemical_name", rows.get(count)[1]));<br /> mutator.addInsertion(key, "oshachemicals", HFactory.createStringColumn("chemical_code", rows.get(count)[2]));<br /> MutationResult mr = mutator.execute();<br /> count = count + 1;<br /> }</p> <p>Dataset is like:<br /> 11111111, lead, 213<br /> 11111112, chromium, P213 ....</p> <p>I can see few datas using list command but not all data is available </p>