http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader Software, Support, and Training for Apache Cassandra en-US Fri, 24 May 2013 21:19:19 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-8882 Sat, 02 Feb 2013 23:59:11 +0000 chandu 8882@http://www.datastax.com/support-forums/ <p>Hello Group,</p> <p>I am using bulkoutputformat to load from HadoopToCassandra. We changed configuration like rpc port to 9161 &amp; storage port to 7002.<br /> How to i pass storage port number from Hadoop Driver.</p> <p>thanks<br /> chandu </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2825 Mon, 09 Jul 2012 14:47:32 +0000 kannanspec 2825@http://www.datastax.com/support-forums/ <p>hi,</p> <p>I cleaned up the data directories /var/lib/cassandra/data and restarted the cassandra and now i am able to load the csv using nodetool refresh. </p> <p>Thanks for you help. I am trying to load from different machine now. </p> <p>Thanks<br /> Kannan. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2759 Fri, 06 Jul 2012 18:53:37 +0000 kannanspec 2759@http://www.datastax.com/support-forums/ <p>Hi, How can i start cassandra in debug mode?</p> <p>I opened the data.db file i see the data, i created sstable only for 3 rows that is why it is 653 byte.</p> <p>thanks<br /> kannan. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2757 Fri, 06 Jul 2012 17:06:08 +0000 xedin 2757@http://www.datastax.com/support-forums/ <p>You can run Cassandra in DEBUG node and see if it actually did the loading or it's possible that there is no data in your SSTable (size of data component is only 652 bytes). </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2754 Fri, 06 Jul 2012 16:13:17 +0000 kannanspec 2754@http://www.datastax.com/support-forums/ <p>Hi, I placed it in correct place and refreshed it. It did not throw any error but i dont see the data in the column family.</p> <p>[cassandra@LNX-XCC-VNA1T01 Users]$ ll<br /> total 20<br /> -rw-rw-r--. 1 cassandra cassandra 652 Jul 6 15:51 Users-g-1-Data.db<br /> -rw-rw-r--. 1 cassandra cassandra 16 Jul 6 15:51 Users-g-1-Filter.db<br /> -rw-rw-r--. 1 cassandra cassandra 78 Jul 6 15:51 Users-g-1-Index.db<br /> -rw-rw-r--. 1 cassandra cassandra 4276 Jul 6 15:51 Users-g-1-Statistics.db<br /> [cassandra@LNX-XCC-VNA1T01 Users]$ pwd<br /> /var/lib/cassandra/data/xynergy/Users</p> <p>[cassandra@LNX-XCC-VNA1T01 bin]$ ./nodetool -h localhost refresh xynergy Users<br /> [cassandra@LNX-XCC-VNA1T01 bin]$ ./cassandra-cli -host localhost -port 9160<br /> Connected to: "Test Cluster" on localhost/9160<br /> Welcome to the Cassandra CLI.</p> <p>Type 'help;' or '?' for help.<br /> Type 'quit;' or 'exit;' to quit.</p> <p>Cassandra CLI version 0.8.10<br /> [default@unknown] use xynergy;<br /> Authenticated to keyspace: xynergy<br /> [default@xynergy] list Users;<br /> Using default limit of 100</p> <p>0 Row Returned.</p> <p>Thanks<br /> Kannan. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2752 Fri, 06 Jul 2012 15:50:49 +0000 xedin 2752@http://www.datastax.com/support-forums/ <p>If you have them placed to the correct place (with all other sstables that belong to particular Keyspace/ColumnFamily) in Cassandra's data directory e.g. /var/lib/cassandra/data/&lt;ks&gt;/&lt;cf&gt; you can use "./bin/nodetool refresh &lt;keyspace&gt; &lt;cf&gt;" to load them. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2751 Fri, 06 Jul 2012 15:45:19 +0000 kannanspec 2751@http://www.datastax.com/support-forums/ <p>Hi,</p> <p>I have a different question here. Is there a way to load sstable to cassandra assuming both sstable and cassandra are in the same machine.</p> <p>Thanks<br /> Kannan </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2748 Fri, 06 Jul 2012 15:26:34 +0000 xedin 2748@http://www.datastax.com/support-forums/ <p>If Cassandra itself was started from the original directory and you are trying to run sstableloader on the modified configuration - you won't be able to do that. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2746 Fri, 06 Jul 2012 15:06:54 +0000 kannanspec 2746@http://www.datastax.com/support-forums/ <p>Hi i am using one node cluster. i copied the existing cassandra directory and modified the storage port to 7001 and running sstableloader from this directory. Can i load sstable this way?</p> <p>thanks<br /> Kannan. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2745 Fri, 06 Jul 2012 14:53:29 +0000 xedin 2745@http://www.datastax.com/support-forums/ <p>I think that this error is self explanatory - there are no alive Cassandra nodes to connect to. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2743 Fri, 06 Jul 2012 14:46:10 +0000 kannanspec 2743@http://www.datastax.com/support-forums/ <p>hi I fixed the above issue. I get the below error now.</p> <p>[cassandra@LNX-XCC-VNA1T01 bin]$ ./sstableloader -v /home/cassandra/apache-cassandra-0.8.10/xynergy<br /> Starting client (and waiting 30 seconds for gossip) ...<br /> java.lang.IllegalStateException: Cannot load any sstable, no live member found in the cluster </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2739 Fri, 06 Jul 2012 10:00:43 +0000 xedin 2739@http://www.datastax.com/support-forums/ <p>Error "property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config" means that you have configuration file from Cassandra &gt;= 1.1.x but trying to actually run Cassandra &lt;= 1.0.x </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/3#post-2730 Fri, 06 Jul 2012 02:17:09 +0000 kannanspec 2730@http://www.datastax.com/support-forums/ <p>hi i fixed the above issue. but i still have issue loading</p> <p>[cassandra@LNX-XCC-VNA1T01 bin]$ ./sstableloader -v /home/cassandra/apache-cassandra-0.8.10-sstableloader/xynergy<br /> Starting client (and waiting 30 seconds for gossip) ...<br /> ERROR 02:04:18,047 Fatal configuration error error<br /> Can't construct a java object for tag:yaml.org,2002:org.apache.cassandra.config.Config; exception=Cannot create property=key_cache_size_in_mb for JavaBean=org.apache.cassandra.config.Config@1a53929c; Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> in "&lt;reader&gt;", line 10, column 1:<br /> cluster_name: 'Test Cluster'<br /> ^</p> <p> at org.yaml.snakeyaml.constructor.Constructor$ConstructYamlObject.construct(Constructor.java:372)<br /> at org.yaml.snakeyaml.constructor.BaseConstructor.constructObject(BaseConstructor.java:177)<br /> at org.yaml.snakeyaml.constructor.BaseConstructor.constructDocument(BaseConstructor.java:136)<br /> at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:122)<br /> at org.yaml.snakeyaml.Loader.load(Loader.java:52)<br /> at org.yaml.snakeyaml.Yaml.load(Yaml.java:166)<br /> at org.apache.cassandra.config.DatabaseDescriptor.&lt;clinit&gt;(DatabaseDescriptor.java:139)<br /> at org.apache.cassandra.service.StorageService.&lt;init&gt;(StorageService.java:164)<br /> at org.apache.cassandra.service.StorageService.&lt;clinit&gt;(StorageService.java:167)<br /> at org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:186)<br /> at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:104)<br /> at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:61)<br /> Caused by: org.yaml.snakeyaml.error.YAMLException: Cannot create property=key_cache_size_in_mb for JavaBean=org.apache.cassandra.config.Config@1a53929c; Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.constructJavaBean2ndStep(Constructor.java:305)<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.construct(Constructor.java:184)<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructYamlObject.construct(Constructor.java:370)<br /> ... 11 more<br /> Caused by: org.yaml.snakeyaml.error.YAMLException: Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.getProperty(Constructor.java:342)<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.constructJavaBean2ndStep(Constructor.java:240)<br /> ... 13 more<br /> null; Can't construct a java object for tag:yaml.org,2002:org.apache.cassandra.config.Config; exception=Cannot create property=key_cache_size_in_mb for JavaBean=org.apache.cassandra.config.Config@1a53929c; Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> Invalid yaml; unable to start server. See log for stacktrace. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/2#post-2727 Fri, 06 Jul 2012 01:13:33 +0000 kannanspec 2727@http://www.datastax.com/support-forums/ <p>I couldnt find a config file where i can change this. </p> http://www.datastax.com/support-forums/topic/cassandra-loading-csv-using-sstableloader/page/2#post-2726 Fri, 06 Jul 2012 01:12:10 +0000 kannanspec 2726@http://www.datastax.com/support-forums/ <p>Hi, i found the file where i need to fix it. </p> <p>I have another issue now. i stopped cassandra by killing the process, i started it again it is throwing me below error.</p> <p>[cassandra@LNX-XCC-VNA1T01 bin]$ ./cassandra &amp;<br /> [1] 2852<br /> [cassandra@LNX-XCC-VNA1T01 bin]$<br /> The stack size specified is too small, Specify at least 160k<br /> Error: Could not create the Java Virtual Machine.<br /> Error: A fatal exception has occurred. Program will exit.</p> <p>Thanks<br /> Kannan. </p>