Support Forums : DataStax

DataStax Support Forums » Apache Cassandra

Cassandra - loading csv using sstableloader

(43 posts) (3 voices)

Started 10 months ago by kannanspec
Latest reply from chandu
This topic is not a support question

Tags:

No tags yet.

12 3 Next »

kannanspec
Member

Hi,

I get below error when i try to load a csv file into cassandra.
----------------------------------------------------------------------

[cassandra@LNX-XCC-VNA1T01 lib]$ javac -cp apache-cassandra-1.1.0.jar DataImportExample.java
DataImportExample.java:37: error: no suitable constructor found for SSTableSimpleUnsortedWriter(File,String,String,AsciiType,<null>,int)
SSTableSimpleUnsortedWriter usersWriter = new SSTableSimpleUnsortedWriter(
^
constructor SSTableSimpleUnsortedWriter.SSTableSimpleUnsortedWriter(File,IPartitioner,String,String,AbstractType<?>,AbstractType<?>,int) is not applicable
(actual and formal argument lists differ in length)
constructor SSTableSimpleUnsortedWriter.SSTableSimpleUnsortedWriter(File,IPartitioner,String,String,AbstractType<?>,AbstractType<?>,int,CompressionParameters) is not applicable
(actual and formal argument lists differ in length)
DataImportExample.java:44: error: no suitable constructor found for SSTableSimpleUnsortedWriter(File,String,String,AsciiType,<null>,int)
SSTableSimpleUnsortedWriter loginWriter = new SSTableSimpleUnsortedWriter(
^
constructor SSTableSimpleUnsortedWriter.SSTableSimpleUnsortedWriter(File,IPartitioner,String,String,AbstractType<?>,AbstractType<?>,int) is not applicable
(actual and formal argument lists differ in length)
constructor SSTableSimpleUnsortedWriter.SSTableSimpleUnsortedWriter(File,IPartitioner,String,String,AbstractType<?>,AbstractType<?>,int,CompressionParameters) is not applicable
(actual and formal argument lists differ in length)
2 errors

---------------------------------------------------------
Can you please help me resolve this?

Thanks
Kannan

Posted 10 months ago #
xedin
Member

Seems like you try to import incorrect output or using SSTableSimpleUnsortedWriter API incorrectly because it reports that argument list it expect doesn't match the actual arguments you give it.

Posted 10 months ago #
xedin
Member

This should be of help http://www.datastax.com/dev/blog/bulk-loading section "Bulk-loading external data: a complete example"

Posted 10 months ago #
kannanspec
Member

Hi Xedin,

Thanks for the prompt reply, actually i am using the jave file mentioned in the below link
http://www.datastax.com/dev/blog/bulk-loading section "Bulk-loading external data: a complete example"

DataImportExample.java

Only difference in my code is i am trying to compile using cassandra 1.1.0 instead of 0.8.2 does it make any difference.

Thanks
Kannan.

Posted 10 months ago #
kannanspec
Member

Posted 10 months ago #
xedin
Member

yes, it surely does, many of the internal APIs changed on the way to 1.1.0.

Posted 10 months ago #
kannanspec
Member

I compiled it using apache-cassandra-0.8.10.jar it got compiled. I am trying to run the java class now. Thanks for your reply

Posted 10 months ago #
kannanspec
Member

I get below error when i run the run.sh shell script, do you have any clue about this. Thanks for your help.

[cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$ ./run.sh
Exception in thread "main" java.lang.UnsupportedClassVersionError: DataImportExample : Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: DataImportExample. Program will exit.

Posted 10 months ago #
xedin
Member

What is in your run.sh ?

Posted 10 months ago #
kannanspec
Member

#!/bin/sh

# paths to the cassandra source tree, cassandra jar and java
CASSANDRA_HOME="."
CASSANDRA_JAR="$CASSANDRA_HOME/lib/apache-cassandra-0.8.10.jar"
JAVA=which java

# Java classpath. Must include:
# - directory of DataImportExample
# - directory with cassandra/log4j config files
# - cassandra jar
# - cassandra depencies jar
CLASSPATH=".:$CASSANDRA_HOME/conf:$CASSANDRA_JAR"

for jar in $CASSANDRA_HOME/lib/*.jar; do
CLASSPATH=$CLASSPATH:$jar
done

$JAVA -ea -cp $CLASSPATH -Xmx256M \
-Dlog4j.configuration=log4j-tools.properties \
DataImportExample "$@"

Posted 10 months ago #
xedin
Member

Did you have DataImportExample.class (compiled version of the DataImportExample.java) in your current directory?

Posted 10 months ago #
kannanspec
Member

yes i have it.

This is what i have in the current directory.

[cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$ ls
bin conf DataImportExample.class first.csv javadoc LICENSE.txt NOTICE.txt run.sh
CHANGES.txt DataImport_bkp.java DataImportExample$CsvEntry.class interface lib NEWS.txt README.txt
[cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$

thanks
kannan

Posted 10 months ago #
kannanspec
Member

more legible list

cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$ ls -l
total 192
drwxr-xr-x. 2 cassandra cassandra 4096 Jul 2 20:31 bin
-rw-r--r--. 1 cassandra cassandra 18544 Jul 3 15:04 cassandra.yaml
-rw-r--r--. 1 cassandra cassandra 84039 Feb 8 10:53 CHANGES.txt
drwxr-xr-x. 2 cassandra cassandra 4096 Jul 2 20:31 conf
-rw-rw-r--. 1 cassandra cassandra 4285 Jul 2 21:23 DataImport_bkp.java
-rw-rw-r--. 1 cassandra cassandra 2528 Jul 2 20:31 DataImportExample.class
-rw-rw-r--. 1 cassandra cassandra 1540 Jul 2 20:31 DataImportExample$CsvEntry.class
-rw-rw-r--. 1 cassandra cassandra 254 Jul 3 14:58 first.csv
drwxr-xr-x. 2 cassandra cassandra 4096 Jul 2 20:31 interface
drwxr-xr-x. 4 cassandra cassandra 4096 Jul 2 20:31 javadoc
drwxr-xr-x. 3 cassandra cassandra 4096 Jul 2 21:30 lib
-rw-r--r--. 1 cassandra cassandra 11609 Feb 8 10:53 LICENSE.txt
-rw-r--r--. 1 cassandra cassandra 22441 Feb 8 10:53 NEWS.txt
-rw-r--r--. 1 cassandra cassandra 1144 Feb 8 10:53 NOTICE.txt
-rw-r--r--. 1 cassandra cassandra 3740 Feb 8 10:53 README.txt
-rwxrwxrwx. 1 cassandra cassandra 593 Jul 2 20:58 run.sh
[cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$

thanks
Kannan.

Posted 10 months ago #
xedin
Member

This http://www.java.net/node/664117 says that the problem is that you have compiled against one jdk but trying to run it with another.

Posted 10 months ago #
kannanspec
Member

Hi xedin,

I fixed the java version, now i am able to run the script run.sh.
where will i see the sstable genreated. I guess it should be in the keyspace directory

/var/lib/cassandra/data/xynergy/Users

but i dont see it here

following command gave no errors.

[cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$ ./run.sh first.csv
[cassandra@LNX-XCC-VNA1T01 apache-cassandra-0.8.10]$

thanks for your help.

Posted 10 months ago #

RSS feed for this topic

12 3 Next »