Support Forums : DataStax

DataStax Support Forums » DataStax Community

Importing data into Cassandra from mysql when Column family already exist

(2 posts) (2 voices)

Started 4 months ago by ernipur
Latest reply from khahn
This topic is not a support question

Tags:

No tags yet.

ernipur
Member

Hi,

I am trying to append to a column family in Cassandra by importing data from my sql using sqoop. But looks like I need to change data type of all column in column family to Text\varchar . Is there any other way through which I can import data to an existing column family in Cassandra. Appreciate you help. please find err I am getting below:

1.) Sqoop statement:
bin/dse sqoop import --connect jdbc:mysql://mysqlURL/sqoopCassandraTest --username root --password root --outdir /home/user/workDir/sqoopTest/ --table sqoopDataTypeTest --cassandra-keyspace sqooptest --cassandra-column-family dataTypeTest --cassandra-thrift-host localhost --split-by id --append
2.) Mapper error:

12/12/28 16:07:57 INFO mapred.JobClient: Task Id : attempt_201212261607_0061_m_000000_1, Status : FAILED
java.io.IOException: InvalidRequestException(why:Expected 4 or 0 byte int (1))
at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter$RangeClient.run(ColumnFamilyRecordWriter.java:316)
Caused by: InvalidRequestException(why:Expected 4 or 0 byte int (1))
at org.apache.cassandra.thrift.Cassandra$batch_mutate_result.read(Cassandra.java:20253)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at org.apache.cassandra.thrift.Cassandra$Client.recv_batch_mutate(Cassandra.java:922)
at org.apache.cassandra.thrift.Cassandra$Client.batch_mutate(Cassandra.java:908)
at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter$RangeClient.run(ColumnFamilyRecordWriter.java:308)

Posted 4 months ago #
khahn
Member

I hope this helps you: http://www.datastax.com/docs/1.2/cql_cli/cql/COPY#cqlsh-copy-to-from. Also a feature of Cassandra 1.1.

Posted 4 months ago #

RSS feed for this topic

Reply

You must log in to post.