ernipur Software, Support, and Training for Apache Cassandra en-US Wed, 22 May 2013 14:32:40 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/importing-data-into-cassandra-from-mysql-when-column-family-already-exist#post-8364 Fri, 11 Jan 2013 16:18:56 +0000 khahn 8364@http://www.datastax.com/support-forums/ <p>I hope this helps you: <a href="http://www.datastax.com/docs/1.2/cql_cli/cql/COPY#cqlsh-copy-to-from" rel="nofollow">http://www.datastax.com/docs/1.2/cql_cli/cql/COPY#cqlsh-copy-to-from</a>. Also a feature of Cassandra 1.1. </p> http://www.datastax.com/support-forums/topic/importing-data-into-cassandra-from-mysql-when-column-family-already-exist#post-8194 Fri, 28 Dec 2012 10:36:37 +0000 ernipur 8194@http://www.datastax.com/support-forums/ <p>Hi,</p> <p>I am trying to append to a column family in Cassandra by importing data from my sql using sqoop. But looks like I need to change data type of all column in column family to Text\varchar . Is there any other way through which I can import data to an existing column family in Cassandra. Appreciate you help. please find err I am getting below:</p> <p>1.) Sqoop statement:<br /> bin/dse sqoop import --connect jdbc:mysql://mysqlURL/sqoopCassandraTest --username root --password root --outdir /home/user/workDir/sqoopTest/ --table sqoopDataTypeTest --cassandra-keyspace sqooptest --cassandra-column-family dataTypeTest --cassandra-thrift-host localhost --split-by id --append<br /> 2.) Mapper error:</p> <p>12/12/28 16:07:57 INFO mapred.JobClient: Task Id : attempt_201212261607_0061_m_000000_1, Status : FAILED<br /> java.io.IOException: InvalidRequestException(why:Expected 4 or 0 byte int (1))<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter$RangeClient.run(ColumnFamilyRecordWriter.java:316)<br /> Caused by: InvalidRequestException(why:Expected 4 or 0 byte int (1))<br /> at org.apache.cassandra.thrift.Cassandra$batch_mutate_result.read(Cassandra.java:20253)<br /> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)<br /> at org.apache.cassandra.thrift.Cassandra$Client.recv_batch_mutate(Cassandra.java:922)<br /> at org.apache.cassandra.thrift.Cassandra$Client.batch_mutate(Cassandra.java:908)<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter$RangeClient.run(ColumnFamilyRecordWriter.java:308) </p> http://www.datastax.com/support-forums/topic/using-sqoop-with-query-option-to-import-data-into-cassandra-column-family-doesnt-seem-to-work#post-8154 Thu, 27 Dec 2012 12:05:44 +0000 ernipur 8154@http://www.datastax.com/support-forums/ <p>Hi,</p> <p>I would rather suggest to use outdir switch. As per my experience looks like RBDMS column name and Cassandra column name should be same for input to be successful. Some thing like this should work.</p> <p>dse sqoop import --connect jdbc:mysql://db.server.address/schema_name --username user --p --outdir /some/output/dir/ --query "select x, y, z from table where cond1 and cond2 and \$CONDITIONS" --target-dir /some/dir --split-by x --cassandra-keyspace cks1 --cassandra-column-family ccf1 --cassandra-row-key x --cassandra-thrift-host 127.0.0.1 --append</p> <p>Thanks ,</p> <p>_Nipur </p> http://www.datastax.com/support-forums/topic/using-sqoop-with-query-option-to-import-data-into-cassandra-column-family-doesnt-seem-to-work#post-7098 Wed, 24 Oct 2012 15:18:31 +0000 cartera_alex 7098@http://www.datastax.com/support-forums/ <p>Hi,</p> <p>I'm trying to use sqoop to import some data from a MySQL database into a Cassandra column family. I've been able to do this successfully when I used the --table option (like shown in the sqoop demo in the docs), but using --query option doesn't seem to work.</p> <p>If I run a command like this:</p> <p><code>dse sqoop import --connect jdbc:mysql://db.server.address/schema_name --username user -P --query &quot;select x, y, z from table where cond1 and cond2 and \$CONDITIONS&quot; --split-by x --cassandra-keyspace cks1 --cassandra-column-family ccf1 --cassandra-row-key x --cassandra-thrift-host 127.0.0.1</code></p> <p>it fails and tells me that --target-dir option must be specified.</p> <p>If I then add the --target-dir option like this:</p> <p><code>dse sqoop import --connect jdbc:mysql://db.server.address/schema_name --username user -P --query &quot;select x, y, z from table where cond1 and cond2 and \$CONDITIONS&quot; --split-by x --target-dir /some/dir --cassandra-keyspace cks1 --cassandra-column-family ccf1 --cassandra-row-key x --cassandra-thrift-host 127.0.0.1</code></p> <p>the job runs, but does not import any records.</p> <p>Running this import without the cassandra options works and dumps the data into CFS.</p> <p>Am I doing something wrong or is it just not possible to import directly into a Cassandra column family using the --query option?</p> <p>I am using DSE 2.2. </p>