http://www.datastax.com/support-forums/topic/using-composite-columns-in-mapreduce Software, Support, and Training for Apache Cassandra en-US Mon, 20 May 2013 21:51:06 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/using-composite-columns-in-mapreduce#post-8051 Fri, 21 Dec 2012 06:19:06 +0000 cartera_alex 8051@http://www.datastax.com/support-forums/ <p>This is, in fact, a manifestation of <a href="https://issues.apache.org/jira/browse/CASSANDRA-4377" rel="nofollow">https://issues.apache.org/jira/browse/CASSANDRA-4377</a> </p> http://www.datastax.com/support-forums/topic/using-composite-columns-in-mapreduce#post-8050 Fri, 21 Dec 2012 05:32:48 +0000 cartera_alex 8050@http://www.datastax.com/support-forums/ <p>I'm starting to think that this is a bug in Thrift.<br /> Since posting the original post, I have implemented a whole new output format that uses the Astyanax client. I have also tried this from a stand-alone program using Astyanax.</p> <p>What I noticed is that I am able to insert columns that have UTF8Type (string) values while any other insertions fail. Surprisingly, if I attempt to insert a string value into a column that was defined as a non-"varchar" type in CQL3 from a Thrift-based client it succeeds! I also noticed that cassandra-cli lists this CF as having default_validation_class = 'UTF8Type'.</p> <p>Inserting non-string values into this CF from cqlsh using CQL3 works fine. </p> http://www.datastax.com/support-forums/topic/using-composite-columns-in-mapreduce#post-8008 Tue, 18 Dec 2012 15:47:40 +0000 cartera_alex 8008@http://www.datastax.com/support-forums/ <p>Hello,<br /> I'm trying to use ColumnFamilyOutputFormat to write to a Cassandra column family with composite columns from my reducer. Since Thrift is the only available API in this case (I wish it wasn't so), I followed an example outlined here: <a href="http://stackoverflow.com/questions/11801288/inserting-and-getting-from-cassandra-with-composite-key-invalidrequestexception" rel="nofollow">http://stackoverflow.com/questions/11801288/inserting-and-getting-from-cassandra-with-composite-key-invalidrequestexception</a></p> <p>Unfortunately, I'm getting the following exception when I run the job:</p> <p>12/12/17 21:37:32 INFO mapred.JobClient: Task Id : attempt_201212120944_0011_r_000003_2, Status : FAILED<br /> java.io.IOException: InvalidRequestException(why:(String didn't validate.) [c8][txnspermember][12:345:ac0a2000-effb-11e1-c000-000000000000:1234:56789:somememberid:txn_date] failed validation)<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter$RangeClient.run(ColumnFamilyRecordWriter.java:316)<br /> Caused by: InvalidRequestException(why:(String didn't validate.) [c8][txnspermember][12:345:ac0a2000-effb-11e1-c000-000000000000:1234:56789:somememberid:txn_date] failed validation)<br /> at org.apache.cassandra.thrift.Cassandra$batch_mutate_result.read(Cassandra.java:20253)<br /> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)<br /> at org.apache.cassandra.thrift.Cassandra$Client.recv_batch_mutate(Cassandra.java:922)<br /> at org.apache.cassandra.thrift.Cassandra$Client.batch_mutate(Cassandra.java:908)<br /> at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter$RangeClient.run(ColumnFamilyRecordWriter.java:308)</p> <p>Note that "somememberid" is what I would expect my row key to be, yet it appears in the middle of the composite string for some reason.</p> <p>My column family looks like this:<br /> <pre><code>CREATE TABLE txnspermember ( member_id text, org_id int, brand_id int, post_date &#039;TimeUUIDType&#039;, merchant_id bigint, offer_id bigint, txn_id text, agreed_rebate text, catalog_id text, cb_elig boolean, cli_shr_pct double, conv_rate double, description text, first_four int, first_name text, g_merchant_id bigint, last_four int, mbr_shr_pct double, mcc bigint, member_zip text, mid text, mn_shr_pct double, rebate_amt double, rebate_val double, spend_amt double, txn_date &#039;TimeUUIDType&#039;, PRIMARY KEY (member_id, org_id, brand_id, post_date, merchant_id, offer_id, txn_id) ) WITH comment=&#039;&#039; AND caching=&#039;KEYS_ONLY&#039; AND read_repair_chance=0.100000 AND gc_grace_seconds=864000 AND replicate_on_write=&#039;true&#039; AND compaction_strategy_class=&#039;SizeTieredCompactionStrategy&#039; AND compression_parameters:sstable_compression=&#039;SnappyCompressor&#039;;</code></pre>