pkolaczk Software, Support, and Training for Apache Cassandra en-US Thu, 23 May 2013 06:00:17 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/reduce-operation-hangs#post-9602 Fri, 29 Mar 2013 12:24:01 +0000 bezgoan 9602@http://www.datastax.com/support-forums/ <p>hi got this resolved. it was problem with debian setup in /etc/hosts.</p> <p>computer name is put against 127.0.1.1 in debian system and<br /> 127.0.0.1 is localhost. added computer name to localhost and nodes started communicating.</p> <p>Thanks<br /> Shashank. </p> http://www.datastax.com/support-forums/topic/reduce-operation-hangs#post-9496 Sat, 23 Mar 2013 18:12:49 +0000 Piotr Kołaczkowski 9496@http://www.datastax.com/support-forums/ <p>Can you post more information about your cluster setup? Can you post dsetool ring output? What is in your /etc/hosts?<br /> There is a bug in DSE 3.0.0 causing Hadoop jobs to hang before reduce phase on multihomed hosts, when running on localhost. Generally changing listen_address and seed nodes in cassandra.yaml from localhost to the proper hostname helps. It is possible you are running into that problem. It is fixed in 3.0.1 which we're going to release soon. </p> http://www.datastax.com/support-forums/topic/error-in-cassandra-cli-error-110506144-fatal-configuration-error-error#post-9495 Fri, 22 Mar 2013 21:40:04 +0000 Sven 9495@http://www.datastax.com/support-forums/ <p>Sorry for the late response. Are you still on this? I would recommend going to a more modern version of DSE, as that has a newer version of C*. I would suspect that as long as you have that option in there, you will see these errors, as the old C* is not supporting that. Does the command work without the change to cassandra.yaml? Do you get a different error? </p> http://www.datastax.com/support-forums/topic/reduce-operation-hangs#post-9461 Sat, 16 Mar 2013 17:46:43 +0000 bezgoan 9461@http://www.datastax.com/support-forums/ <p>Hi All,</p> <p>I have managed to run an MR job in DSE3.0 enterprise edition.<br /> The problem seems to be with reduce job, which is not responding at all.<br /> I suspect it should be because I am using<br /> FileOutputFormat.setOutputPath(job, new Path(args[2]));<br /> to set the output paths, but cassandra (understand it is underlying DFS) is supposedly not responding.<br /> Not sure on how to figure out exact reason for reduce operation hanging.</p> <p>Thanks<br /> Shashank. </p> http://www.datastax.com/support-forums/topic/error-in-cassandra-cli-error-110506144-fatal-configuration-error-error#post-9058 Mon, 18 Feb 2013 07:41:58 +0000 Hans-Peter.Sloot_atos.net 9058@http://www.datastax.com/support-forums/ <p>But what is the relation between setting the timeuuid() as :</p> <p><code>SET blog_entry[&#039;yomama&#039;][timeuuid()] = &#039;I love my new shoes!&#039;;</code></p> <p>and the error and the tweaking?<br /> That is what I do not understand.<br /> How do I need to tweak the cache size to prevent the cassandra-cli to terminate?<br /> Is the timeuuid also not permitted in 2.1? </p> http://www.datastax.com/support-forums/topic/error-in-cassandra-cli-error-110506144-fatal-configuration-error-error#post-9029 Fri, 15 Feb 2013 16:34:16 +0000 Sven 9029@http://www.datastax.com/support-forums/ <p>The version of DSE (2.1) you are using includes an old version of Cassandra that is not aware of that option. </p> <p>So if you want to stick with that version, the instructions on how to tweak Cassandra are here: <a href="http://www.datastax.com/docs/1.0/operations/tuning#configuring-the-column-family-key-cache" rel="nofollow">http://www.datastax.com/docs/1.0/operations/tuning#configuring-the-column-family-key-cache</a>.</p> <p>If you want to change the setting the way you tried (which is consistent with more modern version of Cassandra), I would recommend you go to a newer version of DSE.</p> <p>Thanks,<br /> Sven </p> http://www.datastax.com/support-forums/topic/error-in-cassandra-cli-error-110506144-fatal-configuration-error-error#post-9028 Fri, 15 Feb 2013 14:51:17 +0000 Hans-Peter.Sloot_atos.net 9028@http://www.datastax.com/support-forums/ <p>Sorry for being a dummy.<br /> Why does it complain about the key_cache_size_in_mb?</p> <p>I do not understand what I should change about the cf either.</p> <p>Regards Hans-Peter </p> http://www.datastax.com/support-forums/topic/error-in-cassandra-cli-error-110506144-fatal-configuration-error-error#post-9027 Fri, 15 Feb 2013 14:43:25 +0000 Piotr Kołaczkowski 9027@http://www.datastax.com/support-forums/ <p>Cassandra 1.0 does not have key_cache_size_in_mb property. This property was added in 1.1 version.</p> <p>Cassandra 1.0 cache size was configured per cf. Follow the instructions here:<br /> <a href="http://www.datastax.com/docs/1.0/operations/tuning#configuring-the-column-family-key-cache" rel="nofollow">http://www.datastax.com/docs/1.0/operations/tuning#configuring-the-column-family-key-cache</a> </p> http://www.datastax.com/support-forums/topic/error-in-cassandra-cli-error-110506144-fatal-configuration-error-error#post-9026 Fri, 15 Feb 2013 14:16:17 +0000 Hans-Peter.Sloot_atos.net 9026@http://www.datastax.com/support-forums/ <p>I am trying to do some examples with cassandra-cli and encounter the error further below.<br /> Is this really a configuration error ?<br /> If I add key_cache_size_in_mb to the cassandra.yaml file cassandra does not even start.</p> <p>I have installed Enterprise 2.1 version.</p> <p>Regards</p> <p>[default@MyCassandraKS] SET blog_entry['yomama'][timeuuid()] = 'I love my new shoes!';<br /> ERROR 11:05:06,144 Fatal configuration error error<br /> Can't construct a java object for tag:yaml.org,2002:org.apache.cassandra.config.Config; exception=Cannot create property=key_cache_size_in_mb for JavaBean=org.apache.cassandra.config.Config@7c138c63; Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> in "&lt;reader&gt;", line 10, column 1:<br /> cluster_name: 'CassandraCluster'<br /> ^</p> <p> at org.yaml.snakeyaml.constructor.Constructor$ConstructYamlObject.construct(Constructor.java:372)<br /> at org.yaml.snakeyaml.constructor.BaseConstructor.constructObject(BaseConstructor.java:177)<br /> at org.yaml.snakeyaml.constructor.BaseConstructor.constructDocument(BaseConstructor.java:136)<br /> at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:122)<br /> at org.yaml.snakeyaml.Loader.load(Loader.java:52)<br /> at org.yaml.snakeyaml.Yaml.load(Yaml.java:166)<br /> at org.apache.cassandra.config.DatabaseDescriptor.&lt;clinit&gt;(DatabaseDescriptor.java:131)<br /> at org.apache.cassandra.utils.FBUtilities.getLocalAddress(FBUtilities.java:143)<br /> at org.apache.cassandra.utils.UUIDGen.createTimeUUIDBytes(UUIDGen.java:151)<br /> at org.apache.cassandra.utils.UUIDGen.getTimeUUIDBytes(UUIDGen.java:131)<br /> at org.apache.cassandra.cli.CliClient.convertValueByFunction(CliClient.java:2600)<br /> at org.apache.cassandra.cli.CliClient.convertValueByFunction(CliClient.java:2573)<br /> at org.apache.cassandra.cli.CliClient.getColumnName(CliClient.java:2798)<br /> at org.apache.cassandra.cli.CliClient.executeSet(CliClient.java:852)<br /> at org.apache.cassandra.cli.CliClient.executeCLIStatement(CliClient.java:218)<br /> at org.apache.cassandra.cli.CliMain.processStatementInteractive(CliMain.java:220)<br /> at org.apache.cassandra.cli.CliMain.main(CliMain.java:348)<br /> Caused by: org.yaml.snakeyaml.error.YAMLException: Cannot create property=key_cache_size_in_mb for JavaBean=org.apache.cassandra.config.Config@7c138c63; Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.constructJavaBean2ndStep(Constructor.java:305)<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.construct(Constructor.java:184)<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructYamlObject.construct(Constructor.java:370)<br /> ... 16 more<br /> Caused by: org.yaml.snakeyaml.error.YAMLException: Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.getProperty(Constructor.java:342)<br /> at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.constructJavaBean2ndStep(Constructor.java:240)<br /> ... 18 more<br /> null; Can't construct a java object for tag:yaml.org,2002:org.apache.cassandra.config.Config; exception=Cannot create property=key_cache_size_in_mb for JavaBean=org.apache.cassandra.config.Config@7c138c63; Unable to find property 'key_cache_size_in_mb' on class: org.apache.cassandra.config.Config </p> http://www.datastax.com/support-forums/topic/unable-to-access-the-cfs-in-analytic-mode#post-9021 Thu, 14 Feb 2013 18:27:35 +0000 Piotr Kołaczkowski 9021@http://www.datastax.com/support-forums/ <p>Your URIs are wrong.<br /> The correct URI syntax is:<br /> [cfs://[host][:port]]/[path]</p> <p>The cfs://user/ URI splits into the following components:</p> <p>scheme = cfs<br /> host = user<br /> path = /</p> <p>This is very likely not what you wanted and that's why it has connection problems.</p> <p>The following will work:</p> <p>dse hadoop fs -ls /user<br /> dse hadoop fs -ls cfs:///user<br /> dse hadoop fs -ls cfs://localhost/user</p> <p>dse hadoop fs -cat info.csv<br /> dse hadoop fs -cat cfs:///info.csv<br /> dse hadoop fs -cat cfs://localhost/info.csv </p> http://www.datastax.com/support-forums/topic/mapping-composite-column-names-on-hive#post-9018 Thu, 14 Feb 2013 11:45:49 +0000 dipesh 9018@http://www.datastax.com/support-forums/ <p>If possible, can you please share a sample code for serializer and deserializer?<br /> And/or provide necessary pointers that could help in that regard.</p> <p>Here is what I have, but not working.</p> <pre><code>package com.cisco.iep.hive.plugins; import java.io.ByteArrayOutputStream; import java.nio.ByteBuffer; import java.util.ArrayList; import java.util.List; import org.apache.hadoop.hive.ql.exec.UDF; import org.apache.hadoop.io.BytesWritable; import org.apache.hadoop.io.LongWritable; import org.apache.hadoop.io.Text; public class WriteCompositeLongString extends UDF{ public BytesWritable evaluate(final LongWritable l, final Text s) { List&lt;byte[]&gt; b = new ArrayList&lt;byte[]&gt;(2); b.add(longWritableToByteArray(l)); b.add(textToByteArray(s)); return new BytesWritable(makeComposite(b)); } private byte[] textToByteArray(Text s){ if(s==null){ return null; } return s.getBytes(); } private byte[] longWritableToByteArray(final LongWritable l){ if(l==null){ return null; } return ByteBuffer.allocate(Long.SIZE).putLong(l.get()).array(); } private byte[] makeComposite(final List&lt;byte[]&gt; b) { ByteArrayOutputStream bos = new ByteArrayOutputStream(); for (int i = 0; i &lt; b.size(); i++) { bos.write((byte) ((b.get(i).length &gt;&gt; (7 + 1)) &amp; 0xFF)); bos.write((byte) (b.get(i).length &amp; 0xFF)); for (int j = 0; j &lt; b.get(i).length; j++) { bos.write(b.get(i)[j] &amp; 0xFF); } bos.write((byte) 0); } return bos.toByteArray(); } }</code></pre> <p>Thanks in advance!! </p> http://www.datastax.com/support-forums/topic/unable-to-access-the-cfs-in-analytic-mode#post-8579 Tue, 22 Jan 2013 13:34:16 +0000 Abhijit 8579@http://www.datastax.com/support-forums/ <p>Hi All,</p> <p>I am facing errors running DSE 2.1 in analytic mode. It might be a configuration problem. Even i have seen similar sort of issues raised in forum previously <a href="http://www.datastax.com/support-forums/topic/cfs-is-not-accessable" rel="nofollow">http://www.datastax.com/support-forums/topic/cfs-is-not-accessable</a>, still am unable to resolve the issue.</p> <p>Actually when i am using the command :<br /> dse hadoop fs -ls cfs://<br /> it is giving output as :<br /> /tmp<br /> /user<br /> Great. But next time when i am trying to execute :<br /> dse hadoop fs -ls cfs://user/<br /> it is not getting executed, rather showing timeout exception.</p> <p>Further using<br /> dse hadoop fs -copyFromLocal localpath/info.csv cfs://info.csv<br /> to copy file from local file system is getting executed successfully. But while trying to execute the following statement<br /> dse hadoop fs -cat cfs://info.csv<br /> its again throwing the same timeout exception</p> <p>Simply asking is it possible to store and retrieve files from cfs in DSE similar like HDFS. </p> http://www.datastax.com/support-forums/topic/cant-start-cassandra-node#post-8317 Mon, 07 Jan 2013 23:27:20 +0000 umermk3 8317@http://www.datastax.com/support-forums/ <p>Warning: This will *delete* your old Cassandra data.</p> <p>On OSX or Linux, delete the previous Cassandra folder like this:</p> <p><code>$ sudo rm -fr /var/lib/cassandra</code></p> <p>Depending on your permission, you might not need to use <code>sudo</code>.</p> <p>It is because the new default partitioner is now Murm3r, instead of RandomPartitioner. That's how it worked for me. </p> http://www.datastax.com/support-forums/topic/pig-and-hive-queries-not-working-in-dse-221#post-8253 Wed, 02 Jan 2013 20:52:20 +0000 ssach03 8253@http://www.datastax.com/support-forums/ <p>Had the same issue. In my case I increased the memory and that resolved my issue. </p> http://www.datastax.com/support-forums/topic/pig-and-hive-queries-not-working-in-dse-221#post-8195 Fri, 28 Dec 2012 15:37:20 +0000 Piotr Kołaczkowski 8195@http://www.datastax.com/support-forums/ <p>Are there any errors reported in system.log? E.g about failed tasks?<br /> What is the load on the machines, when the task is "not moving further"?<br /> Especially, have you given enough memory for your reducers? Can you check with jmap that the dse daemon process has enough free heap space? </p>