khahn Software, Support, and Training for Apache Cassandra en-US Wed, 22 May 2013 09:35:23 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-10626 Sun, 05 May 2013 15:34:28 +0000 Jack Krupansky 10626@http://www.datastax.com/support-forums/ <p>In general, it is best to create a "Solr" column family from scratch using the Solr HTTP APPI. You can then populate the column family using either the Solr or Cassandra APIs. </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-10592 Sat, 04 May 2013 04:04:24 +0000 rahul 10592@http://www.datastax.com/support-forums/ <p>Here i am using DSE3.0.1. I am creating a composite column family through cassandra-cli.But at indexing solr gives error that "Solr indexes are not supported on ColumnFamilies with non-string comparators".Where am i missing? Please help me. I have badly need it. It'll be very great-full for you. </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-9622 Sun, 31 Mar 2013 11:33:15 +0000 avon 9622@http://www.datastax.com/support-forums/ <p>Seems Solr always require a unique id to be configured under it's index designated in the schema.xml config file. A CQL3 table with a simple and single index can be easily resolved to a unique id as required by Solr - and my guess - when the index is a composite one, that's where Solr &amp; DSE integration finds it unable to decide on which one to use as unique key given multiple fields in a composite index. Or perhaps should use all fields in a composite index as unique key!<br /> Anyway what I hear is CQL3 and SOLR is not integrated yet...and only single field index works for now...please correct my understanding </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-9618 Sat, 30 Mar 2013 05:14:07 +0000 khahn 9618@http://www.datastax.com/support-forums/ <p>We added an example to the docs to show how to insert your own data for searching into Cassandra: <a href="http://www.datastax.com/docs/datastax_enterprise3.0/solutions/dse_search_load_data" rel="nofollow">http://www.datastax.com/docs/datastax_enterprise3.0/solutions/dse_search_load_data</a></p> <p>The example uses CQL 2. CQL 3 isn't supported yet. Hope this helps. </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-9606 Fri, 29 Mar 2013 18:21:54 +0000 Jack Krupansky 9606@http://www.datastax.com/support-forums/ <p>To be clear, DSE doesn't specifically support creation of a Solr-enabled column family using CQL. But, once created using the DSE/Solr HTTP API, that column family can be queried with CQL by using the WHERE solr_query='query-string' clause. </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-9605 Fri, 29 Mar 2013 15:08:40 +0000 Jack Krupansky 9605@http://www.datastax.com/support-forums/ <p>It is easier and better to completely create a Solr-enabled column family using the Solr HTTP API, as shown in the DSE doc with the Wikipedia demo. In fact, start with the solrconfig.xml for that demo, and modify the schema as well.</p> <p>If you do that, you will see all the detailed metadata and column family parameters that DSE/Solr automatically creates for you. Do you really want to do all of that by hand?!</p> <p>Meanwhile, I will research whether there technical issues with CQL3 for Solr. I mean, you should be able to create a Solr-enabled column family that way if you actually really want to. </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-9600 Fri, 29 Mar 2013 08:43:55 +0000 avon 9600@http://www.datastax.com/support-forums/ <p>I tried all table combinations<br /> 1. with all fields as varchars and compsite index - fails<br /> 2. with all fields different data types and single field index - is ok<br /> 3. all fields different data types and composite index - fails</p> <p>Seems table with composite index is not workable in Solr and the irony is without composite key you miss the clustering guarantees per partition akin to column family with dynamic columns... </p> http://www.datastax.com/support-forums/topic/error-creating-solr-indexes-on-cql3-created-tables#post-9599 Fri, 29 Mar 2013 05:05:03 +0000 avon 9599@http://www.datastax.com/support-forums/ <p>Hi,</p> <p>I created a table using CQL3 and subsequently went ahead to create a Solr index and encountered this error when curl-ing the solrconfig.xml. </p> <p>CREATE TABLE receiptrepository (<br /> CustomerId uuid,<br /> ReceiptDate timestamp,<br /> ReceiptId uuid,<br /> MerchantName varchar,<br /> MallName varchar,<br /> PRIMARY KEY (CustomerId, ReceiptDate, ReceiptId, MerchantName, MallName)<br /> );</p> <p>curl --data-binary file=@solrconfig.xml -H 'Content-type:text/xml; charset=utf-8' <a href="http://192.168.56.135:8983/solr/resource/demodb.receiptrepository/solrconfig.xml" rel="nofollow">http://192.168.56.135:8983/solr/resource/demodb.receiptrepository/solrconfig.xml</a> (btw, solrconfig.xml is reused from wiki-solr demo)</p> <p>error I get: "Solr indexes are not supported on ColumnFamilies with non-string comparators" </p> <p>1. Could you explain what is wrong with the TABLE creation to elicit this response during solr index creation?<br /> 2. Also on a side note: when I executed the wiki-solr demo and launched the solr admin, I'm unable to see the full query interface and wiki-solr doesn't appear on the left menu option (below thread dump) </p> http://www.datastax.com/support-forums/topic/datastax-java-driver#post-9471 Mon, 18 Mar 2013 00:07:36 +0000 lc2a 9471@http://www.datastax.com/support-forums/ <p>Hi All,</p> <p>May I know how to run CQL3 in MapReduce.<br /> CREATE TABLE payloads (<br /> pinter varchar,<br /> computer varchar,<br /> snapshot_date int,<br /> xml_data text,<br /> status varchar,<br /> PRIMARY KEY ((pinter, computer), snapshot_date)<br /> )</p> <p>How to integrate Datastax Java Driver or Astyanax into MapReduce ColumnFamilyInputFormat class.</p> <p>Thanks in advance. </p> http://www.datastax.com/support-forums/topic/no-dsc12-package-in-yum-repository#post-8905 Mon, 04 Feb 2013 16:55:09 +0000 mbulman 8905@http://www.datastax.com/support-forums/ <p>Philip,</p> <p>The community (DSC) and enterprise (DSE) packages live in separate repositories. You can see the instructions for installing the DSE RPM here: <a href="http://www.datastax.com/docs/datastax_enterprise2.2/install/install_rpm_pkg" rel="nofollow">http://www.datastax.com/docs/datastax_enterprise2.2/install/install_rpm_pkg</a> </p> http://www.datastax.com/support-forums/topic/no-dsc12-package-in-yum-repository#post-8890 Mon, 04 Feb 2013 03:18:54 +0000 philip.fielder_bhnetwork.com 8890@http://www.datastax.com/support-forums/ <p>doesn't look like the DSE version is available either:</p> <p>[root@ip-10-180-105-227 ~]# yum install dse-full opscenter<br /> Loaded plugins: security<br /> Repository epel is listed more than once in the configuration<br /> rightscale-epel | 951 B 00:00<br /> Excluding Packages from none<br /> Finished<br /> Setting up Install Process<br /> No package dse-full available.<br /> No package opscenter available.<br /> Nothing to do<br /> [end]</p> <p>I don't know why you document this feature on your website when it is not ready. </p> http://www.datastax.com/support-forums/topic/why-a-3rd-column-family-when-creating-a-custom-index-on-cassandra#post-8850 Fri, 01 Feb 2013 17:00:12 +0000 Janbalik 8850@http://www.datastax.com/support-forums/ <p>Since I think someone else could have the same doubt than me, I'm going to answer my own question with the things I have found:</p> <p>As I supposed the main problem is the concurrency. If we assume that many users at the same time can be changing the same indexed value, as you have to read the index before updating, between the time you read a value and the time you update a value in the index another user could have changed again that value. As well as, from the moment the value is updated until you update the index the system could crash. Then, after a few concurrent changes the index could have old values that point to rows that have not that value. </p> <p>By adding the third column family this process is safer but NOT 100% SAFE. </p> <p>And a last thing: from my understanding, if there is no concurrency when updating the values, then there must be no problem. Let's supose you are indexing some user data. If only the owner of the data is allowed to modify the data, there is no concurrency at all. The unique risk is the system crashes before you finish the process to align the index with the value, but this operation is idempotent, so you can repeat it until success. </p> <p>Hope this explain what I have understood and help others. </p> http://www.datastax.com/support-forums/topic/why-a-3rd-column-family-when-creating-a-custom-index-on-cassandra#post-8702 Sun, 27 Jan 2013 10:54:22 +0000 Janbalik 8702@http://www.datastax.com/support-forums/ <p>Hi Khahn, </p> <p>Don't say sorry friend ;) You are helping me! Thank you very much. I'm still tring to understand this. I think a key is this: "Updates to the index an data are not atomic". Another one is "a node might index data held by another node". This is aligned with what I thought: you can have an index to a data which does not exist or a data not indexed. But, why using a third with the values indexed we can avoid this problem? We could say updates to the index, data and values indexes are not atomic, I mean, from my understanding, there could be concurrency and consistency problems also between the third CF (values indexed) and data. Or am I wrong? If so, why? Can you (or anyone) explain me why I'm wrong? </p> <p>Thanks!! </p> http://www.datastax.com/support-forums/topic/datastax-java-driver#post-8642 Thu, 24 Jan 2013 23:21:20 +0000 michael.figuiere 8642@http://www.datastax.com/support-forums/ <p>This driver is already quite stable but is not considered production ready yet. We'll iterate through some betas and rc releases over the upcoming weeks. We'll validate it internally and we currently plan release a 1.0 GA in the second half of March 2013.</p> <p>If you need to go in production right now with a project then you'd probably prefer to go with one of the currently available client libraries for Java. But if the release plan that I've mentioned above fits your project schedule, then you should give it a try. </p> http://www.datastax.com/support-forums/topic/why-a-3rd-column-family-when-creating-a-custom-index-on-cassandra#post-8617 Thu, 24 Jan 2013 02:09:59 +0000 khahn 8617@http://www.datastax.com/support-forums/ <p>Sorry the link didn't answer your question. I learned a little more after researching your question, but I'm afraid it's not a complete answer. I hope an expert gives you a better explanation soon. </p> <p>The third column family is needed because simply reading the previous value from the users CF before updating it and then removing the index entry for that value from the Users_Index_Entries will not reliably work due to Cassandra's model of eventual consistency and lack of transactions. When creating your own index, a node might index data held by another node. Updates to the index and data are not atomic. To overcome these problems, you maintain a third column family to list previous values for the property of an item and use the list to remove these values from the index before adding the new value to the index. </p>