http://www.datastax.com/support-forums/tags/index Software, Support, and Training for Apache Cassandra en-US Thu, 20 Jun 2013 01:52:27 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/rebuid-solr-index-when-adding-new-columns#post-2469 Thu, 28 Jun 2012 20:36:56 +0000 xzhang 2469@http://www.datastax.com/support-forums/ <p>OK. It looks like this happens only if I change the column family schema. </p> http://www.datastax.com/support-forums/topic/rebuid-solr-index-when-adding-new-columns#post-2466 Thu, 28 Jun 2012 20:25:58 +0000 xzhang 2466@http://www.datastax.com/support-forums/ <p>Hi, I am using DataStax Enterprise and having a problem with solr when dynamically adding new columns to Cassandra. </p> <p>The schema.xml has the following line to index all columns ends with "_dy".<br /> &lt;dynamicField name="*_dy" type="string" indexed="true" stored="true"/&gt;</p> <p>The initial column family consists of columns without indexing. After posting the schema.xml and solrconfig.xml files, all works fine. However, whenever I add a new column to a column family, accessing the solr admin page prints out the following exceptions:<br /> ---------------------------------------------------------------------------------<br /> HTTP Status 500 - java.lang.RuntimeException: org.apache.solr.common.SolrException: Could not find: solrconfig.xml java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.common.SolrException: Could not find: solrconfig.xml at com.datastax.bdp.plugin.AbstractPlugin.activate(AbstractPlugin.java:47) at ...<br /> ---------------------------------------------------------------------------------</p> <p>If I post the same schema.xml and solrconfig.xml files again, the admin page works again. Is there a way to avoid this re-posting? I need to programmatically add new columns continuously and at the mean time, searching via solr should also work. </p> <p>Thanks a lot!! </p> http://www.datastax.com/support-forums/topic/solr-index-files#post-1886 Wed, 09 May 2012 21:26:08 +0000 jas 1886@http://www.datastax.com/support-forums/ <p>Thanks, Rock, that does help. I like to know where I stand. :)</p> <p>BTW, I see you're a forum "Member" like me as opposed to a "Moderator". Do you work for DataStax or just so happen to know these details? :)</p> <p>Thanks,</p> <p>Jeff </p> http://www.datastax.com/support-forums/topic/solr-index-files#post-1878 Wed, 09 May 2012 15:39:58 +0000 Anonymous 1878@http://www.datastax.com/support-forums/ <p>Jeff,</p> <p>Your analysis of how the DSE Solr product works is correct. The index files are stored locally. This produces the maximum query speed possible, and enables taking advantage of new Lucene posting codecs.</p> <p>Optimization of the Lucene / Solr index will help in the read-only case. If updates are frequent, then optimizing will not be beneficial.</p> <p>&gt; Does every node in the ring index the same content and product its own index files?</p> <p>Yes</p> <p>Hope that helps! </p> http://www.datastax.com/support-forums/topic/solr-index-files#post-1865 Mon, 07 May 2012 21:14:43 +0000 jas 1865@http://www.datastax.com/support-forums/ <p>Hi:</p> <p>For whatever reason I thought the DSE 2 Solr indexes were maintained in Cassandra. But in this document:</p> <p><a href="http://www.datastax.com/docs/datastax_enterprise2.0/search/dse_search_cluster#updating-individual-fields-in-a-solr-document" rel="nofollow">http://www.datastax.com/docs/datastax_enterprise2.0/search/dse_search_cluster#updating-individual-fields-in-a-solr-document</a></p> <p>Under "Manage the Location of Solr Data", describes the existence of <code>solr.data</code>. I went there and I see what look like numerous Lucene index files. This indicates to me that the indexes reside within the node's local file system, and not somewhere in Cassandra. I know the equivalently named keyspace and CF in Cassandra has the field data, and the Solr configuration files. Does <code>com.datastax.bdp.cassandra.index.solr.SolrSecondaryIndex</code> place the Lucene indexes themselves in the file system rather than in Cassandra itself?</p> <p>This means the indexes themselves are not distributed and replicated? Does every node in the ring index the same content and product its own index files? I guess that's a form of replication, but it could well exceed the desired replication factor. If I add a node, does it then have to go and index the Solr related CFs?</p> <p>If the indexes are indeed in the file system, then optimizing the index is still useful, right? I have a lot of read-only data indexed, and optimizing pays off well in regular Solr. I figured Cassandra's compaction took care of that, but I guess if the indexes don't reside there, that's not the case.</p> <p>Thanks,</p> <p>Jeff </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered/page/2#post-1857 Mon, 07 May 2012 05:04:06 +0000 Anonymous 1857@http://www.datastax.com/support-forums/ <p>Hi,<br /> Even not directly related to the problem mentioned here i am facing a set of problems with dse search.</p> <p>1. Changes in solrconfig.xml and schema.xml is not relaoding corrcetly until cassandra restart<br /> 2.when we apply autoSoftCommit in solrconfig.xml only id is appearing in index. My analysis shown that somehow its laoding default schema.xml in this case.</p> <p>3. In my scenario we have a field quickserach which is fileld by copyFileds alone.When we use solrJ API ,indexing working fine.But when we use hector apis to insert data into cassandra the iondexing is not working.It works corrcetly if we pass the quickserach explicitely as a column name in hector.beacuse of this we are losing the copyFiled functionality. </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered/page/2#post-1784 Fri, 27 Apr 2012 16:08:35 +0000 tjake 1784@http://www.datastax.com/support-forums/ <p>Yes, however the schema must be compatible with the old </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered/page/2#post-1783 Fri, 27 Apr 2012 16:06:11 +0000 jas 1783@http://www.datastax.com/support-forums/ <p>So I can just run dsetool on the command line w/o taking the node offline etc.? Like Solr, will the current index be used to handle queries while the index is being rebuilt?</p> <p>Thanks,</p> <p>Jeff </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1781 Fri, 27 Apr 2012 15:52:53 +0000 tjake 1781@http://www.datastax.com/support-forums/ <p>Yes you can rebuild the index without removing the index. It will rebuild live. </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1779 Fri, 27 Apr 2012 15:45:56 +0000 jas 1779@http://www.datastax.com/support-forums/ <p>Hi Jake:</p> <p>I tried dsetool a week ago as a desperate attempt. I noticed in the docs that rebuilding indexes using dsetool is presented in the guise of a corrupted index. One takes the node offline, shuts it down, deletes the index directory, restarts, and then uses dsetool to rebuild the index.</p> <p>Is it possible to force reindexing w/o going through all that? I figured it was too good to be true to simply POST a new version of <code>schema.xml</code> and have the existing content reindexed. That obviously won't work for new fields, but not all fields are actually stored (just indexed), and could not be re-indexed with new analysis configurations, adding term offsets and positions etc.</p> <p>I'll be back with some performance data.</p> <p>Jeff </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1776 Fri, 27 Apr 2012 13:10:48 +0000 tjake 1776@http://www.datastax.com/support-forums/ <p>So even when rebuilding the index with dsetool rebuild_index command you saw no affect? </p> <p>What kind of performance are you seeing now? </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1775 Fri, 27 Apr 2012 13:04:10 +0000 jas 1775@http://www.datastax.com/support-forums/ <p>Trying to resolve my highlighting related performance issue in <a href="http://www.datastax.com/support-forums/topic/levers-for-increasing-dse-2-solr-performance" rel="nofollow">http://www.datastax.com/support-forums/topic/levers-for-increasing-dse-2-solr-performance</a>, I figured I'd explicitly re-index my content (POST XML to Solr) and see what happens. As I mentioned earlier, once I got <code>schema.xml</code> w/o errors and no longer saw log messages indicating Solr was reverting to the old highlighter, I assumed the actual term positions and offsets were actually generated based on the content already in Cassandra.</p> <p>I guess that was not the case though. After finding nothing directly applicable to my issue regarding FVH on the web, I decided what the heck, re-index all of the content by posting my existing Solr XML files. Well, I'm getting highlights now with FVH! Unfortunately, they are not lined up properly, but I hope that's something goofy I'm doing that I can more readily resolve. </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1706 Thu, 19 Apr 2012 13:08:30 +0000 tjake 1706@http://www.datastax.com/support-forums/ <p>Yes that's what it would be. </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1704 Thu, 19 Apr 2012 02:55:56 +0000 jas 1704@http://www.datastax.com/support-forums/ <p>Hi Jake:</p> <p>I can see that re-indexing does occur as long as the config files are valid. Will 'thrown upfront' entail an error coming back via the HTTP API in addition to the log?</p> <p>Jeff </p> http://www.datastax.com/support-forums/topic/how-does-solr-re-indexing-get-triggered#post-1703 Thu, 19 Apr 2012 01:08:05 +0000 tjake 1703@http://www.datastax.com/support-forums/ <p>Hi Jeff,</p> <p>It sounds like we didn't catch the error upfront when you posted the new schema. I'll look at this and see if it can be thrown upfront.</p> <p>-Jake </p>