DataStax Support Forums » User Favorites: tjake

DataStax Support Forums » User Favorites: tjake tjake Software, Support, and Training for Apache Cassandra en-US Sat, 25 May 2013 20:51:48 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php bbaribeau on "Can't run Solr wikipedia sample in cluster" http://www.datastax.com/support-forums/topic/cant-run-solr-wikipedia-sample-in-cluster#post-6759 Wed, 03 Oct 2012 19:04:17 +0000 bbaribeau 6759@http://www.datastax.com/support-forums/ Finally got around to getting back to this issue. Turns out changing the stack size 180k fixed the issue. sam on "Can't run Solr wikipedia sample in cluster" http://www.datastax.com/support-forums/topic/cant-run-solr-wikipedia-sample-in-cluster#post-6526 Mon, 17 Sep 2012 07:31:13 +0000 sam 6526@http://www.datastax.com/support-forums/ Going by the system.log files, there seems to be a problem with the schema on one of the nodes. If this is a test of P.O.C. setup, can you nuke the data directory (i.e. /var/lib/cassandra) on both nodes and start over? bbaribeau on "Can't run Solr wikipedia sample in cluster" http://www.datastax.com/support-forums/topic/cant-run-solr-wikipedia-sample-in-cluster#post-6461 Thu, 13 Sep 2012 16:01:16 +0000 bbaribeau 6461@http://www.datastax.com/support-forums/ I've followed the steps on: <a href="http://www.datastax.com/docs/1.0/install/install_jre#install-jre-rh" rel="nofollow">http://www.datastax.com/docs/1.0/install/install_jre#install-jre-rh</a> I'm running 1.6 update 34 from Oracle. I've already had to modify cassandra-env.sh to set the minimum stack size to 160k (the default of 128k generates an error when starting dse). Also I've installed DSE 2.0 if that makes a difference. tjake on "Can't run Solr wikipedia sample in cluster" http://www.datastax.com/support-forums/topic/cant-run-solr-wikipedia-sample-in-cluster#post-6460 Thu, 13 Sep 2012 13:59:33 +0000 tjake 6460@http://www.datastax.com/support-forums/ What JVM are you using? There is a issue in the newest Sun 6/7 JVMs requiring more stack. You can set this in conf/cassandra-env.sh Most people are 180k now. We will update this in the next DSE release. bbaribeau on "Can't run Solr wikipedia sample in cluster" http://www.datastax.com/support-forums/topic/cant-run-solr-wikipedia-sample-in-cluster#post-6459 Thu, 13 Sep 2012 13:05:25 +0000 bbaribeau 6459@http://www.datastax.com/support-forums/ I'm trying to create a DSE cluster of 2 search nodes to run the wikipedia sample. Note that everything works fine if I only use one node. I can successfully install DSE, OpsCenter, and agents are running on both machines. As soon as I run the first script for the wikipedia sample however, my cluster enters a state where only 1 node will ever be up at a time. Restarting one node will cause the other node to crash. They error they produce is: ERROR 08:56:19,241 Fatal exception in thread Thread[WRITE-/192.168.62.204,5,main] java.lang.StackOverflowError at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(Unknown Source) at java.net.SocketOutputStream.write(Unknown Source) at java.io.BufferedOutputStream.flushBuffer(Unknown Source) at java.io.BufferedOutputStream.flush(Unknown Source) at java.io.DataOutputStream.flush(Unknown Source) at org.apache.cassandra.net.OutboundTcpConnection.writeConnected(OutboundTcpConnection.java:123) at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:99) The log files for both nodes can be found at: <a href="https://docs.google.com/open?id=0B56RRVlR8h2MZENKWjBUN0tsbFE" rel="nofollow">https://docs.google.com/open?id=0B56RRVlR8h2MZENKWjBUN0tsbFE</a> Any help as to what's happening would be much appreciated.. jkusar on "Data inserted via CQL does not get run through Solr's copyField directives" http://www.datastax.com/support-forums/topic/data-inserted-via-cql-does-not-get-run-through-solrs-copyfield-directives/page/2#post-4322 Mon, 30 Jul 2012 21:24:55 +0000 jkusar 4322@http://www.datastax.com/support-forums/ Bah, I found my issue. I had some 2.0 binaries floating around in my path mucking things up since this didn't work in 2.0. Got everything cleaned up and it seems to be working now. Thanks! alexliu on "Data inserted via CQL does not get run through Solr's copyField directives" http://www.datastax.com/support-forums/topic/data-inserted-via-cql-does-not-get-run-through-solrs-copyfield-directives/page/2#post-4320 Mon, 30 Jul 2012 20:44:29 +0000 alexliu 4320@http://www.datastax.com/support-forums/ you can try test my example on DSE 2.1. I think it should work there as well. jkusar on "Data inserted via CQL does not get run through Solr's copyField directives" http://www.datastax.com/support-forums/topic/data-inserted-via-cql-does-not-get-run-through-solrs-copyfield-directives/page/2#post-4318 Mon, 30 Jul 2012 20:41:44 +0000 jkusar 4318@http://www.datastax.com/support-forums/ That's very interesting. How much longer till that version is released to the general public? Is it available as a beta anywhere? alexliu on "Data inserted via CQL does not get run through Solr's copyField directives" http://www.datastax.com/support-forums/topic/data-inserted-via-cql-does-not-get-run-through-solrs-copyfield-directives/page/2#post-4314 Mon, 30 Jul 2012 20:32:55 +0000 alexliu 4314@http://www.datastax.com/support-forums/ This is working in the incoming release, I am not sure DSE 2.1 the following is result that I run cqlsh> use ks33; cqlsh:ks33> insert into cf3 (key,title,body) values ('12345','This is a title','This is some body text'); cqlsh:ks33> select * from cf3; KEY | body | title -------+------------------------+----------------- 12345 | This is some body text | This is a title cqlsh:ks33> select * from cf3 where solr_query='text1:is'; KEY | body | title -------+------------------------+----------------- 12345 | This is some body text | This is a title cqlsh:ks33> select * from cf3 where solr_query='text1:body'; KEY | body | title -------+------------------------+----------------- 12345 | This is some body text | This is a title schema.xml <?xml version="1.0" encoding="UTF-8" ?> <schema name="wikipedia" version="1.1"> <types> <fieldType name="string" class="solr.StrField"/> <fieldType name="text" class="solr.TextField"> <analyzer><tokenizer class="solr.WikipediaTokenizerFactory"/></analyzer> </fieldType> </types> <fields> <field name="id" type="string" indexed="true" stored="true"/> <field name="name" type="text" indexed="true" stored="true"/> <field name="body" type="text" indexed="true" stored="true"/> <field name="title" type="text" indexed="true" stored="true"/> <field name="date" type="string" indexed="true" stored="true"/> <field name="text1" type="text" indexed="true" stored="true" multiValued="true"/> </fields> <defaultSearchField>body</defaultSearchField> <uniqueKey>id</uniqueKey> <copyField source="body" dest="text1"/> <copyField source="title" dest="text1"/> </schema> alexliu on "How do I update Hive table when columns are added to Cassandra?" http://www.datastax.com/support-forums/topic/how-do-i-update-hive-table-when-columns-are-added-to-cassandra#post-4283 Mon, 30 Jul 2012 17:14:11 +0000 alexliu 4283@http://www.datastax.com/support-forums/ Drop HiveMetaStore keyspace and MetaStore column family. Then restart DSE, restart HIVE, you should have a fresh start. jonusko on "How do I update Hive table when columns are added to Cassandra?" http://www.datastax.com/support-forums/topic/how-do-i-update-hive-table-when-columns-are-added-to-cassandra#post-3916 Thu, 26 Jul 2012 21:34:11 +0000 jonusko 3916@http://www.datastax.com/support-forums/ Yes. I was starting/stopping cqlsh and dse hive from the same shell prompt and never had them running at the same time. I tried a lot of things to make this work, one of them was to delete the Hive database definition in the HiveMetaStore.MetaStore. I only deleted the one row in the MetaStore that corresponded with my Hive database. Now, Hive will no longer run properly. When I try to "use" any database in Hive, I get an OutOfMemoryError: GC overhead limit reached. I tried restarting dse cassandra and dse hive, but Hive still is broken. Is there anyway to fix Hive? tjake on "How do I update Hive table when columns are added to Cassandra?" http://www.datastax.com/support-forums/topic/how-do-i-update-hive-table-when-columns-are-added-to-cassandra#post-3909 Thu, 26 Jul 2012 20:02:44 +0000 tjake 3909@http://www.datastax.com/support-forums/ Did you restart Hive before #6? jonusko on "How do I update Hive table when columns are added to Cassandra?" http://www.datastax.com/support-forums/topic/how-do-i-update-hive-table-when-columns-are-added-to-cassandra#post-3906 Thu, 26 Jul 2012 19:44:38 +0000 jonusko 3906@http://www.datastax.com/support-forums/ If I define all the columns for a column family in Cassandra, I see that they are automatically defined in Hive. If I use ALTER TABLE to add a column in Cassandra, this column does not get added to the Hive metastore thus it is not visible to Hive. Hive does not let me modify an external table. So how do I get my Hive table back in sync with the Cassandra column family? Steps to reproduce: 1) Create table in cqlsh. 2) Insert row in table using cqlsh. 3) Select row in Hive to verify the data. 4) Alter table in cqlsh and add a new column. 5) Update new column with a value in cqlsh. 6) Select row in Hive to verify the new column's data. In step #6, select * does not return the new column and select newColumn returns an error. jkusar on "Data inserted via CQL does not get run through Solr's copyField directives" http://www.datastax.com/support-forums/topic/data-inserted-via-cql-does-not-get-run-through-solrs-copyfield-directives/page/2#post-3897 Thu, 26 Jul 2012 18:07:23 +0000 jkusar 3897@http://www.datastax.com/support-forums/ Ok, here's some steps to reproduce the problem. First modify the wikipedia schema as follows: <pre><code><schema name="wikipedia" version="1.1"> <types> <fieldType name="string" class="solr.StrField"/> <fieldType name="text" class="solr.TextField"> <analyzer><tokenizer class="solr.WikipediaTokenizerFactory"/></analyzer> </fieldType> </types> <fields> <field name="id" type="string" indexed="true" stored="true"/> <field name="body" type="text" indexed="true" stored="true"/> <field name="text" type="text" indexed="true" stored="true" multiValued="true"/> <field name="title" type="text" indexed="true" stored="true"/> <field name="date" type="string" indexed="true" stored="true"/> </fields> <defaultSearchField>text</defaultSearchField> <uniqueKey>id</uniqueKey> <copyField source="body" dest="text"/> <copyField source="title" dest="text"/> </schema></code></pre> Run the add schema script. From cqlsh add a record: <code>cqlsh:wiki> insert into solr (key,title,body) values ('12345','This is a title','This is some body text');</code> Now from the solr admin tool, query for body. You will get nothing as it is searching the 'text' field and nothing has been copied to it. If you instead search for body:body (search for body within the body field), you get your record back. The copyField is definitely not happening. This is running a single solr node. The keyspace is using SimpleStrategy with RF=1. jkusar on "Data inserted via CQL does not get run through Solr's copyField directives" http://www.datastax.com/support-forums/topic/data-inserted-via-cql-does-not-get-run-through-solrs-copyfield-directives/page/2#post-3896 Thu, 26 Jul 2012 17:47:40 +0000 jkusar 3896@http://www.datastax.com/support-forums/ I'm not using dynamic fields. All nodes are Solr. My schema is posted in another recent thread about copyField.