DataStax Support Forums » Topic: Solr dynamic field causing cassandra error on dse 2.2

DataStax Support Forums » Topic: Solr dynamic field causing cassandra error on dse 2.2 http://www.datastax.com/support-forums/topic/solr-dynamic-field-causing-cassandra-error-on-dse-22 Software, Support, and Training for Apache Cassandra en-US Tue, 21 May 2013 04:02:22 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php jpayne97 on "Solr dynamic field causing cassandra error on dse 2.2" http://www.datastax.com/support-forums/topic/solr-dynamic-field-causing-cassandra-error-on-dse-22#post-7809 Tue, 04 Dec 2012 13:00:59 +0000 jpayne97 7809@http://www.datastax.com/support-forums/ That is what the problem was. The strange thing is someone else at work has a keyspace with a column family setup to be bytestype with dynamic fields and his works fine. That is why we couldn't figure out why mine wasn't working. Thanks. sam on "Solr dynamic field causing cassandra error on dse 2.2" http://www.datastax.com/support-forums/topic/solr-dynamic-field-causing-cassandra-error-on-dse-22#post-7800 Tue, 04 Dec 2012 11:19:09 +0000 sam 7800@http://www.datastax.com/support-forums/ What is the default validator for the column family? The Solr/Cassandra handler in DSE is trying to insert the value "test" from the img_1 field into a new column (also named img_1) in Cassandra. If this column isn't pre-defined in the column family schema, it will be validated using the default validator for the column family (which appears to be BytesType). Changing the default validator to UTF8Type should avoid this error and permit string values, but if you add other dynamic fields whose values don't conform to UTF8Type's validation rules, you'll encounter similar issues. jpayne97 on "Solr dynamic field causing cassandra error on dse 2.2" http://www.datastax.com/support-forums/topic/solr-dynamic-field-causing-cassandra-error-on-dse-22#post-7786 Mon, 03 Dec 2012 20:29:23 +0000 jpayne97 7786@http://www.datastax.com/support-forums/ Trying to do a simple add to solr, but every time I get an error back when I have a dynamic field in the add. Works without the dynamic field. If I view the schema through the solr schema browser, it loads it as expected. Basic default solrconfig.xml is used. In the error below it mentions wanting the data to be hex, which if I do change my text in the dynamic field to be a hex string, it works, but thats not what I want to store there. Keyspace is setup as: Settings replica_placement_strategy org.apache.cassandra.locator.NetworkTopologyStrategy Replication Strategy Options Solr 1 ERROR: org.apache.cassandra.db.marshal.MarshalException: cannot parse 'test' as hex bytes at org.apache.cassandra.db.marshal.BytesType.fromString(BytesType.java:74) at com.datastax.bdp.cassandra.index.solr.CassandraDirectUpdateHandler2.addDoc(CassandraDirectUpdateHandler2.java:288) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:133) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:78) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1460) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:353) at com.datastax.bdp.cassandra.index.solr.CassandraDispatchFilter.execute(CassandraDispatchFilter.java:190) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:248) at com.datastax.bdp.cassandra.index.solr.CassandraDispatchFilter.doFilter(CassandraDispatchFilter.java:151) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Unknown Source) Caused by: java.lang.NumberFormatException: Non-hex characters in test at org.apache.cassandra.utils.Hex.hexToBytes(Hex.java:60) at org.apache.cassandra.db.marshal.BytesType.fromString(BytesType.java:70) ... 24 more schema.xml <?xml version="1.0" encoding="UTF-8" ?> <schema name="item" version="1.5"> <types> <fieldType name="string" class="solr.StrField" sortMissingLast="true" />  <fieldType name="text_ws" class="solr.TextField" positionIncrementGap="100"> <analyzer> <tokenizer class="solr.WhitespaceTokenizerFactory"/> </analyzer> </fieldType> <fieldType name="text" class="solr.TextField" positionIncrementGap="100"> <analyzer type="index"> <tokenizer class="solr.StandardTokenizerFactory"/>   <filter class="solr.LowerCaseFilterFactory"/> </analyzer> <analyzer type="query"> <tokenizer class="solr.StandardTokenizerFactory"/>   <filter class="solr.LowerCaseFilterFactory"/> </analyzer> </fieldType> <fieldType name="ignored" stored="false" indexed="false" multiValued="true" class="solr.StrField" /> </types> <fields> <field name="id" type="string" indexed="true" stored="true" required="true" multiValued="false" /> <field name="upc" type="string" indexed="true" stored="true" /> <field name="labelDesc" type="text" indexed="true" stored="true" /> <field name="longDesc" type="text" indexed="true" stored="true" /> <field name="commonName" type="text" indexed="true" stored="true" /> <field name="consumerSize" type="string" indexed="false" stored="true" /> <field name="consumerSizeUom" type="string" indexed="false" stored="true" /> <field name="consumerPkgType" type="string" indexed="false" stored="true" /> <field name="manufacturer" type="string" indexed="false" stored="true" /> <field name="brandName" type="string" indexed="false" stored="true" /> <field name="fmlyTreePrimDept" type="string" indexed="false" stored="true" /> <field name="fmlyTreeRcpDept" type="string" indexed="false" stored="true" /> <field name="fmlyTreeDept" type="string" indexed="false" stored="true" /> <field name="fmlyTreeCmdty" type="string" indexed="false" stored="true" /> <field name="fmlyTreeSubCmdty" type="string" indexed="false" stored="true" /> <dynamicField name="img_*" type="string" indexed="false" stored="true" />  </fields> <defaultSearchField>labelDesc</defaultSearchField> <uniqueKey>id</uniqueKey> </schema> example add <add> <doc boost="1.0"> <field name="id">00005210000150</field> <field name="upc">00005210000150</field> <field name="labelDesc">MCCORMICK GRILL MATES SPICY MONTREAL STEAK</field> <field name="longDesc"/> <field name="commonName">SPICES SEASONINGS STEAK SPICE</field> <field name="consumerSize">3.12</field> <field name="consumerSizeUom">OZ</field> <field name="consumerPkgType">SHAKER</field> <field name="manufacturer">MCCORMICK</field> <field name="brandName">MCCORMICK</field> <field name="fmlyTreePrimDept">GROCERY</field> <field name="fmlyTreeRcpDept">GROCERY</field> <field name="fmlyTreeDept">GROCERY</field> <field name="fmlyTreeCmdty">SPICES & EXTRACTS</field> <field name="fmlyTreeSubCmdty"/> <field name="img_1">test</field> </doc> </add>