CQL pushdown filter
Optimize the processing of the data by moving filtering expressions in Pig as close to the data source as possible.
Create an index for the Cassandra table.
For Pig pushdown filtering, the index must have the same name as the column being indexed.
Include the use_secondary option with a value of true in the url format for the storage handler. The option name reflects the term that used to be used for a Cassandra index: secondary index. For example:
newdata = LOAD 'cql://ks/cf_300000_keys_50_cols?use_secondary=true' USING CqlStorage(); -- DataStax Enterprise 4.0 - 4.0.3 newdata = LOAD 'cql://ks/cf_300000_keys_50_cols?use_secondary=true' USING CqlNativeStorage(); -- DataStax Enterprise 4.0.4
Attention: Be sure this document version matches your product version!