Support Forums : DataStax

Data in Cassandra grows too fast

(4 posts) (2 voices)

Tags:

No tags yet.

Harry.deng
Member

Hi,
I use the brisk to deal with many smail text file, but I find the data in Cassandra grows too fast, any ideas? Thanks.

Each hour I upload 10+ file, eahc file < 300K, total < 800K, than run some hive to output files, it runs for 30 days, after that, I find the Data in Cassandra is grows more than 21 G ??

0.8M * 24 * 30 = 574 M

Posted 8 months ago #
Harry.deng
Member

I upload the file doesn't grow the Cassandra Data, but after run the job. the Data in Cassandra grows about 90 M, Any idea ?

Posted 8 months ago #
thobbs
Administrator

This post should explain the issue: http://www.datastax.com/dev/blog/new-in-datastax-enterprise-2-1-improved-compaction-strategy-to-boost-analytical-processing-performance

Brisk used the older compaction strategy, which can result in the data size growing like you've seen. Recent versions of DataStax Enterprise do not have this issue.

Posted 8 months ago #
Harry.deng
Member

Thank you very much, can we use strategy in the brisk or we have to use DataStax Enterprise?

Posted 8 months ago #