http://www.datastax.com/support-forums/topic/sequencing-how-to-replace-auto_increment Software, Support, and Training for Apache Cassandra en-US Fri, 24 May 2013 17:33:31 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/sequencing-how-to-replace-auto_increment#post-8670 Fri, 25 Jan 2013 17:06:38 +0000 ethrbunny 8670@http://www.datastax.com/support-forums/ <p>One sticking point to my adopting Cassandra for our research is the question of how to set 'milestones' or 'markers' in data and do 'retrieve all since last marker'. In MySQL I use an auto_increment column and just select for everything greater than a known point.</p> <p>Situation: we collect and store sensor data. Its hundreds of millions of records x hundreds of locations. The data comes in as 'raw' and has to be processed several times over. To this end I keep pointers of 'what have I looked at'. </p> <p>How could I implement this in Cassandra given the 'eventual consistency' model? I've pondered date/time/mSec/sensor keys and even putting a 'seen'/'not seen' bit on each piece of sensor data. </p> <p>Any suggestions on how this could be implemented? </p>