http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average Software, Support, and Training for Apache Cassandra en-US Fri, 24 May 2013 23:27:36 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1049 Wed, 11 Jan 2012 00:19:08 +0000 thobbs 1049@http://www.datastax.com/support-forums/ <p>I should also add that it's likely that you should think about changing your data model. There are probably other models that would work better than using 800 separate CFs, and would have lower overhead. </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1048 Wed, 11 Jan 2012 00:19:00 +0000 kirktrue 1048@http://www.datastax.com/support-forums/ <p>Well, it's those CFs that I want to get metrics on :) I'll try disabling them temporarily and see if it helps.</p> <p>Thanks. </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1047 Wed, 11 Jan 2012 00:17:43 +0000 thobbs 1047@http://www.datastax.com/support-forums/ <p>Having 800 CFs will definitely have a performance impact on OpsCenter and will result in quite a bit of metric data being stored in your cluster. You should probably disable the collection of metrics on those CFs. In <code>opscenterd.conf</code>, this can be done by setting either <code>ignored_keyspaces</code> or <code>ignored_column_familes</code> under <code>[cassandra_metrics]</code>. </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1046 Wed, 11 Jan 2012 00:09:39 +0000 kirktrue 1046@http://www.datastax.com/support-forums/ <p>Also, we have ~800 column families in our schema. Would the number of CFs have such an effect on OpsCenter? </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1045 Wed, 11 Jan 2012 00:08:46 +0000 kirktrue 1045@http://www.datastax.com/support-forums/ <p>Nothing particularly interesting in the logs apart from the memory usage is growing way too fast:</p> <p><code><br /> 2012-01-10 09:38:28-0800 [] DEBUG: Average opscenterd CPU usage: 46.38%, max resident: 107 MB<br /> 2012-01-10 10:00:28-0800 [] DEBUG: Average opscenterd CPU usage: 99.87%, max resident: 1267 MB<br /> 2012-01-10 11:00:29-0800 [] DEBUG: Average opscenterd CPU usage: 99.88%, max resident: 2873 MB<br /> 2012-01-10 12:00:34-0800 [] DEBUG: Average opscenterd CPU usage: 99.94%, max resident: 3680 MB<br /> 2012-01-10 13:00:29-0800 [] DEBUG: Average opscenterd CPU usage: 99.72%, max resident: 4330 MB<br /> 2012-01-10 14:00:33-0800 [] DEBUG: Average opscenterd CPU usage: 99.91%, max resident: 4835 MB<br /> 2012-01-10 15:00:29-0800 [] DEBUG: Average opscenterd CPU usage: 99.83%, max resident: 5264 MB<br /> 2012-01-10 16:00:28-0800 [] DEBUG: Average opscenterd CPU usage: 99.56%, max resident: 5640 MB<br /> </code> </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1040 Tue, 10 Jan 2012 20:23:18 +0000 thobbs 1040@http://www.datastax.com/support-forums/ <p>Kirk,</p> <p>It sounds like something has gone seriously wrong with opscenterd. Can you check the opscenterd log (by default at /var/log/opscenter/opscenterd.log if you installed from a package) to see what's going on?</p> <p>(The red 'X' indicates that your browser is having trouble communicating with the opscenterd webserver.) </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-1039 Tue, 10 Jan 2012 16:58:00 +0000 kirktrue 1039@http://www.datastax.com/support-forums/ <p>I'm using Apache's Cassandra 1.0.5 and OpsCenter 1.3.1.</p> <p>It takes about 1-2 minutes for the UI to start up and we routinely get time out errors in the UI.</p> <p>Python (running the OpsCenter web application) is constantly sitting at 100% CPU on an 8 core box with 12 GB of RAM.</p> <p>There's a little connection icon in the top-right corner of the UI and it starts flashing a little red 'X' over the cable.</p> <p>Any ideas? </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-378 Thu, 28 Jul 2011 10:04:03 +0000 jsevellec 378@http://www.datastax.com/support-forums/ <p>Ok thanks</p> <p>I'm going to try it. </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-359 Wed, 27 Jul 2011 20:37:15 +0000 mbulman 359@http://www.datastax.com/support-forums/ <p>We just released a new version of OpsCenter that fixes some performance issues we found. You can view the release notes here: <a href="http://www.datastax.com/docs/opscenter/release_notes#opscenter-1-2-1" rel="nofollow">http://www.datastax.com/docs/opscenter/release_notes#opscenter-1-2-1</a>. Let us know if that doesn't solve your issues. </p> http://www.datastax.com/support-forums/topic/opscenter-takes-a-lot-of-cpu-memory-and-cause-high-load-average#post-356 Wed, 27 Jul 2011 07:44:55 +0000 jsevellec 356@http://www.datastax.com/support-forums/ <p>Hi,</p> <p>OpsCenter is up on my cluster for 2 Days.</p> <p>It is installed on one of my cassandra node (I knows it not a good idea but it's for test)<br /> It now takes a lot of CPU, memory and cause high load average. My cassandra node (where the opscenter is) crash... </p> <p>Have you ever seen this behavior?</p> <p>My OpsCenter is "out of the box". Is there some configurations or tuning to improve it all? </p>