DataStax Support Forums » Forum: OpsCenter

DataStax Support Forums » Forum: OpsCenter - Recent Posts http://www.datastax.com/support-forums/forum/opscenter Software, Support, and Training for Apache Cassandra en-US Tue, 21 May 2013 14:24:47 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php mbulman on "OpsCenter 3.1 Upgrade Failure" http://www.datastax.com/support-forums/topic/opscenter-31-upgrade-failure#post-11236 Mon, 20 May 2013 02:45:34 +0000 mbulman 11236@http://www.datastax.com/support-forums/ @troper: Thanks for the info. Just wanted to let you know that we were able to reproduce your issue, and will have a patch release out very soon to address it. We'll update this thread once that's available. mbulman on "Start Errored: Timed out waiting for Cassandra to start." http://www.datastax.com/support-forums/topic/start-errored-timed-out-waiting-for-cassandra-to-start#post-11160 Thu, 16 May 2013 22:43:20 +0000 mbulman 11160@http://www.datastax.com/support-forums/ When you say "there is no information there" for system.log, do you mean the file is empty? Is the Cassandra/DSE process running? If it is, make sure you can 'telnet <ip> 9160' to verify that the thrift server is running properly. joaquin on "DataStax AMI not working" http://www.datastax.com/support-forums/topic/datastax-ami-not-working#post-11152 Thu, 16 May 2013 18:18:32 +0000 joaquin 11152@http://www.datastax.com/support-forums/ Hello gdelgado, The error message is letting you know what is occurring: EC2 is experiencing large latency on their end by not having the clusters spin up in 10 minutes. Perhaps you should try other regions and/or availability zones, but ultimately waiting for the EC2 latency to die down will fix the issue. Thanks, Joaquin gdelgado on "Start Errored: Timed out waiting for Cassandra to start." http://www.datastax.com/support-forums/topic/start-errored-timed-out-waiting-for-cassandra-to-start#post-11146 Thu, 16 May 2013 14:02:55 +0000 gdelgado 11146@http://www.datastax.com/support-forums/ I checked /var/log/cassandra/system.log but there is no information there. I also checked /var/log/opscenter-agent/agent.log and I found the output below. INFO [Initialization] 2013-05-16 13:58:03,169 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 13:58:23,170 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 13:58:23,170 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 13:58:43,170 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 13:58:43,171 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 13:59:03,171 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 13:59:03,172 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 13:59:23,172 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 13:59:23,172 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 13:59:43,173 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 13:59:43,173 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 14:00:03,174 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 14:00:03,174 Sleeping for 20s before trying to determine IP over JMX again INFO [Initialization] 2013-05-16 14:00:23,174 Node is still provisioning, not attempting to determine ip. INFO [Initialization] 2013-05-16 14:00:23,175 Sleeping for 20s before trying to determine IP over JMX again gdelgado on "DataStax AMI not working" http://www.datastax.com/support-forums/topic/datastax-ami-not-working#post-11145 Thu, 16 May 2013 13:26:07 +0000 gdelgado 11145@http://www.datastax.com/support-forums/ I am using following article to launch the pre-configured DataStax AMI <a href="http://www.datastax.com/docs/datastax_enterprise3.0/install/install_dse_ami" rel="nofollow">http://www.datastax.com/docs/datastax_enterprise3.0/install/install_dse_ami</a>. I have tried to launch the AMI twice and have gotten the same result I get the following error telling me to check the ami.log file for errors. when I check the log i get the message below. [ERROR] EC2 is experiencing some issues and has not allocated all of the resources in u$ in under 10 minutes Aborting the clustering of this reservation. Please try again. [ERROR] Exception seen in ds1_launcher.py: Traceback (most recent call last): File "/home/ubuntu/datastax_ami/ds1_launcher.py", line 31, in initial_configurations ds2_configure.run() File "/home/ubuntu/datastax_ami/ds2_configure.py", line 945, in run File "/home/ubuntu/datastax_ami/ds2_configure.py", line 385, in get_seed_list File "/home/ubuntu/datastax_ami/ds2_configure.py", line 55, in exit_path AttributeError mbulman on "Start Errored: Timed out waiting for Cassandra to start." http://www.datastax.com/support-forums/topic/start-errored-timed-out-waiting-for-cassandra-to-start#post-11142 Thu, 16 May 2013 12:58:36 +0000 mbulman 11142@http://www.datastax.com/support-forums/ We've recently added a troubleshooting page for Create Cluster/Add Nodes to our OpsCenter docs: <a href="http://www.datastax.com/docs/opscenter/trouble_shooting_opsc#provisioning" rel="nofollow">http://www.datastax.com/docs/opscenter/trouble_shooting_opsc#provisioning</a> As the first step, you'll want to check /var/log/cassandra/system.log on each node for any errors. Let us know if you run into any other issues. gdelgado on "Start Errored: Timed out waiting for Cassandra to start." http://www.datastax.com/support-forums/topic/start-errored-timed-out-waiting-for-cassandra-to-start#post-11106 Thu, 16 May 2013 03:31:11 +0000 gdelgado 11106@http://www.datastax.com/support-forums/ I am evaluating DataStax Enterprise 3.1.0 I was able to install the OpsCenter server but when trying to add nodes to the cluster I get the following error "Start Errored: Timed out waiting for Cassandra to start." I have both servers in the same security group in AWS. Any help would be appreciated.. Thanks.. troper on "OpsCenter 3.1 Upgrade Failure" http://www.datastax.com/support-forums/topic/opscenter-31-upgrade-failure#post-10984 Mon, 13 May 2013 23:01:03 +0000 troper 10984@http://www.datastax.com/support-forums/ Thanks for taking a look for me! ----------------------------------------------------- CREATE KEYSPACE test_beta WITH strategy_class = 'NetworkTopologyStrategy' AND strategy_options:analytics = '1'; USE test_beta; CREATE TABLE cf_test ( tracked_asset_id int, time 'ReversedType(org.apache.cassandra.db.marshal.DateType)', floorplan_id int, tag_description text, tag_id text, tracked_asset_description text, zone_code text, PRIMARY KEY (tracked_asset_id, time) ) WITH comment='' AND caching='KEYS_ONLY' AND read_repair_chance=0.100000 AND gc_grace_seconds=864000 AND replicate_on_write='true' AND compaction_strategy_class='SizeTieredCompactionStrategy' AND compression_parameters:sstable_compression='SnappyCompressor'; nickmbailey on "OpsCenter 3.1 Upgrade Failure" http://www.datastax.com/support-forums/topic/opscenter-31-upgrade-failure#post-10980 Mon, 13 May 2013 17:33:33 +0000 nickmbailey 10980@http://www.datastax.com/support-forums/ Can you provide the output of 'describe schema' from cqlsh? troper on "OpsCenter 3.1 Upgrade Failure" http://www.datastax.com/support-forums/topic/opscenter-31-upgrade-failure#post-10890 Fri, 10 May 2013 20:04:03 +0000 troper 10890@http://www.datastax.com/support-forums/ I am running a 3 node development cluster on AWS EC2 using the Datastax AMI. DSE 3.0.1, Cassandra 1.1.9.3. I upgraded to OpsCenter 3.1. I restarted OpsCenter, clicked "fix" agents, entered credentials and refeshed. All agents connected. OpsCenter loads, but no keyspaces are visible and the error "Error loading alerts: Alerts have not been loaded yet. There may be a connectivity problem with Cassandra" is displayed. My column families were created with CQL3 and use compound primary keys. I cannot see any schema info after the upgrade. I would appreciate any ideas on how to resolve this issue! Log entries: 2013-04-29 18:57:06+0000 [] INFO: Testing SSH connectivity to 10.115.11.199, 10.218.41.204, 10.78.222.11 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 2048 09:47:46:51:d5:f9:30:f2:56:7f:dc:56:d6:18:de:a0 _ (RSA) for 10.218.41.204 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 256 49:ad:ca:6b:1b:17:8f:f6:8e:3b:8a:c6:7e:3c:aa:e5 _ (ECDSA) for 10.218.41.204 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 1024 c8:97:cf:53:3c:aa:e3:c4:74:92:2e:92:7d:0b:31:1f _ (DSA) for 10.218.41.204 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 2048 d7:fa:27:c5:8a:da:3b:69:00:8b:31:87:93:1a:a7:3b _ (RSA) for 10.78.222.11 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 2048 ae:6f:39:a2:37:9d:ea:75:94:f7:09:9e:b5:d7:05:1a _ (RSA) for 10.115.11.199 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 256 e2:9d:2d:f1:fe:2e:86:7b:b3:f5:4a:81:bf:59:fe:d1 _ (ECDSA) for 10.78.222.11 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 1024 aa:d8:90:28:2b:9f:8d:df:84:86:9d:c7:32:4c:a7:fb _ (DSA) for 10.78.222.11 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 256 6c:b4:e1:2b:36:d5:ac:6c:a7:25:b4:77:61:fc:d1:ae _ (ECDSA) for 10.115.11.199 2013-04-29 18:57:07+0000 [] INFO: Obtained fingerprint 1024 c8:93:7b:67:d0:04:14:ea:cd:26:56:6f:ac:27:6e:58 _ (DSA) for 10.115.11.199 2013-04-29 18:57:08+0000 [] INFO: Testing SSH connectivity to 10.115.11.199, 10.218.41.204, 10.78.222.11 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 2048 09:47:46:51:d5:f9:30:f2:56:7f:dc:56:d6:18:de:a0 _ (RSA) for 10.218.41.204 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 2048 d7:fa:27:c5:8a:da:3b:69:00:8b:31:87:93:1a:a7:3b _ (RSA) for 10.78.222.11 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 256 49:ad:ca:6b:1b:17:8f:f6:8e:3b:8a:c6:7e:3c:aa:e5 _ (ECDSA) for 10.218.41.204 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 2048 ae:6f:39:a2:37:9d:ea:75:94:f7:09:9e:b5:d7:05:1a _ (RSA) for 10.115.11.199 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 256 e2:9d:2d:f1:fe:2e:86:7b:b3:f5:4a:81:bf:59:fe:d1 _ (ECDSA) for 10.78.222.11 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 1024 c8:97:cf:53:3c:aa:e3:c4:74:92:2e:92:7d:0b:31:1f _ (DSA) for 10.218.41.204 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 256 6c:b4:e1:2b:36:d5:ac:6c:a7:25:b4:77:61:fc:d1:ae _ (ECDSA) for 10.115.11.199 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 1024 aa:d8:90:28:2b:9f:8d:df:84:86:9d:c7:32:4c:a7:fb _ (DSA) for 10.78.222.11 2013-04-29 18:57:09+0000 [] INFO: Obtained fingerprint 1024 c8:93:7b:67:d0:04:14:ea:cd:26:56:6f:ac:27:6e:58 _ (DSA) for 10.115.11.199 2013-04-29 18:57:09+0000 [DEV_CLUSTER] INFO: Beginning install of OpsCenter agent to 10.115.11.199 2013-04-29 18:57:09+0000 [DEV_CLUSTER] INFO: Installing debian package on 10.115.11.199 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Beginning install of OpsCenter agent to 10.218.41.204 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Beginning install of OpsCenter agent to 10.78.222.11 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Version: {'search': None, 'dse': '3.0.1', 'tasktracker': None, 'jobtracker': None, 'cassandra': '1.1.9.3'} 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Node 10.115.11.199 changed its mode to normal 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Using 10.115.11.199 as the RPC address for node 10.115.11.199 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Using 10.115.11.199 as the RPC address for node 10.115.11.199 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Installing debian package on 10.218.41.204 2013-04-29 18:57:24+0000 [DEV_CLUSTER] INFO: Installing debian package on 10.78.222.11 2013-04-29 18:57:38+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-04-29 18:57:38+0000 [DEV_CLUSTER] INFO: Node 10.78.222.11 changed its mode to normal 2013-04-29 18:57:38+0000 [DEV_CLUSTER] INFO: Using 10.78.222.11 as the RPC address for node 10.78.222.11 2013-04-29 18:57:38+0000 [DEV_CLUSTER] INFO: Using 10.78.222.11 as the RPC address for node 10.78.222.11 2013-04-29 18:57:40+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-04-29 18:57:40+0000 [DEV_CLUSTER] INFO: Using 10.218.41.204 as the RPC address for node 10.218.41.204 2013-04-29 18:57:40+0000 [DEV_CLUSTER] INFO: Node 10.218.41.204 changed its mode to normal 2013-04-29 18:57:40+0000 [DEV_CLUSTER] INFO: Using 10.218.41.204 as the RPC address for node 10.218.41.204 2013-04-29 20:52:01+0000 [] INFO: No handlers could be found for logger "xhtml2pdf" 2013-04-30 13:06:15+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-04-30 13:06:15+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-04-30 13:06:15+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-01 14:59:03+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-01 14:59:03+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-01 14:59:03+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-01 21:42:33+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-01 21:42:33+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 21:44:59+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-01 21:44:59+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 21:54:52+0000 [] ERROR: Problem while calling CFDataController: unpack requires a string argument of length 8 2013-05-01 21:54:52+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 21:54:52+0000 [] ERROR: Problem while calling CFDataController: unpack requires a string argument of length 8 2013-05-01 21:54:52+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 21:56:42+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-01 21:56:42+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 22:03:42+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-01 22:03:42+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 22:18:07+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-01 22:18:07+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-01 22:18:07+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-01 22:18:07+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-02 14:07:12+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-02 14:07:12+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-02 14:07:12+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-02 14:09:30+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-02 14:09:30+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-02 15:34:25+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-02 15:34:25+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-02 15:36:44+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-02 15:36:44+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-02 16:08:10+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-02 16:08:10+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-02 16:08:10+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-02 16:08:10+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-02 17:50:35+0000 [] ERROR: Problem while calling CFDataController: year is out of range 2013-05-02 17:50:35+0000 [] ERROR: File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 845, in getCFPage File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 753, in _unpack_rows File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 771, in _unpack_columns File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 785, in _unpack_col File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftVals.py", line 334, in unpack_date 2013-05-03 02:07:44+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-03 02:07:44+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-03 02:07:44+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-03 14:07:45+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-03 14:07:45+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-03 14:07:45+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-04 02:08:20+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-04 02:08:20+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-04 02:08:20+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-04 14:08:27+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-04 14:08:27+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-04 14:08:27+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-05 02:08:37+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-05 02:08:37+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-05 02:08:37+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-05 14:08:48+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-05 14:08:48+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-05 14:08:48+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-06 02:08:53+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-06 02:08:53+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-06 02:08:53+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-06 14:08:54+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-06 14:08:54+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-06 14:08:54+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-07 02:09:47+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-07 02:09:47+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-07 02:09:47+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-07 15:42:19+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-07 15:42:19+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-07 15:42:19+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-08 15:06:24+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-08 15:06:24+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-08 15:06:24+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-10 18:12:27+0000 [DEV_CLUSTER] INFO: Agent for ip 10.78.222.11 is version u'3.0.2' 2013-05-10 18:12:27+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-10 18:12:28+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-10 19:32:19+0000 [] INFO: Received SIGTERM, shutting down. 2013-05-10 19:32:19+0000 [DEV_CLUSTER] INFO: OpsCenter shutting down. 2013-05-10 19:32:19+0000 [] INFO: (TCP Port 61620 Closed) 2013-05-10 19:32:19+0000 [] INFO: (TCP Port 61619 Closed) 2013-05-10 19:32:19+0000 [] INFO: Stopping factory <morbid.morbid.StompFactory instance at 0x2e2e128> 2013-05-10 19:32:19+0000 [] INFO: (TCP Port 8888 Closed) 2013-05-10 19:32:19+0000 [] INFO: Stopping factory <opscenterd.WebServer.OpsCenterdWebServer instance at 0x2e28440> 2013-05-10 19:32:19+0000 [DEV_CLUSTER] INFO: Stopping CassandraCluster service 2013-05-10 19:32:19+0000 [DEV_CLUSTER] INFO: OpsCenter shutting down. 2013-05-10 19:32:19+0000 [] INFO: Main loop terminated. 2013-05-10 19:32:19+0000 [] INFO: Server Shut Down. 2013-05-10 19:32:27+0000 [] INFO: Log opened. 2013-05-10 19:32:27+0000 [] INFO: twistd 10.2.0 (/usr/bin/python2.7 2.7.3) starting up. 2013-05-10 19:32:27+0000 [] INFO: reactor class: twisted.internet.selectreactor.SelectReactor. 2013-05-10 19:32:27+0000 [] INFO: set uid/gid 0/0 2013-05-10 19:32:27+0000 [] INFO: Logging level set to 'info' 2013-05-10 19:32:27+0000 [] INFO: OpsCenter version: 3.1.0 2013-05-10 19:32:27+0000 [] INFO: Compatible agent version: 3.1.0 2013-05-10 19:32:27+0000 [] INFO: Loading per-cluster config file /etc/opscenter/clusters/DEV_CLUSTER.conf 2013-05-10 19:32:27+0000 [] INFO: HTTP BASIC authentication disabled 2013-05-10 19:32:27+0000 [] INFO: Starting webserver with ssl disabled. 2013-05-10 19:32:27+0000 [] INFO: SSL agent communication enabled 2013-05-10 19:32:27+0000 [] INFO: opscenterd.WebServer.OpsCenterdWebServer starting on 8888 2013-05-10 19:32:27+0000 [] INFO: Starting factory <opscenterd.WebServer.OpsCenterdWebServer instance at 0x3fd33f8> 2013-05-10 19:32:27+0000 [] INFO: morbid.morbid.StompFactory starting on 61619 2013-05-10 19:32:27+0000 [] INFO: Starting factory <morbid.morbid.StompFactory instance at 0x3ff2fc8> 2013-05-10 19:32:27+0000 [] INFO: Configuring agent communication with ssl support enabled. 2013-05-10 19:32:27+0000 [] INFO: morbid.morbid.StompFactory starting on 61620 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Starting services for cluster DEV_CLUSTER 2013-05-10 19:32:27+0000 [] INFO: Starting PushService 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Starting CassandraCluster service 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: agent_config items: {'cassandra_log_location': '/var/log/cassandra/system.log', 'thrift_port': 9160, 'thrift_ssl_truststore': None, 'rollups300_ttl': 2419200, 'rollups86400_ttl': -1, 'jmx_port': 7199, 'metrics_ignored_solr_cores': '', 'api_port': '61621', 'metrics_enabled': 1, 'thrift_ssl_truststore_type': 'JKS', 'kerberos_use_ticket_cache': True, 'kerberos_renew_tgt': True, 'rollups60_ttl': 604800, 'cassandra_install_location': '', 'rollups7200_ttl': 31536000, 'kerberos_debug': False, 'storage_keyspace': 'OpsCenter', 'ec2_metadata_api_host': '169.254.169.254', 'provisioning': 0, 'kerberos_use_keytab': True, 'metrics_ignored_column_families': '', 'thrift_ssl_truststore_password': None, 'metrics_ignored_keyspaces': 'system, system_traces, system_auth, dse_auth, OpsCenter'} 2013-05-10 19:32:27+0000 [] INFO: OS Version: Linux version 3.2.0-35-virtual (buildd@allspice) (gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) ) #55-Ubuntu SMP Wed Dec 5 18:02:05 UTC 2012 2013-05-10 19:32:27+0000 [] INFO: CPU Info: ['2666.760', '2666.760'] 2013-05-10 19:32:27+0000 [] INFO: Mem Info: 17079MB 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Cluster Name: DEV_CLUSTER 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Snitch: com.datastax.bdp.snitch.DseDelegateSnitch 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Partitioner: org.apache.cassandra.dht.RandomPartitioner 2013-05-10 19:32:27+0000 [] INFO: Package Manager: aptitude 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Recognizing new node 10.115.11.199 ('113427455640312821154458202477256070485') 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Recognizing new node 10.218.41.204 ('0') 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Recognizing new node 10.78.222.11 ('56713727820156410577229101238628035242') 2013-05-10 19:32:27+0000 [DEV_CLUSTER] ERROR: Error getting keyspaces: [Failure instance: Traceback: <type 'exceptions.KeyError'>: 'cf_test' /usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py:361:callback /usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py:455:_startRunCallbacks /usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py:542:_runCallbacks /usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py:1076:gotResult --- <exception caught here> --- /usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py:1020:_inlineCallbacks /usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py:408:getNonCompactCQL3ColumnFamilies ] 2013-05-10 19:32:27+0000 [DEV_CLUSTER] ERROR: Error when attempting to create OpsCenter schema: (KeyError) 'cf_test' 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Sleeping for 10s before retrying schema creation 2013-05-10 19:32:27+0000 [] INFO: Unhandled error in Deferred: 2013-05-10 19:32:27+0000 [] Unhandled Error Traceback (most recent call last): File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 361, in callback self._startRunCallbacks(result) File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 455, in _startRunCallbacks self._runCallbacks() File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 542, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1076, in gotResult _inlineCallbacks(r, g, deferred) --- <exception caught here> --- File "/usr/share/opscenter/lib/py-debian/2.7/amd64/twisted/internet/defer.py", line 1020, in _inlineCallbacks result = g.send(result) File "/usr/lib/python2.7/dist-packages/opscenterd/ThriftService.py", line 408, in getNonCompactCQL3ColumnFamilies exceptions.KeyError: 'cf_test' 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Version: {'search': None, 'dse': '3.0.1', 'tasktracker': None, 'jobtracker': None, 'cassandra': '1.1.9.3'} 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Node 10.218.41.204 changed its mode to normal 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Node 10.115.11.199 changed its mode to normal 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Node 10.78.222.11 changed its mode to normal 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Using 10.78.222.11 as the RPC address for node 10.78.222.11 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Using 10.218.41.204 as the RPC address for node 10.218.41.204 2013-05-10 19:32:27+0000 [DEV_CLUSTER] INFO: Using 10.115.11.199 as the RPC address for node 10.115.11.199 2013-05-10 19:32:29+0000 [DEV_CLUSTER] INFO: Agent for ip 10.218.41.204 is version u'3.0.2' 2013-05-10 19:32:29+0000 [DEV_CLUSTER] INFO: Agent for ip 10.115.11.199 is version u'3.0.2' 2013-05-10 19:32:29+0000 [DEV_CLUSTER] IN mbulman on "Opscenter Community Error" http://www.datastax.com/support-forums/topic/opscenter-community-error#post-10752 Wed, 08 May 2013 08:15:20 +0000 mbulman 10752@http://www.datastax.com/support-forums/ Great! Let us know if you need help with anything else. jbdkz on "Opscenter Community Error" http://www.datastax.com/support-forums/topic/opscenter-community-error#post-10730 Wed, 08 May 2013 01:41:41 +0000 jbdkz 10730@http://www.datastax.com/support-forums/ Thank you for responding mbulman. Yep, by mistake I downloaded 1.4.1. I upgraded to 3.0.2 and everything is just dandy. mbulman on "Opscenter Community Error" http://www.datastax.com/support-forums/topic/opscenter-community-error#post-10710 Tue, 07 May 2013 14:51:15 +0000 mbulman 10710@http://www.datastax.com/support-forums/ Hi, OpsCenter 1.4.1 is a very old version. Try following the instructions to install the latest version of OpsCenter: <a href="http://www.datastax.com/docs/opscenter/install/install_rhel" rel="nofollow">http://www.datastax.com/docs/opscenter/install/install_rhel</a> . You should end up with version 3.0.2. Let us know if you have any more questions. jbdkz on "Opscenter Community Error" http://www.datastax.com/support-forums/topic/opscenter-community-error#post-10663 Mon, 06 May 2013 20:19:48 +0000 jbdkz 10663@http://www.datastax.com/support-forums/ Running Opscenter v1.4.1 on RHEL64. I modified the /etc/opscenter/opscenterd.conf file to include the interface of the web server and the the IP address of the seed Cassandra node. I have also manually installed the Opscenter Agent on the seed Cassandra node. When I open up the Opscenter web page in Firefox 20.0.1 on a Windows 2003 server, I get the following message: Error Loading OpsCenter Error:a[0] is undefined. This is my first forage into the Cassandra/Opscenter realm so it could be something silly. ajit on "Agent installations failed." http://www.datastax.com/support-forums/topic/agent-installations-failed#post-10304 Wed, 24 Apr 2013 12:27:11 +0000 ajit 10304@http://www.datastax.com/support-forums/ Thanks a lot for the quick reply, after reading your reply i started to explore the sshd config file where in i find out the problem was not of 'motd' but of banner, which needed to switched off. Thanks again.