DataStax Support Forums » User Favorites: tupton

DataStax Support Forums » User Favorites: tupton tupton Software, Support, and Training for Apache Cassandra en-US Thu, 23 May 2013 11:55:47 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php thobbs on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10281 Tue, 23 Apr 2013 20:54:21 +0000 thobbs 10281@http://www.datastax.com/support-forums/ Great! Glad to hear that worked for you. Thanks for posting your solution. tember.josef on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10280 Tue, 23 Apr 2013 20:42:30 +0000 tember.josef 10280@http://www.datastax.com/support-forums/ Ok - I made without my network guys ;) I configured apache2-httpd and added an aditional Proxy maybe this solutions is helpful for somebody else, too. <code> ProxyPass /opscenter <a href="http://127.0.0.1:8888" rel="nofollow">http://127.0.0.1:8888</a> ProxyPassReverse /opscenter <a href="http://127.0.0.1:8888" rel="nofollow">http://127.0.0.1:8888</a> ProxyPass /tcp <a href="http://127.0.0.1:8888/tcp" rel="nofollow">http://127.0.0.1:8888/tcp</a> ProxyPassReverse /tcp <a href="http://127.0.0.1:8888/tcp" rel="nofollow">http://127.0.0.1:8888/tcp</a> </code> everything works now. Thank you very much for your support -- SOLVED !! thobbs on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10277 Tue, 23 Apr 2013 20:22:38 +0000 thobbs 10277@http://www.datastax.com/support-forums/ Ah, I believe that is causing the problem. In addition to acting as a normal webserver, opscenterd also pushes data to the browser using orbited (<a href="http://orbited2.org/)" rel="nofollow">http://orbited2.org/)</a>. To do that, opscenterd listens on 127.0.0.1:61619 (by default) and tunnels requests to <code><opscenterd_ip>/tcp</code> to that interface and port. (I'm personally a little unclear on the specifics of how that works, but perhaps that will give you a clue.) tember.josef on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10275 Tue, 23 Apr 2013 19:57:11 +0000 tember.josef 10275@http://www.datastax.com/support-forums/ Yes, there's a Firewall. So we made a proxy pass through apache httpd default-server.conf:ProxyPass /opscenter <a href="http://127.0.0.1:8888" rel="nofollow">http://127.0.0.1:8888</a> default-server.conf:ProxyPassReverse /opscenter <a href="http://127.0.0.1:8888" rel="nofollow">http://127.0.0.1:8888</a> can this be a problem? If yes, I can tell you tomorrow ... I have to talk to our network guys first ;) thobbs on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10274 Tue, 23 Apr 2013 19:46:13 +0000 thobbs 10274@http://www.datastax.com/support-forums/ Okay, that looks good, so perhaps the problem is between opscenterd and your browser. Do you have any kind of firewall/NAT/VPN that might be interfering with traffic in either direction? tember.josef on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10273 Tue, 23 Apr 2013 19:30:32 +0000 tember.josef 10273@http://www.datastax.com/support-forums/ [{"load": 1.3100000000000001, "has_jna": false, "devices": {"saved_caches": "cciss/c0d1p1", "commitlog": "cciss/c0d1p1", "other": ["sda", "cciss/c0d1", "cciss/c0d0"], "data": ["cciss/c0d1p1"]}, "task_progress": {}, "node_ip": "10.176.29.51", "network_interfaces": ["lo", "eth0", "eth1", "eth2", "eth3", "eth4", "eth5"], "ec2": {"instance-type": null, "placement": null, "ami-id": null, "instance-id": null}, "node_version": {"cassandra": "1.2.1"}, "dc": "datacenter1", "node_name": "geo4", "num_procs": 24, "streaming": {}, "token": "102084710076281539039012382229530463435", "data_held": 714620999434.0, "mode": "normal", "rpc_ip": "10.176.29.51", "partitions": {"saved_caches": "/dev/cciss/c0d1p1", "commitlog": "/dev/cciss/c0d1p1", "other": ["/dev/cciss/c0d0p2"], "data": ["/dev/cciss/c0d1p1"]}, "os": "linux", "rack": "rack1", "last_seen": 0}, {"load": 1.0700000000000001, "has_jna": false, "devices": {"saved_caches": "cciss/c0d1p1", "commitlog": "cciss/c0d1p1", "other": ["sda", "cciss/c0d1", "cciss/c0d0"], "data": ["cciss/c0d1p1"]}, "task_progress": {}, "node_ip": "10.176.29.50", "network_interfaces": ["lo", "eth4", "eth5", "eth0", "eth1", "eth2", "eth3"], "ec2": {"instance-type": null, "placement": null, "ami-id": null, "instance-id": null}, "node_version": {"cassandra": "1.2.1"}, "dc": "datacenter1", "node_name": "geo3", "num_procs": 24, "streaming": {}, "token": "68056473384187692692674921486353642290", "data_held": 695851410528.0, "mode": "normal", "rpc_ip": "10.176.29.50", "partitions": {"saved_caches": "/dev/cciss/c0d1p1", "commitlog": "/dev/cciss/c0d1p1", "other": ["/dev/cciss/c0d0p2"], "data": ["/dev/cciss/c0d1p1"]}, "os": "linux", "rack": "rack1", "last_seen": 0}, {"load": 0.46999999999999997, "has_jna": false, "devices": {"saved_caches": "cciss/c0d1p1", "commitlog": "cciss/c0d1p1", "other": ["sda", "cciss/c0d1", "cciss/c0d0"], "data": ["cciss/c0d1p1"]}, "task_progress": {}, "node_ip": "10.176.29.52", "network_interfaces": ["lo", "eth0", "eth1", "eth2", "eth3", "eth4", "eth5"], "ec2": {"instance-type": null, "placement": null, "ami-id": null, "instance-id": null}, "node_version": {"cassandra": "1.2.1"}, "dc": "datacenter1", "node_name": "geo5", "num_procs": 24, "streaming": {}, "token": "136112946768375385385349842972707284580", "data_held": 696355555527.0, "mode": "normal", "rpc_ip": "10.176.29.52", "partitions": {"saved_caches": "/dev/cciss/c0d1p1", "commitlog": "/dev/cciss/c0d1p1", "other": ["/dev/cciss/c0d0p2"], "data": ["/dev/cciss/c0d1p1"]}, "os": "linux", "rack": "rack1", "last_seen": 0}, {"load": 0.79000000000000004, "has_jna": false, "devices": {"saved_caches": "cciss/c0d1p1", "commitlog": "cciss/c0d1p1", "other": ["sda", "cciss/c0d1", "cciss/c0d0"], "data": ["cciss/c0d1p1"]}, "task_progress": {}, "node_ip": "10.176.29.48", "network_interfaces": ["lo", "eth4", "eth5", "eth0", "eth1", "eth2", "eth3"], "ec2": {"instance-type": null, "placement": null, "ami-id": null, "instance-id": null}, "node_version": {"cassandra": "1.2.1"}, "dc": "datacenter1", "node_name": "geo1", "num_procs": 24, "streaming": {}, "token": "0", "data_held": 697872070718.0, "mode": "normal", "rpc_ip": "10.176.29.48", "partitions": {"saved_caches": "/dev/cciss/c0d1p1", "commitlog": "/dev/cciss/c0d1p1", "other": ["/dev/cciss/c0d0p2"], "data": ["/dev/cciss/c0d1p1"]}, "os": "linux", "rack": "rack1", "last_seen": 0}, {"load": 1.24, "has_jna": false, "devices": {"saved_caches": "cciss/c0d1p1", "commitlog": "cciss/c0d1p1", "other": ["sda", "cciss/c0d1", "cciss/c0d0"], "data": ["cciss/c0d1p1"]}, "task_progress": {}, "node_ip": "10.176.29.49", "network_interfaces": ["lo", "eth4", "eth0", "eth1", "eth2", "eth3", "eth5"], "ec2": {"instance-type": null, "placement": null, "ami-id": null, "instance-id": null}, "node_version": {"cassandra": "1.2.1"}, "dc": "datacenter1", "node_name": "geo2", "num_procs": 24, "streaming": {}, "token": "34028236692093846346337460743176821145", "data_held": 702705998022.0, "mode": "normal", "rpc_ip": "10.176.29.49", "partitions": {"saved_caches": "/dev/cciss/c0d1p1", "commitlog": "/dev/cciss/c0d1p1", "other": ["/dev/cciss/c0d0p2"], "data": ["/dev/cciss/c0d1p1"]}, "os": "linux", "rack": "rack1", "last_seen": 0}] thobbs on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10270 Tue, 23 Apr 2013 18:08:17 +0000 thobbs 10270@http://www.datastax.com/support-forums/ To confirm that opscenterd and the agents are communicating correctly, can you curl "<opscenterd_ip>:8888/BettyCluster/nodes/all" and paste the results here? tember.josef on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10243 Tue, 23 Apr 2013 06:45:13 +0000 tember.josef 10243@http://www.datastax.com/support-forums/ The "0 of 0 agents connected"-message doesn't disappear (for hours/days) And: Yes The Error still apears: Ring View: ---> Error loading cluster view: Unknown cluster partitioner Just guessing: Is it possible it depends on the change of the Default-Partitioner / resp. the differen default token-numbering? Is there a way to check out manually the communication between Cassandra <--> Agents <--> OpsCenter ? thobbs on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10206 Mon, 22 Apr 2013 14:33:16 +0000 thobbs 10206@http://www.datastax.com/support-forums/ Do you still get an error when you attempt to view the Ring View? If the metrics and storage capacity chart are both working, that usually indicates that the agents and opscenterd can communicate without any problems. The UI can temporarily show "0 of 0 agents connected", but that typically goes away pretty quickly. Is that not happening for you? tember.josef on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10190 Mon, 22 Apr 2013 07:26:15 +0000 tember.josef 10190@http://www.datastax.com/support-forums/ How can I find out who is comunicating with whom? OpsCenter says: 0 of 0 agents connected but there are Data and Graphs in the "Performance"-Section as well as the Disk-Usage-Pie-Chart seems to be ok tupton on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10147 Fri, 19 Apr 2013 21:46:39 +0000 tupton 10147@http://www.datastax.com/support-forums/ It looks like those kerberos messages in the logs were a red herring, so you can ignore that. I'm still wondering if the agent can communicate with Cassandra and if opscenter can communicate with the agents. tupton on "Starting agent get the java.io.FileNotFoundException exception" http://www.datastax.com/support-forums/topic/starting-agent-get-the-javaiofilenotfoundexception-exception#post-10146 Fri, 19 Apr 2013 19:59:27 +0000 tupton 10146@http://www.datastax.com/support-forums/ What is your JAVA_HOME? Is it set and is it the same for the agent user? When starting the agent manually, you should run the init script, which should be in /etc/init.d/opscenter-agent. This will attempt to set up certain environment variables needed to run the agent, such as JAVA_HOME and the correct config directory. tupton on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10145 Fri, 19 Apr 2013 19:52:05 +0000 tupton 10145@http://www.datastax.com/support-forums/ The logs seem to indicate that you have kerberos enabled. Is that the case, and is it set up and working properly? It could be that the agent cannot connect to cassandra. What is the output of an api call to '"/<cluster_name>/storage-capacity"? This requires that the agent be connected to report meaningful data, and can help figure out if the problem is a connection between opscenter and the agent or something else. tember.josef on "Agents running without Error, but not connecting to OpsCenter" http://www.datastax.com/support-forums/topic/agents-running-without-error-but-not-connecting-to-opscenter#post-10130 Fri, 19 Apr 2013 08:50:27 +0000 tember.josef 10130@http://www.datastax.com/support-forums/ We manuelly installed OpsCenter and Agents (Version 3.0.2) // Older Version worked neither (same issue) disabled SSL The Agents are running Opscenter is running We don't see any StackTraces Opscenter sais: 0 of 0 agents connected When choosing Ringview : Error loading cluster view: Unknown cluster partitioner LogFile Agent <pre><code> user@server:/raidvolume/cassandra/agent> bin/opscenter-agent -f log4j:WARN No appenders could be found for logger (org.eclipse.jetty.util.log). log4j:WARN Please initialize the log4j system properly. log4j:WARN See <a href="http://logging.apache.org/log4j/1.2/faq.html#noconfig" rel="nofollow">http://logging.apache.org/log4j/1.2/faq.html#noconfig</a> for more info. INFO [main] 2013-04-19 10:26:38,640 Loading conf files: ./conf/address.yaml INFO [main] 2013-04-19 10:26:38,704 Java vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_41 INFO [main] 2013-04-19 10:26:38,705 Waiting for the config from OpsCenter INFO [main] 2013-04-19 10:26:38,705 SSL communication is disabled INFO [main] 2013-04-19 10:26:38,705 Creating stomp connection to 10.176.29.52:61620 INFO [StompConnection receiver] 2013-04-19 10:26:38,712 Reconnecting in 0s. INFO [main] 2013-04-19 10:26:38,714 Attempting to determine Cassandra's broadcast address through JMX INFO [StompConnection receiver] 2013-04-19 10:26:38,720 Connected to 10.176.29.52:61620 INFO [Initialization] 2013-04-19 10:26:38,731 Sleeping for 2s before trying to determine IP over JMX again INFO [main] 2013-04-19 10:26:38,773 Starting Jetty server: {:port 61621, :host nil, :ssl? false, :join? false} INFO [Jetty] 2013-04-19 10:26:38,865 Jetty server started INFO [StompConnection receiver] 2013-04-19 10:26:38,865 Got new config from OpsCenter: {:kerberos_use_keytab true, :rollups300_ttl 2419200, :kerberos_use_ticket_cache true, :rollups60_ttl 604800, :thrift_port 9160, :metrics_enabled 1, :rollups7200_ttl 31536000, :thrift_ssl_truststore nil, :metrics_ignored_column_families "", :cassandra_log_location "/var/log/cassandra/system.log", :thrift_rpc_interface "10.176.29.51", :thrift_ssl_truststore_password nil, :jmx_port 7199, :provisioning 0, :kerberos_debug false, :rollups86400_ttl -1, :api_port "61621", :storage_keyspace "OpsCenter", :kerberos_renew_tgt true, :metrics_ignored_solr_cores "", :thrift_ssl_truststore_type "JKS", :metrics_ignored_keyspaces "system, system_traces, system_auth, dse_auth, OpsCenter", :rollup_subscriptions [], :cassandra_install_location "/raidvolume/cassandra/apache-cassandra-1.2.1"} INFO [Initialization] 2013-04-19 10:26:40,734 New JMX connection (127.0.0.1:7199) INFO [Initialization] 2013-04-19 10:26:41,186 Using 10.176.29.51 as the cassandra broadcast address INFO [Initialization] 2013-04-19 10:26:41,190 Clearing ssl.truststore INFO [Initialization] 2013-04-19 10:26:41,191 Clearing ssl.truststore.password INFO [Initialization] 2013-04-19 10:26:41,191 Setting ssl.store.type to JKS INFO [Initialization] 2013-04-19 10:26:41,192 Clearing kerberos.service.principal.name INFO [Initialization] 2013-04-19 10:26:41,192 Clearing kerberos.principal INFO [Initialization] 2013-04-19 10:26:41,192 Setting kerberos.useTicketCache to true INFO [Initialization] 2013-04-19 10:26:41,193 Clearing kerberos.ticketCache INFO [Initialization] 2013-04-19 10:26:41,193 Setting kerberos.useKeyTab to true INFO [Initialization] 2013-04-19 10:26:41,193 Clearing kerberos.keyTab INFO [Initialization] 2013-04-19 10:26:41,193 Setting kerberos.renewTGT to true INFO [Initialization] 2013-04-19 10:26:41,194 Setting kerberos.debug to false INFO [Initialization] 2013-04-19 10:26:41,197 Starting OS metric collectors (Linux) INFO [thrift-init] 2013-04-19 10:26:41,198 Connecting to Cassandra cluster: 10.176.29.51 (port 9160) INFO [Initialization] 2013-04-19 10:26:41,210 Starting Cassandra JMX metric collectors INFO [thrift-init] 2013-04-19 10:26:41,219 Downed Host Retry service started with queue size -1 and retry delay 10s INFO [Initialization] 2013-04-19 10:26:41,224 New JMX connection (127.0.0.1:7199) INFO [thrift-init] 2013-04-19 10:26:41,227 Registering JMX me.prettyprint.cassandra.service_Agent Cluster:ServiceType=hector,MonitorType=hector INFO [Initialization] 2013-04-19 10:26:41,243 New JMX connection (127.0.0.1:7199) INFO [thrift-init] 2013-04-19 10:26:41,285 Connected to Cassandra cluster: BettyCluster INFO [pdp-loader] 2013-04-19 10:26:41,285 in execute with client org.apache.cassandra.thrift.Cassandra$Client@15d07c3f INFO [thrift-init] 2013-04-19 10:26:41,291 in execute with client org.apache.cassandra.thrift.Cassandra$Client@15d07c3f INFO [thrift-init] 2013-04-19 10:26:41,292 Using partitioner: org.apache.cassandra.dht.RandomPartitioner INFO [pdp-loader] 2013-04-19 10:26:41,294 Attempting to load stored metric values. INFO [Initialization] 2013-04-19 10:26:41,357 New JMX connection (127.0.0.1:7199) INFO [pool-4-thread-1] 2013-04-19 10:26:46,218 New JMX connection (127.0.0.1:7199) INFO [pool-4-thread-2] 2013-04-19 10:26:51,220 New JMX connection (127.0.0.1:7199) INFO [pool-4-thread-4] 2013-04-19 10:26:51,221 New JMX connection (127.0.0.1:7199) INFO [pool-4-thread-3] 2013-04-19 10:26:51,223 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-1] 2013-04-19 10:26:52,368 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-2] 2013-04-19 10:26:52,370 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-3] 2013-04-19 10:26:52,371 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-1] 2013-04-19 10:26:52,373 Cassandra node just went down INFO [pool-5-thread-1] 2013-04-19 10:26:57,376 New JMX connection (127.0.0.1:7199) INFO [qtp385491364-30] 2013-04-19 10:26:58,249 HTTP: :get /os-metric/disk-space - 200 INFO [pool-5-thread-1] 2013-04-19 10:27:02,384 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-2] 2013-04-19 10:27:02,455 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-1] 2013-04-19 10:27:07,392 New JMX connection (127.0.0.1:7199) INFO [qtp385491364-30] 2013-04-19 10:27:10,536 HTTP: :get /os-metric/disk-space - 200 INFO [pool-5-thread-1] 2013-04-19 10:27:12,400 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-2] 2013-04-19 10:27:12,507 New JMX connection (127.0.0.1:7199) INFO [pool-5-thread-1] 2013-04-19 10:27:17,408 New JMX connection (127.0.0.1:7199) ... </code></pre> LogFile OpsCenter <pre><code> 2013-04-19 10:46:02+0200 [] INFO: Log opened. 2013-04-19 10:46:02+0200 [] INFO: twistd 10.2.0 (/usr/bin/python2.6 2.6.5) starting up. 2013-04-19 10:46:02+0200 [] INFO: reactor class: twisted.internet.selectreactor.SelectReactor. 2013-04-19 10:46:02+0200 [] INFO: Logging level set to 'info' 2013-04-19 10:46:02+0200 [] INFO: OpsCenter version: 3.0.2 2013-04-19 10:46:02+0200 [] INFO: Compatible agent version: 3.0.2 2013-04-19 10:46:02+0200 [] INFO: Loading per-cluster config file ./conf/clusters/BettyCluster.conf 2013-04-19 10:46:02+0200 [] INFO: HTTP BASIC authentication enabled 2013-04-19 10:46:02+0200 [] INFO: Starting webserver with ssl disabled. 2013-04-19 10:46:02+0200 [] INFO: SSL disabled 2013-04-19 10:46:02+0200 [] INFO: opscenterd.WebServer.OpsCenterdWebServer starting on 8888 2013-04-19 10:46:02+0200 [] INFO: Starting factory <opscenterd.WebServer.OpsCenterdWebServer instance at 0x1fba560> 2013-04-19 10:46:02+0200 [] INFO: morbid.morbid.StompFactory starting on 61619 2013-04-19 10:46:02+0200 [] INFO: Starting factory <morbid.morbid.StompFactory instance at 0x2115908> 2013-04-19 10:46:02+0200 [] INFO: Configuring agent communication with ssl support disabled. 2013-04-19 10:46:02+0200 [] INFO: morbid.morbid.StompFactory starting on 61620 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Starting services for cluster BettyCluster 2013-04-19 10:46:02+0200 [] INFO: Starting PushService 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Starting CassandraCluster service 2013-04-19 10:46:02+0200 [BettyCluster] INFO: agent_config items: {'cassandra_log_location': '/var/log/cassandra/system.log', 'thrift_port': 9160, 'thrift_ssl_truststore': None, 'rollups300_ttl': 2419200, 'rollups86400_ttl': -1, 'jmx_port': 7199, 'metrics_ignored_solr_cores': '', 'api_port': '61621', 'metrics_enabled': 1, 'thrift_ssl_truststore_type': 'JKS', 'kerberos_use_ticket_cache': True, 'kerberos_renew_tgt': True, 'rollups60_ttl': 604800, 'cassandra_install_location': '/raidvolume/cassandra/apache-cassandra-1.2.1', 'rollups7200_ttl': 31536000, 'kerberos_debug': False, 'storage_keyspace': 'OpsCenter', 'provisioning': 0, 'kerberos_use_keytab': True, 'metrics_ignored_column_families': '', 'thrift_ssl_truststore_password': None, 'metrics_ignored_keyspaces': 'system, system_traces, system_auth, dse_auth, OpsCenter'} 2013-04-19 10:46:02+0200 [] INFO: OS Version: Linux version 2.6.34.7-0.7-desktop (geeko@buildhost) (gcc version 4.5.0 20100604 [gcc-4_5-branch revision 160292] (SUSE Linux) ) #1 SMP PREEMPT 2010-12-13 11:13:53 +0100 2013-04-19 10:46:02+0200 [] INFO: CPU Info: ['2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762', '2666.762'] 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Keyspaces: {'BETTYTEST': CassandraKeyspace(name=BETTYTEST, column_families=['atkis', 'atkisgray', 'atkishybrid'], attributes={'strategy_options': {'replication_factor': '1'}, 'replica_placement_strategy': 'org.apache.cassandra.locator.SimpleStrategy'}), 'system_auth': CassandraKeyspace(name=system_auth, column_families=[], attributes={'strategy_options': {'replication_factor': '1'}, 'replica_placement_strategy': 'org.apache.cassandra.locator.SimpleStrategy'}), 'system': CassandraKeyspace(name=system, column_families=['schema_keyspaces', 'HintsColumnFamily', 'IndexInfo', 'Migrations', 'LocationInfo', 'NodeIdInfo', 'hints', 'Schema'], attributes={'strategy_options': {}, 'replica_placement_strategy': 'org.apache.cassandra.locator.LocalStrategy'}), 'OpsCenter': CassandraKeyspace(name=OpsCenter, column_families=['events_timeline', 'settings', 'rollups60', 'rollups86400', 'pdps', 'rollups7200', 'events', 'rollups300'], attributes={'strategy_options': {'replication_factor': '2'}, 'replica_placement_strategy': 'org.apache.cassandra.locator.SimpleStrategy'}), 'BETTY': CassandraKeyspace(name=BETTY, column_families=['dfk', 'atkishybrid', 'urpos', 'parzinv', 'parzellar', 'satdop', 'topo', 'dop40', 'cir40', 'dfkinv', 'urauf', 'cir20', 'onmaphybrid', 'lod1', 'atkisgray', 'atkis'], attributes={'strategy_options': {'replication_factor': '3'}, 'replica_placement_strategy': 'org.apache.cassandra.locator.SimpleStrategy'}), 'system_traces': CassandraKeyspace(name=system_traces, column_families=[], attributes={'strategy_options': {'replication_factor': '1'}, 'replica_placement_strategy': 'org.apache.cassandra.locator.SimpleStrategy'})} 2013-04-19 10:46:02+0200 [] INFO: Mem Info: 28188MB 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Snitch: org.apache.cassandra.locator.SimpleSnitch 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Cluster Name: BettyCluster 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Partitioner: org.apache.cassandra.dht.RandomPartitioner 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Recognizing new node 10.176.29.51 ('102084710076281539039012382229530463435') 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Recognizing new node 10.176.29.52 ('136112946768375385385349842972707284580') 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Recognizing new node 10.176.29.49 ('34028236692093846346337460743176821145') 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Recognizing new node 10.176.29.50 ('68056473384187692692674921486353642290') 2013-04-19 10:46:02+0200 [BettyCluster] INFO: Recognizing new node 10.176.29.48 ('0') 2013-04-19 10:46:03+0200 [] INFO: Package Manager: Unknown 2013-04-19 10:46:03+0200 [BettyCluster] INFO: Initializing event storage. 2013-04-19 10:46:03+0200 [BettyCluster] INFO: Attempting to load all persisted alert rules 2013-04-19 10:46:03+0200 [BettyCluster] INFO: Done loading persisted alert rules 2013-04-19 10:46:03+0200 [BettyCluster] INFO: Done loading persisted scheduled job descriptions 2013-04-19 10:46:03+0200 [BettyCluster] INFO: Done initializing event storage. 2013-04-19 10:46:03+0200 [BettyCluster] INFO: OpsCenter starting up. 2013-04-19 10:46:41+0200 [BettyCluster] INFO: Version: {'cassandra': '1.2.1'} 2013-04-19 10:46:41+0200 [BettyCluster] INFO: Node 10.176.29.49 changed its mode to normal 2013-04-19 10:46:41+0200 [BettyCluster] INFO: Node 10.176.29.52 changed its mode to normal 2013-04-19 10:46:41+0200 [BettyCluster] INFO: Node 10.176.29.51 changed its mode to normal 2013-04-19 10:46:41+0200 [BettyCluster] INFO: Node 10.176.29.50 changed its mode to normal 2013-04-19 10:46:41+0200 [BettyCluster] INFO: Node 10.176.29.48 changed its mode to normal 2013-04-19 10:46:52+0200 [BettyCluster] INFO: Using 10.176.29.49 as the RPC address for node 10.176.29.49 2013-04-19 10:46:52+0200 [BettyCluster] INFO: Using 10.176.29.50 as the RPC address for node 10.176.29.50 2013-04-19 10:46:52+0200 [BettyCluster] INFO: Using 10.176.29.48 as the RPC address for node 10.176.29.48 2013-04-19 10:46:52+0200 [BettyCluster] INFO: Using 10.176.29.51 as the RPC address for node 10.176.29.51 2013-04-19 10:46:52+0200 [BettyCluster] INFO: Using 10.176.29.52 as the RPC address for node 10.176.29.52 2013-04-19 10:47:34+0200 [BettyCluster] INFO: Agent for ip 10.176.29.52 is version u'3.0.2' 2013-04-19 10:47:34+0200 [BettyCluster] INFO: Agent for ip 10.176.29.48 is version u'3.0.2' 2013-04-19 10:47:34+0200 [BettyCluster] INFO: Agent for ip 10.176.29.51 is version u'3.0.2' 2013-04-19 10:47:34+0200 [BettyCluster] INFO: Agent for ip 10.176.29.50 is version u'3.0.2' 2013-04-19 10:47:34+0200 [BettyCluster] INFO: Agent for ip 10.176.29.49 is version u'3.0.2' </code></pre> I appreciate any hint Josef Tina on "Starting agent get the java.io.FileNotFoundException exception" http://www.datastax.com/support-forums/topic/starting-agent-get-the-javaiofilenotfoundexception-exception#post-10123 Fri, 19 Apr 2013 03:56:07 +0000 Tina 10123@http://www.datastax.com/support-forums/ My environment is CentOs 5.8 Final. I install the OpsCenter first then use OpsCenter UI install agent in each Cassandra, it show the success message. But there is no information in OpsCenter then I check the installer.log(DEBUG level) in agent. It had some message show agent might start up fail. [installer.log] ... 2013-04-18 14:40:08 +0800 Starting new agent... 2013-04-18 14:40:08 +0800 Starting Cassandra cluster manager agent opscenter-agent 2013-04-18 14:40:08 +0800 Starting opscenter-agentUnable to find a java executable! 2013-04-18 14:40:08 +0800 Please install java or set JAVA_HOME. 2013-04-18 14:40:08 +0800 [FAILED] 2013-04-18 14:40:10 +0800 Agent installation complete. The log show that cannot find JAVA_HOME. I try to execute the "find-java" in "/usr/share/opscenter-agent/bin", it print the correct JAVA_HOME value. Then I try to run the "/usr/share/opscenter-agent/bin/opscenter-agent" and got java.io.FileNotFoundException exception. Can I run the "opscenter-agent" alone? Thanks.