I had 4 node cassandra cluster running well, all agents connected.
I'm adding 5th node.
nodetools can detect it and it's joining the cluster (about 2-3TB data to transfer). nodetools shows its status is "joining".
I went back to OpsCenter -> Edit Cluster: I added the 5th node's IP address.
manually package installed agent on 5th node.
however, i cannot see OpsCenter find this node.
no errors in OpsCenter log -
here's the 5th node local agent log:
============================================
Starting OpsCenter agent monitor opscenter_agent_monitor.
Starting OpsCenter agent monitor opscenter_agent_monitor.
INFO [main] 2012-10-22 11:28:21,900 Loading conf files: /var/lib/opscenter-agent/conf/address.yaml
INFO [main] 2012-10-22 11:28:21,964 Java vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.7.0_09
INFO [main] 2012-10-22 11:28:21,965 Waiting for the config from OpsCenter
INFO [main] 2012-10-22 11:28:21,965 SSL communication is enabled
INFO [main] 2012-10-22 11:28:21,966 Creating stomp connection to 10.2.255.7:61620
INFO [StompConnection receiver] 2012-10-22 11:28:21,973 Reconnecting in 0s.
INFO [main] 2012-10-22 11:28:21,974 Attempting to determine Cassandra's broadcast address through JMX
INFO [Initialization] 2012-10-22 11:28:21,982 Sleeping for 2s before trying to determine IP over JMX again
WARN [pool-2-thread-1] 2012-10-22 11:28:21,998 Tried to send message while not connected: /conf-request [null,["2.10","\/1921359053\/conf",["fe80:0:0:0:2e41:38ff:fe4f:7cd7%2","10.2.255.7","0:0:0:0:0:0:0:1%1","127.0.0.1"]]]
ERROR [StompConnection receiver] 2012-10-22 11:28:22,166 failed connecting to 10.2.255.7:61620:java.net.ConnectException: Connection refused
INFO [StompConnection receiver] 2012-10-22 11:28:22,183 Reconnecting in 2s.
INFO [Initialization] 2012-10-22 11:28:23,984 Sleeping for 4s before trying to determine IP over JMX again
WARN [pool-2-thread-1] 2012-10-22 11:28:23,986 Tried to send message while not connected: /conf-request [null,["2.10","\/1921359053\/conf",["fe80:0:0:0:2e41:38ff:fe4f:7cd7%2","10.2.255.7","0:0:0:0:0:0:0:1%1","127.0.0.1"]]]
ERROR [StompConnection receiver] 2012-10-22 11:28:24,185 failed connecting to 10.2.255.7:61620:java.net.ConnectException: Connection refused
INFO [StompConnection receiver] 2012-10-22 11:28:24,185 Reconnecting in 6s.
INFO [Initialization] 2012-10-22 11:28:27,986 Sleeping for 8s before trying to determine IP over JMX again
WARN [pool-2-thread-1] 2012-10-22 11:28:27,987 Tried to send message while not connected: /conf-request [null,["2.10","\/1921359053\/conf",["fe80:0:0:0:2e41:38ff:fe4f:7cd7%2","10.2.255.7","0:0:0:0:0:0:0:1%1","127.0.0.1"]]]
ERROR [StompConnection receiver] 2012-10-22 11:28:30,187 failed connecting to 10.2.255.7:61620:java.net.ConnectException: Connection refused
INFO [StompConnection receiver] 2012-10-22 11:28:30,187 Reconnecting in 14s.
INFO [main] 2012-10-22 11:28:31,490 Loading conf files: ./conf/address.yaml
INFO [Initialization] 2012-10-22 11:28:35,988 Sleeping for 16s before trying to determine IP over JMX again
WARN [pool-2-thread-1] 2012-10-22 11:28:35,989 Tried to send message while not connected: /conf-request [null,["2.10","\/1921359053\/conf",["fe80:0:0:0:2e41:38ff:fe4f:7cd7%2","10.2.255.7","0:0:0:0:0:0:0:1%1","127.0.0.1"]]]
ERROR [StompConnection receiver] 2012-10-22 11:28:44,191 failed connecting to 10.2.255.7:61620:java.net.ConnectException: Connection refused
INFO [StompConnection receiver] 2012-10-22 11:28:44,191 Reconnecting in 30s.
INFO [Initialization] 2012-10-22 11:28:51,991 Sleeping for 20s before trying to determine IP over JMX again
WARN [pool-2-thread-1] 2012-10-22 11:28:51,993 Tried to send message while not connected: /conf-request [null,["2.10","\/1921359053\/conf",["fe80:0:0:0:2e41:38ff:fe4f:7cd7%2","10.2.255.7","0:0:0:0:0:0:0:1%1","127.0.0.1"]]]
INFO [Initialization] 2012-10-22 11:29:11,994 Sleeping for 20s before trying to determine IP over JMX again
WARN [pool-2-thread-1] 2012-10-22 11:29:11,995 Tried to send message while not connected: /conf-request [null,["2.10","\/1921359053\/conf",["fe80:0:0:0:2e41:38ff:fe4f:7cd7%2","10.2.255.7","0:0:0:0:0:0:0:1%1","127.0.0.1"]]]
ERROR [StompConnection receiver] 2012-10-22 11:29:14,194 failed connecting to 10.2.255.7:61620:java.net.ConnectException: Connection refused
INFO [StompConnection receiver] 2012-10-22 11:29:14,194 Reconnecting in 62s.
