Support Forums : DataStax

DataStax Support Forums » OpsCenter

The installed agent doesn't seem to be responding - EC2

(8 posts) (2 voices)

Started 2 months ago by vodnok
Latest reply from vodnok
This topic is not resolved

Tags:

No tags yet.

vodnok
Member

Hi,

First of all, i'm a newby on amazon (just to notice)

I followed this tuto to create a cluster on EC2 : http://www.datastax.com/docs/1.2/install/install_ami

And all is OK, running opCenter on browser, i've made the fix for node recognition. There is 2 nodes up and running

So for test purpose i wanted to add a node using the "add nodes" fonction in opsCenter, filling the form using own security group and keypair

Instance has been created on EC2 OK
Some configuration are sended OK

Then opsCenter is waiting for Agent to start and... nothing

Then nice red message : Install Errored: The installed agent doesn't seem to be responding

I tried to change security group or keypair option in the add node form but all the time the same

For the node name i've put something like '123456' (for test) maybe it's that

So i'm stuck :-)

In guide there is : http://www.datastax.com/docs/1.2/install/expand_ami

So creating a new cluster then assinging all the node to the good cluster...
In this tutorial i'm stuck too

@4 "Set the following properties in the cassandra.yaml configurtion file. For example:"

I don't know where to find the cassandra.yaml. Connected to instance via ssh i don't find the *.yaml

So questions for the pro :

How to add a node ?

Via opsCenter or via tutorial "expanding..." ?

Any idea to help me on my stuck ?

Thank you,

Vodnok

Posted 2 months ago #
mbulman
Key Master

Vodnok,

The cassandra.yaml file can be located in /etc/cassandra/cassandra.yaml if you are using DataStax Community Edition. If you are using DataStax Enterprise, it can be found in /etc/dse/cassandra/cassandra.yaml

As for the agent not responding when adding a node to your cluster, the first step is to look in /var/log/opscenter-agent/agent.log on the node you're adding for any errors or problems connecting to the central OpsCenter machine.

Posted 2 months ago #
vodnok
Member

I've made an SSH to the new instance created by opsCenter and i have this :

Cluster started with these options:
--raidonly

Waiting for nodetool...
The cluster is now in it's finalization phase. This should only take a moment...

Note: You can also use CTRL+C to view the logs if desired:
AMI log: ~/datastax_ami/ami.log
Cassandra log: /var/log/cassandra/system.log

Traceback (most recent call last):
File "datastax_ami/ds4_motd.py", line 196, in <module>
run()
File "datastax_ami/ds4_motd.py", line 187, in run
waiting_for_nodetool()
File "datastax_ami/ds4_motd.py", line 84, in waiting_for_nodetool
retcode = subprocess.call(shlex.split(config_data['nodetool_statement']), stdout=subprocess.PIPE, stderr=subprocess.PIPE)
File "/usr/lib/python2.7/subprocess.py", line 493, in call
return Popen(*popenargs, **kwargs).wait()
File "/usr/lib/python2.7/subprocess.py", line 679, in __init__
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1249, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory

Posted 2 months ago #
vodnok
Member

"The cassandra.yaml file can be located in /etc/cassandra/cassandra.yaml"

but i have access to nothing via ssh

Here the file system :

ami.log
datastax_ami

AMI_LICENSE.txt SWITCHES.md ds0_updater.py ds4_motd.py tokentool.html
CHANGES.md ami.conf ds1_launcher.py logger.py tokentoolv2.py
EXPANDING.md ami.log ds1_launcher.pyc logger.pyc
FILES.md conf.py ds2_configure.pyc presetup
README.md conf.pyc ds3_after_init.py reflector.php

So i don't have etc,var,bin...

when i do vi /var/log/cassandra/system.log

access denied !!!

Posted 2 months ago #
mbulman
Key Master

File "/usr/lib/python2.7/subprocess.py", line 1249, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory

This is safe to ignore. See https://github.com/riptano/ComboAMI/issues/12

So i don't have etc,var,bin...

What happens if you run the following command: ls -l /etc/cassandra

when i do vi /var/log/cassandra/system.log

access denied !!!

Try using sudo

Posted 2 months ago #
vodnok
Member

ok sudo vi /etc/cassandra/cassandra.yaml worked fine

Thank you !!!

To return to my initial question : What's the best way for adding a node ?

Via opsCenter or via http://www.datastax.com/docs/1.2/install/expand_ami ?

Posted 2 months ago #
vodnok
Member

Well i followed every line of the guide and i cannot add new node

So i'll explained what i'm doing : (hoping somebody can explain my mistake)

I've done every thing on http://www.datastax.com/docs/1.2/install/install_ami

with :

--clustername cass1 --totalnodes 2 --version community

Using own security group with right opened ports

After that i can open opsCenter and fix the 2 nodes and everything is fine

Then i want to add 2 new nodes to cass1

VIA OPSCENTER :

Using opsCenter with add node form with theses parameters

nodes : 256
security group : the security group created for the cluster
Use OpsCenter specific keypair : the keypair of cluster

After EC2 instance creation i have error : Install Errored: The installed agent doesn't seem to be responding

STUCKED

VIA http://www.datastax.com/docs/1.2/install/expand_ami :

I create another cluster with these parameters

--clustername tmp --totalnodes 2 --version community

(clustername different then the first cluster)

Then on each instance i do :

sudo service cassandra stop
sudo rm -rf /var/lib/cassandra/*
sudo vi /etc/cassandra/cassandra.yaml

cluster_name: 'cass1' (the name of the first cluster)
...
num_tokens: 256
...
seed_provider:
- class_name: org.apache.cassandra.locator.SimpleSeedProvider
parameters:
- seeds: "{ip of first instance of first cluster}"

Then on each (2 min interval)

sudo service cassandra start

On console of main instance cluster cass1 when i do
nodetool status

i have the 2 nodes and nothing more

On the instance i want to add i have

nodetool status

"cannot connect"

So there is 2 ways for adding new node but nothing worked for me. Do i'm missing something ?

Thank you for your support

Posted 2 months ago #
vodnok
Member

Ok i find a solution

There is a mistake on the guide : http://www.datastax.com/docs/1.2/install/expand_ami

(or something change since it was written)

------------------

In the AWS Management Console, create the number of nodes you need in another cluster with a temporary name. See Installing a Cassandra cluster on Amazon EC2.

The temporary name prevents the new nodes from joining the cluster with the wrong settings.

sudo rm -rf /var/lib/cassandra/*

You must clear the data because new nodes have existing data from the initial start with the temporary cluster name and settings.

----------------------

What was wrong is : sudo rm -rf /var/lib/cassandra/* didn't erase the cluster name

So the solution is to create a instance WITH THE REAL CLUSTER NAME and it worked fine :-)

Posted 2 months ago #

RSS feed for this topic

Reply

You must log in to post.