I tried to expand my cluster twice using the new AMI (and only one available).
I got the following error :
Installation complete.
Exception seen in ds1_launcher.py. Please check ~/datastax_ami/ami.log for more info.
Then in the ami.log:
[EXEC] 12/24/12-08:23:39 git pull:
Updating b9eca2b..68812e2
Fast-forward
ds2_configure.py | 4 +-
presetup/launch_amis | 166 ++++++++++++++++++++++++++++++++++++++++++++++++++
presetup/setup.md | 96 +++++++++++++++++++++++++++++
3 files changed, 264 insertions(+), 2 deletions(-)
create mode 100755 presetup/launch_amis
create mode 100644 presetup/setup.md
[EXEC] 12/24/12-08:23:39 sudo rm ds2_configure.py
[INFO] Deleting ds2_configure.py now. This AMI will never change any configs after this first run.
[EXEC:E] 12/24/12-08:25:39 gpg --keyserver pgp.mit.edu --recv-keys 40976EAF437D05B5:
gpg: directory `/root/.gnupg' created
gpg: new configuration file `/root/.gnupg/gpg.conf' created
gpg: WARNING: options in `/root/.gnupg/gpg.conf' are not yet active during this run
gpg: keyring `/root/.gnupg/secring.gpg' created
gpg: keyring `/root/.gnupg/pubring.gpg' created
gpg: requesting key 437D05B5 from hkp server pgp.mit.edu
gpg: keyserver timed out
gpg: keyserver receive failed: keyserver error
[PIPE] 12/24/12-08:25:39 gpg --export --armor 40976EAF437D05B5 | sudo apt-key add -
[EXEC] 12/24/12-08:25:39 sudo rm -rf /etc/motd
[EXEC] 12/24/12-08:25:39 sudo touch /etc/motd
[INFO] Started with user data set to:
[INFO] --clustername expand --totalnodes 1 --version community --opscenter no --release 1.1.6
[INFO] Using instance type: m1.xlarge
[INFO] Using cluster name: expand
[INFO] Using cluster size: 1
[INFO] Using seed indexes: [0, 1, 1]
[EXEC:E] 12/24/12-08:25:39 sudo rm /etc/apt/sources.list.d/datastax.sources.list:
rm: cannot remove `/etc/apt/sources.list.d/datastax.sources.list': No such file or directory
[PIPE] 12/24/12-08:25:39 echo "deb http://debian.datastax.com/community stable main" | sudo tee -a /etc/apt/sources.list.d/datastax.sources.list:
deb http://debian.datastax.com/community stable main
[PIPE] 12/24/12-08:25:39 echo "deb http://debian.datastax.com/community stable main" | sudo tee -a /etc/apt/sources.list.d/datastax.sources.list:
deb http://debian.datastax.com/community stable main
[PIPE] 12/24/12-08:25:39 curl -s http://installer.datastax.com/downloads/ubuntuarchive.repo_key | sudo apt-key add -:
OK
[PIPE] 12/24/12-08:25:39 curl -s http://installer.datastax.com/downloads/ubuntuarchive.repo_key | sudo apt-key add -:
OK
[PIPE] 12/24/12-08:25:40 curl -s http://opscenter.datastax.com/debian/repo_key | sudo apt-key add -:
OK
[PIPE] 12/24/12-08:25:40 curl -s http://opscenter.datastax.com/debian/repo_key | sudo apt-key add -:
OK
[PIPE] 12/24/12-08:25:40 curl -s http://debian.datastax.com/debian/repo_key | sudo apt-key add -:
OK
[PIPE] 12/24/12-08:25:40 curl -s http://debian.datastax.com/debian/repo_key | sudo apt-key add -:
OK
[EXEC] 12/24/12-08:25:51 sudo apt-get update:
Ign http://eu-west-1.ec2.archive.ubuntu.com precise InRelease
Ign http://eu-west-1.ec2.archive.ubuntu.com precise-updates InRelease
Ign http://security.ubuntu.com precise-security InRelease
Ign http://archive.canonical.com lucid InRelease
Get:1 http://security.ubuntu.com precise-security Release.gpg [198 B]
Get:2 http://archive.canonical.com lucid Release.gpg [198 B]
Hit http://security.ubuntu.com precise-security Release
Get:3 http://eu-west-1.ec2.archive.ubuntu.com precise Release.gpg [198 B]
Hit http://archive.canonical.com lucid Release
Get:4 http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release.gpg [198 B]
Hit http://eu-west-1.ec2.archive.ubuntu.com precise Release
Hit http://security.ubuntu.com precise-security/main Sources
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release
Hit http://archive.canonical.com lucid/partner amd64 Packages
Hit http://security.ubuntu.com precise-security/universe Sources
Hit http://archive.canonical.com lucid/partner i386 Packages
Hit http://security.ubuntu.com precise-security/main amd64 Packages
Ign http://archive.canonical.com lucid/partner TranslationIndex
Hit http://security.ubuntu.com precise-security/universe amd64 Packages
Hit http://security.ubuntu.com precise-security/main i386 Packages
Hit http://security.ubuntu.com precise-security/universe i386 Packages
Get:5 http://eu-west-1.ec2.archive.ubuntu.com precise/main Sources [934 kB]
Hit http://security.ubuntu.com precise-security/main TranslationIndex
Hit http://security.ubuntu.com precise-security/universe TranslationIndex
Hit http://security.ubuntu.com precise-security/main Translation-en
Ign http://debian.datastax.com stable InRelease
Hit http://security.ubuntu.com precise-security/universe Translation-en
Ign http://archive.canonical.com lucid/partner Translation-en_US
Ign http://archive.canonical.com lucid/partner Translation-en
Get:6 http://eu-west-1.ec2.archive.ubuntu.com precise/universe Sources [5,019 kB]
Get:7 http://debian.datastax.com stable Release.gpg [490 B]
Get:8 http://debian.datastax.com stable Release [2,859 B]
Get:9 http://debian.datastax.com stable/main amd64 Packages [5,724 B]
Get:10 http://eu-west-1.ec2.archive.ubuntu.com precise/main amd64 Packages [1,273 kB]
Get:11 http://debian.datastax.com stable/main i386 Packages [5,717 B]
Get:12 http://eu-west-1.ec2.archive.ubuntu.com precise/universe amd64 Packages [4,786 kB]
Ign http://debian.datastax.com stable/main TranslationIndex
Get:13 http://eu-west-1.ec2.archive.ubuntu.com precise/main i386 Packages [1,274 kB]
Get:14 http://eu-west-1.ec2.archive.ubuntu.com precise/universe i386 Packages [4,796 kB]
Get:15 http://eu-west-1.ec2.archive.ubuntu.com precise/main TranslationIndex [3,706 B]
Get:16 http://eu-west-1.ec2.archive.ubuntu.com precise/universe TranslationIndex [2,922 B]
Get:17 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Sources [197 kB]
Get:18 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Sources [67.5 kB]
Get:19 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main amd64 Packages [446 kB]
Get:20 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe amd64 Packages [163 kB]
Get:21 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main i386 Packages [454 kB]
Ign http://debian.datastax.com stable/main Translation-en_US
Ign http://debian.datastax.com stable/main Translation-en
Get:22 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe i386 Packages [165 kB]
Get:23 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main TranslationIndex [3,564 B]
Get:24 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe TranslationIndex [2,850 B]
Get:25 http://eu-west-1.ec2.archive.ubuntu.com precise/main Translation-en [726 kB]
Get:26 http://eu-west-1.ec2.archive.ubuntu.com precise/universe Translation-en [3,341 kB]
Get:27 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Translation-en [219 kB]
Get:28 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Translation-en [97.8 kB]
Fetched 24.0 MB in 7s (3,016 kB/s)
Reading package lists...
[EXEC] 12/24/12-08:25:56 sudo apt-get update:
Ign http://eu-west-1.ec2.archive.ubuntu.com precise InRelease
Ign http://eu-west-1.ec2.archive.ubuntu.com precise-updates InRelease
Hit http://eu-west-1.ec2.archive.ubuntu.com precise Release.gpg
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release.gpg
Hit http://eu-west-1.ec2.archive.ubuntu.com precise Release
Ign http://security.ubuntu.com precise-security InRelease
Ign http://archive.canonical.com lucid InRelease
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release
Hit http://archive.canonical.com lucid Release.gpg
Hit http://security.ubuntu.com precise-security Release.gpg
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main Sources
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe Sources
Hit http://archive.canonical.com lucid Release
Hit http://security.ubuntu.com precise-security Release
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main amd64 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe amd64 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main i386 Packages
Hit http://archive.canonical.com lucid/partner amd64 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe i386 Packages
Hit http://security.ubuntu.com precise-security/main Sources
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main TranslationIndex
Hit http://archive.canonical.com lucid/partner i386 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe TranslationIndex
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Sources
Hit http://security.ubuntu.com precise-security/universe Sources
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Sources
Ign http://archive.canonical.com lucid/partner TranslationIndex
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main amd64 Packages
Hit http://security.ubuntu.com precise-security/main amd64 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe amd64 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main i386 Packages
Hit http://security.ubuntu.com precise-security/universe amd64 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe i386 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main TranslationIndex
Hit http://security.ubuntu.com precise-security/main i386 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe TranslationIndex
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main Translation-en
Hit http://security.ubuntu.com precise-security/universe i386 Packages
Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe Translation-en
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Translation-en
Hit http://security.ubuntu.com precise-security/main TranslationIndex
Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Translation-en
Hit http://security.ubuntu.com precise-security/universe TranslationIndex
Hit http://security.ubuntu.com precise-security/main Translation-en
Hit http://security.ubuntu.com precise-security/universe Translation-en
Ign http://debian.datastax.com stable InRelease
Ign http://archive.canonical.com lucid/partner Translation-en_US
Ign http://archive.canonical.com lucid/partner Translation-en
Get:1 http://debian.datastax.com stable Release.gpg [490 B]
Get:2 http://debian.datastax.com stable Release [2,859 B]
Get:3 http://debian.datastax.com stable/main amd64 Packages [5,724 B]
Get:4 http://debian.datastax.com stable/main i386 Packages [5,717 B]
Ign http://debian.datastax.com stable/main TranslationIndex
Ign http://debian.datastax.com stable/main Translation-en_US
Ign http://debian.datastax.com stable/main Translation-en
Fetched 14.8 kB in 1s (7,817 B/s)
Reading package lists...
[INFO] Performing deployment install...
[EXEC] 12/24/12-08:26:01 sudo apt-get install -y cassandra=1.1.6 dsc1.1=1.1.6-1:
Reading package lists...
Building dependency tree...
Reading state information...
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
dsc1.1 : Depends: python-cql but it is not going to be installed
[ERROR] 12/24/12-08:26:01 sudo service cassandra stop:
cassandra: unrecognized service
[EXEC] 12/24/12-08:26:01 sudo rm -rf /var/lib/cassandra
[EXEC] 12/24/12-08:26:01 sudo rm -rf /var/log/cassandra
[EXEC] 12/24/12-08:26:01 sudo mkdir -p /var/lib/cassandra
[EXEC] 12/24/12-08:26:01 sudo mkdir -p /var/log/cassandra
[ERROR] 12/24/12-08:26:01 sudo chown -R cassandra:cassandra /var/lib/cassandra:
chown: invalid user: `cassandra:cassandra'
[ERROR] 12/24/12-08:26:01 sudo chown -R cassandra:cassandra /var/log/cassandra:
chown: invalid user: `cassandra:cassandra'
[INFO] Reflector loop...
[INFO] Seed list: set([u'10.251.15.164'])
[INFO] OpsCenter: 10.251.15.164
[INFO] Options: {'username': None, 'cfsreplication': None, 'reflector': None, 'clustername': 'expand', 'analyticsnodes': 0, 'seed_indexes': [0, 1, 1], 'realtimenodes': 1, 'opscenter': 'no', 'totalnodes': 1, 'searchnodes': 0, 'opscenterinterface': None, 'version': 'community', 'dev': None, 'release': '1.1.6', 'password': None, 'email': None, 'raidonly': None, 'heapsize': None}
[ERROR] Exception seen in ds1_launcher.py:
Traceback (most recent call last):
File "/home/ubuntu/datastax_ami/ds1_launcher.py", line 20, in initial_configurations
ds2_configure.run()
File "/home/ubuntu/datastax_ami/ds2_configure.py", line 803, in run
File "/home/ubuntu/datastax_ami/ds2_configure.py", line 393, in construct_yaml
IOError: [Errno 2] No such file or directory: '/etc/cassandra/cassandra.yaml'
I am quite sure this log will help you. Is it possible to let the last ami available while the new is still unstable, I already get stuck twice because of an unstable AMI.
Thanks
