Support Forums : DataStax

DataStax Support Forums » DataStax Enterprise

Not able to connect to Casandra file system from external java application.

(8 posts) (2 voices)

Started 11 months ago by sagrawal_informatica.com
Latest reply from xedin
This topic is not a support question

Tags:

No tags yet.

sagrawal_informatica.com
Member

Hi,
I am from Informatica and we are evaluating Casandra hadoop file system.I see an error running my application:-

12/06/26 14:57:43 INFO cfs.CassandraFileSystem: CassandraFileSystem.uri : cfs://10.1.43.76:9160
12/06/26 14:57:43 INFO cfs.CassandraFileSystem: Default block size: 33554432
12/06/26 14:58:04 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 14:58:04 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 14:58:26 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 14:58:26 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 14:58:48 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 14:58:48 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 14:59:11 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 14:59:11 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 14:59:33 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 14:59:33 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 14:59:55 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 14:59:55 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 15:00:17 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 15:00:17 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 15:00:39 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 15:00:39 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 15:01:01 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 15:01:01 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
12/06/26 15:01:23 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server
12/06/26 15:01:23 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to
java.io.IOException: Error connecting to node 10.1.43.76:9160 with strategy STICKY.
at com.datastax.bdp.util.CassandraProxyClient.initialize(CassandraProxyClient.java:208)
at com.datastax.bdp.util.CassandraProxyClient.<init>(CassandraProxyClient.java:180)
at com.datastax.bdp.util.CassandraProxyClient.newProxyConnection(CassandraProxyClient.java:119)
at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.initialize(CassandraFileSystemThriftStore.java:195)
at com.datastax.bdp.hadoop.cfs.CassandraFileSystem.initialize(CassandraFileSystem.java:68)
at com.informatica.casandra.casandra.main(casandra.java:24)

My cassandra.yaml looks this this:

listen_address:

# Address to broadcast to other Cassandra nodes
# Leaving this blank will set it to the same value as listen_address
# broadcast_address: 1.2.3.4

# The address to bind the Thrift RPC service to -- clients connect
# here. Unlike ListenAddress above, you *can* specify 0.0.0.0 here if
# you want Thrift to listen on all interfaces.
#
# Leaving this blank has the same effect it does for ListenAddress,
# (i.e. it will be based on the configured hostname of the node).
rpc_address: 0.0.0.0
# port for Thrift to listen for clients on
rpc_port: 9160

I tried changing the rpc_address to actual IP address also but it doesn’t work. I can connect from cqlsh & cassandra-cli utility. Java code , we are using is:

CassandraFileSystem fs = new CassandraFileSystem();

fs.initialize(URI.create("cfs://10.1.43.76:9160/"), new Configuration());

// Prepare some data to write into the file:
String s = "this is a sample";
byte[] data = s.getBytes();

// Create a new file:
Path path = new Path("testfile");
System.out.println(data);
FSDataOutputStream os1 = fs.create(path);
os1.write(data);
os1.close();

Posted 11 months ago #
xedin
Member

Is it a Cassandra or DSE instance you are talking about? If that is DSE have you started it with -t option to enable Hadoop support?

Posted 11 months ago #
sagrawal_informatica.com
Member

This is DSE. I have started it with "-t" option already. I still cannot connect from my java application . Any ideas?

Posted 11 months ago #
xedin
Member

does the system log show you that JT or TT have been started?

Posted 11 months ago #
sagrawal_informatica.com
Member

I see that its started :-

INFO [IPC Server Responder] 2012-06-26 14:52:42,733 Server.java (line 598) IPC Server Responder: starting
INFO [IPC Server handler 6 on 8012] 2012-06-26 14:52:42,733 Server.java (line 1358) IPC Server handler 6 on 8012: starting
INFO [IPC Server handler 8 on 8012] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 8 on 8012: starting
INFO [IPC Server listener on 44019] 2012-06-26 14:52:42,733 Server.java (line 434) IPC Server listener on 44019: starting
INFO [JOB-TRACKER-INIT] 2012-06-26 14:52:42,734 JobTracker.java (line 2619) Starting RUNNING
INFO [IPC Server handler 7 on 8012] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 7 on 8012: starting
INFO [IPC Server handler 9 on 8012] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 9 on 8012: starting
INFO [IPC Server handler 0 on 44019] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 0 on 44019: starting
INFO [IPC Server handler 1 on 44019] 2012-06-26 14:52:42,735 Server.java (line 1358) IPC Server handler 1 on 44019: starting
INFO [IPC Server handler 2 on 44019] 2012-06-26 14:52:42,736 Server.java (line 1358) IPC Server handler 2 on 44019: starting
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,736 TaskTracker.java (line 792) TaskTracker up at: localhost/127.0.0.1:44019
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,737 TaskTracker.java (line 795) Starting tracker tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019
INFO [IPC Server handler 3 on 44019] 2012-06-26 14:52:42,736 Server.java (line 1358) IPC Server handler 3 on 44019: starting
INFO [Map-events fetcher for all reduce tasks on tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019] 2012-06-26 14:52:42,780 TaskTracker.java (line 960) Starting thread: Map-events fetcher for all reduce tasks on tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,787 ProcessTree.java (line 63) setsid exited with exit code 0
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,793 TaskTracker.java (line 826) Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1547a16f
WARN [TASK-TRACKER-INIT] 2012-06-26 14:52:42,797 TaskTracker.java (line 4189) TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,801 IndexCache.java (line 46) IndexCache created with max memory = 10485760
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,808 MetricsSourceAdapter.java (line 90) MBean for source ShuffleServerMetrics registered.
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,811 HttpServer.java (line 578) Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50060
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,811 HttpServer.java (line 583) listener.getLocalPort() returned 50060 webServer.getConnectors()[0].getLocalPort() returned 50060
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,811 HttpServer.java (line 616) Jetty bound to port 50060
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,812 Slf4jLog.java (line 67) jetty-6.1.22
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,981 Slf4jLog.java (line 67) Started SelectChannelConnector@0.0.0.0:50060
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,994 TaskTracker.java (line 1503) FILE_CACHE_SIZE for mapOutputServlet set to : 2000
INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,996 HadoopTrackerPlugin.java (line 301) Hadoop Task Tracker Started...
INFO [IPC Server handler 3 on 8012] 2012-06-26 14:52:43,313 NetworkTopology.java (line 328) Adding a new node: /default-rack/psvrrh6qa1.informatica.com
INFO [IPC Server handler 3 on 8012] 2012-06-26 14:52:43,316 JobTracker.java (line 3207) Adding tracker tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019 to host psvrrh6qa1.informatica.com
INFO [CompactionExecutor:5] 2012-06-26 18:52:07,969 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 23 ms
INFO [CompactionExecutor:7] 2012-06-26 22:52:07,949 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 3 ms
INFO [CompactionExecutor:9] 2012-06-27 02:52:07,965 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 19 ms
INFO [CompactionExecutor:11] 2012-06-27 06:52:07,951 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 4 ms
INFO [CompactionExecutor:13] 2012-06-27 10:52:07,958 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 11 ms
INFO [CompactionExecutor:15] 2012-06-27 14:52:07,975 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 28 ms
INFO [Thread[Thread-4,5,main]] 2012-06-27 14:52:12,849 AbstractDelegationTokenSecretManager.java (line 140) Updating the current master key for generating delegation tokens
INFO [CompactionExecutor:17] 2012-06-27 18:52:07,951 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 4 ms
INFO [CompactionExecutor:19] 2012-06-27 22:52:07,960 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 12 ms
INFO [CompactionExecutor:21] 2012-06-28 02:52:07,962 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 14 ms
INFO [CompactionExecutor:23] 2012-06-28 06:52:07,960 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 12 ms
INFO [CompactionExecutor:25] 2012-06-28 10:52:07,960 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 12 ms

Posted 11 months ago #
xedin
Member

Are you using default DseDelegateSnitch snitch?

Posted 11 months ago #
sagrawal_informatica.com
Member

Can you explain me how to check this? I just downloaded the DSE EE and configured it in analytic mode.

Posted 11 months ago #
xedin
Member

can you please paste to pastebin configs that you have modified and copy links here so I can test them too?

Posted 11 months ago #

RSS feed for this topic

Reply

You must log in to post.