http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application Software, Support, and Training for Apache Cassandra en-US Mon, 20 May 2013 00:02:37 +0000 http://bbpress.org/?v=1.0.3 q http://www.datastax.com/support-forums/search.php http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2490 Thu, 28 Jun 2012 22:09:21 +0000 xedin 2490@http://www.datastax.com/support-forums/ <p>can you please paste to pastebin configs that you have modified and copy links here so I can test them too? </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2488 Thu, 28 Jun 2012 22:03:12 +0000 sagrawal_informatica.com 2488@http://www.datastax.com/support-forums/ <p>Can you explain me how to check this? I just downloaded the DSE EE and configured it in analytic mode. </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2474 Thu, 28 Jun 2012 21:09:05 +0000 xedin 2474@http://www.datastax.com/support-forums/ <p>Are you using default DseDelegateSnitch snitch? </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2464 Thu, 28 Jun 2012 20:18:17 +0000 sagrawal_informatica.com 2464@http://www.datastax.com/support-forums/ <p>I see that its started :-</p> <p> INFO [IPC Server Responder] 2012-06-26 14:52:42,733 Server.java (line 598) IPC Server Responder: starting<br /> INFO [IPC Server handler 6 on 8012] 2012-06-26 14:52:42,733 Server.java (line 1358) IPC Server handler 6 on 8012: starting<br /> INFO [IPC Server handler 8 on 8012] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 8 on 8012: starting<br /> INFO [IPC Server listener on 44019] 2012-06-26 14:52:42,733 Server.java (line 434) IPC Server listener on 44019: starting<br /> INFO [JOB-TRACKER-INIT] 2012-06-26 14:52:42,734 JobTracker.java (line 2619) Starting RUNNING<br /> INFO [IPC Server handler 7 on 8012] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 7 on 8012: starting<br /> INFO [IPC Server handler 9 on 8012] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 9 on 8012: starting<br /> INFO [IPC Server handler 0 on 44019] 2012-06-26 14:52:42,734 Server.java (line 1358) IPC Server handler 0 on 44019: starting<br /> INFO [IPC Server handler 1 on 44019] 2012-06-26 14:52:42,735 Server.java (line 1358) IPC Server handler 1 on 44019: starting<br /> INFO [IPC Server handler 2 on 44019] 2012-06-26 14:52:42,736 Server.java (line 1358) IPC Server handler 2 on 44019: starting<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,736 TaskTracker.java (line 792) TaskTracker up at: localhost/127.0.0.1:44019<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,737 TaskTracker.java (line 795) Starting tracker tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019<br /> INFO [IPC Server handler 3 on 44019] 2012-06-26 14:52:42,736 Server.java (line 1358) IPC Server handler 3 on 44019: starting<br /> INFO [Map-events fetcher for all reduce tasks on tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019] 2012-06-26 14:52:42,780 TaskTracker.java (line 960) Starting thread: Map-events fetcher for all reduce tasks on tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,787 ProcessTree.java (line 63) setsid exited with exit code 0<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,793 TaskTracker.java (line 826) Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1547a16f<br /> WARN [TASK-TRACKER-INIT] 2012-06-26 14:52:42,797 TaskTracker.java (line 4189) TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,801 IndexCache.java (line 46) IndexCache created with max memory = 10485760<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,808 MetricsSourceAdapter.java (line 90) MBean for source ShuffleServerMetrics registered.<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,811 HttpServer.java (line 578) Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50060<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,811 HttpServer.java (line 583) listener.getLocalPort() returned 50060 webServer.getConnectors()[0].getLocalPort() returned 50060<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,811 HttpServer.java (line 616) Jetty bound to port 50060<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,812 Slf4jLog.java (line 67) jetty-6.1.22<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,981 Slf4jLog.java (line 67) Started SelectChannelConnector@0.0.0.0:50060<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,994 TaskTracker.java (line 1503) FILE_CACHE_SIZE for mapOutputServlet set to : 2000<br /> INFO [TASK-TRACKER-INIT] 2012-06-26 14:52:42,996 HadoopTrackerPlugin.java (line 301) Hadoop Task Tracker Started...<br /> INFO [IPC Server handler 3 on 8012] 2012-06-26 14:52:43,313 NetworkTopology.java (line 328) Adding a new node: /default-rack/psvrrh6qa1.informatica.com<br /> INFO [IPC Server handler 3 on 8012] 2012-06-26 14:52:43,316 JobTracker.java (line 3207) Adding tracker tracker_psvrrh6qa1.informatica.com:localhost/127.0.0.1:44019 to host psvrrh6qa1.informatica.com<br /> INFO [CompactionExecutor:5] 2012-06-26 18:52:07,969 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 23 ms<br /> INFO [CompactionExecutor:7] 2012-06-26 22:52:07,949 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 3 ms<br /> INFO [CompactionExecutor:9] 2012-06-27 02:52:07,965 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 19 ms<br /> INFO [CompactionExecutor:11] 2012-06-27 06:52:07,951 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 4 ms<br /> INFO [CompactionExecutor:13] 2012-06-27 10:52:07,958 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 11 ms<br /> INFO [CompactionExecutor:15] 2012-06-27 14:52:07,975 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (11 items) in 28 ms<br /> INFO [Thread[Thread-4,5,main]] 2012-06-27 14:52:12,849 AbstractDelegationTokenSecretManager.java (line 140) Updating the current master key for generating delegation tokens<br /> INFO [CompactionExecutor:17] 2012-06-27 18:52:07,951 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 4 ms<br /> INFO [CompactionExecutor:19] 2012-06-27 22:52:07,960 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 12 ms<br /> INFO [CompactionExecutor:21] 2012-06-28 02:52:07,962 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 14 ms<br /> INFO [CompactionExecutor:23] 2012-06-28 06:52:07,960 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 12 ms<br /> INFO [CompactionExecutor:25] 2012-06-28 10:52:07,960 AutoSavingCache.java (line 269) Saved cfs-inode-KeyCache (13 items) in 12 ms </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2463 Thu, 28 Jun 2012 20:08:41 +0000 xedin 2463@http://www.datastax.com/support-forums/ <p>does the system log show you that JT or TT have been started? </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2461 Thu, 28 Jun 2012 20:06:19 +0000 sagrawal_informatica.com 2461@http://www.datastax.com/support-forums/ <p>This is DSE. I have started it with "-t" option already. I still cannot connect from my java application . Any ideas? </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2441 Thu, 28 Jun 2012 00:45:31 +0000 xedin 2441@http://www.datastax.com/support-forums/ <p>Is it a Cassandra or DSE instance you are talking about? If that is DSE have you started it with -t option to enable Hadoop support? </p> http://www.datastax.com/support-forums/topic/not-able-to-connect-to-casandra-file-system-from-external-java-application#post-2440 Thu, 28 Jun 2012 00:38:52 +0000 sagrawal_informatica.com 2440@http://www.datastax.com/support-forums/ <p>Hi,<br /> I am from Informatica and we are evaluating Casandra hadoop file system.I see an error running my application:-</p> <p>12/06/26 14:57:43 INFO cfs.CassandraFileSystem: CassandraFileSystem.uri : cfs://10.1.43.76:9160<br /> 12/06/26 14:57:43 INFO cfs.CassandraFileSystem: Default block size: 33554432<br /> 12/06/26 14:58:04 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 14:58:04 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 14:58:26 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 14:58:26 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 14:58:48 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 14:58:48 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 14:59:11 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 14:59:11 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 14:59:33 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 14:59:33 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 14:59:55 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 14:59:55 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 15:00:17 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 15:00:17 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 15:00:39 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 15:00:39 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 15:01:01 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 15:01:01 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> 12/06/26 15:01:23 WARN util.CassandraProxyClient: Connection failed to Cassandra node: 10.1.43.76:9160 unable to connect to server<br /> 12/06/26 15:01:23 WARN util.CassandraProxyClient: No cassandra ring information found, no other nodes to connect to<br /> java.io.IOException: Error connecting to node 10.1.43.76:9160 with strategy STICKY.<br /> at com.datastax.bdp.util.CassandraProxyClient.initialize(CassandraProxyClient.java:208)<br /> at com.datastax.bdp.util.CassandraProxyClient.&lt;init&gt;(CassandraProxyClient.java:180)<br /> at com.datastax.bdp.util.CassandraProxyClient.newProxyConnection(CassandraProxyClient.java:119)<br /> at com.datastax.bdp.hadoop.cfs.CassandraFileSystemThriftStore.initialize(CassandraFileSystemThriftStore.java:195)<br /> at com.datastax.bdp.hadoop.cfs.CassandraFileSystem.initialize(CassandraFileSystem.java:68)<br /> at com.informatica.casandra.casandra.main(casandra.java:24)</p> <p>My cassandra.yaml looks this this:</p> <p>listen_address:</p> <p># Address to broadcast to other Cassandra nodes<br /> # Leaving this blank will set it to the same value as listen_address<br /> # broadcast_address: 1.2.3.4</p> <p># The address to bind the Thrift RPC service to -- clients connect<br /> # here. Unlike ListenAddress above, you *can* specify 0.0.0.0 here if<br /> # you want Thrift to listen on all interfaces.<br /> #<br /> # Leaving this blank has the same effect it does for ListenAddress,<br /> # (i.e. it will be based on the configured hostname of the node).<br /> rpc_address: 0.0.0.0<br /> # port for Thrift to listen for clients on<br /> rpc_port: 9160</p> <p>I tried changing the rpc_address to actual IP address also but it doesn’t work. I can connect from cqlsh &amp; cassandra-cli utility. Java code , we are using is:</p> <p>CassandraFileSystem fs = new CassandraFileSystem();</p> <p> fs.initialize(URI.create("cfs://10.1.43.76:9160/"), new Configuration());</p> <p> // Prepare some data to write into the file:<br /> String s = "this is a sample";<br /> byte[] data = s.getBytes();</p> <p> // Create a new file:<br /> Path path = new Path("testfile");<br /> System.out.println(data);<br /> FSDataOutputStream os1 = fs.create(path);<br /> os1.write(data);<br /> os1.close(); </p>