DataStax Support Forums » Tag: brisk

DataStax Support Forums » Tag: brisk - Recent Posts http://www.datastax.com/support-forums/tags/brisk Software, Support, and Training for Apache Cassandra en-US Thu, 23 May 2013 17:49:49 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php Anonymous on "Cannot Connect to Task Tracker" http://www.datastax.com/support-forums/topic/cannot-connect-to-task-tracker#post-552 Mon, 10 Oct 2011 18:23:41 +0000 Anonymous 552@http://www.datastax.com/support-forums/ I figured this out. In case anyone else has the same issues, here's what was going on: Brisk uses the first entry in the Cassandra cluster's seed list to pick the initial jobtracker. One of my nodes had 127.0.0.1 in the seed list. This worked for the Cassandra setup since all the other nodes in the cluster connected to that box to get the cluster topology but this didn't work for the job tracker selection. Anonymous on "Cannot Connect to Task Tracker" http://www.datastax.com/support-forums/topic/cannot-connect-to-task-tracker#post-546 Fri, 07 Oct 2011 19:41:33 +0000 Anonymous 546@http://www.datastax.com/support-forums/ I have a 3 node Brisk cluster (Briskv1.0_beta2). Cassandra is working fine (all three nodes see each other and data is balanced across the ring). I started the nodes with the brisk cassandra -t command. I cannot, however, run any Hive or Pig jobs. When I do, I get an exception saying that it cannot connect to the task tracker. During the startup process, I see the following in the log: TaskTracker.java (line 695) TaskTracker up at: localhost.localdomain/127.0.0.1:34928 A few lines later, however, I see this: Retrying connect to server: localhost.localdomain/127.0.0.1:8012. Already tried 9 time(s). INFO [TASK-TRACKER-INIT] RPC.java (line 321) Server at localhost.localdomain/127.0.0.1:8012 not available yet, Zzzzz... Those lines are repeated non-stop as long as my cluster is running. My cassandra.yaml file specifies the box IP (not 0.0.0.0 or localhost) as the listen_address and the rpc_address is set to 0.0.0.0 Why is the client attempting to connect to a different port than the log shows the task tracker as using? Is there anywhere these addresses/ports can be specified? Anonymous on "Share Cassandra cluster between Brisk and Solandra?" http://www.datastax.com/support-forums/topic/share-cassandra-cluster-between-brisk-and-solandra#post-537 Sat, 01 Oct 2011 01:38:45 +0000 Anonymous 537@http://www.datastax.com/support-forums/ Hello, I'd like to have a single Cassandra cluster used by both Brisk and Solandra. Both seem to have their own embedded Cassandra. I see that Solandra has instructions for pointing it at a standard Cassandra distribution, but the Cassandra embedded in Brisk seems to be non-standard. Any tips on how I can get this to work? joaquin on "How to get Brisk AMI working for a whole cluster of nodes?" http://www.datastax.com/support-forums/topic/how-to-get-brisk-ami-working-for-a-whole-cluster-of-nodes#post-464 Mon, 22 Aug 2011 17:03:23 +0000 joaquin 464@http://www.datastax.com/support-forums/ From your logs I'm seeing your first line as: INFO [main] 2011-08-18 03:15:08,141 AbstractCassandraDaemon.java (line 78) Logging initialized and your last lines as: INFO [HintedHandoff:2] 2011-08-18 05:19:32,394 HintedHandOffManager.java (line 376) Finished hinted handoff of 0 rows to endpoint /10.250.79.112 ERROR [Thread-70] 2011-08-18 15:37:21,847 AbstractCassandraDaemon.java (line 113) Fatal exception in thread Thread[Thread-70,5,main] java.lang.OutOfMemoryError: Java heap space Which lets me know that this node had been running for some time. I'm also noticing that compacted SSTable files were removed meaning that data was already on this cluster. Did you perhaps send me a different log file? anthonyu on "How to get Brisk AMI working for a whole cluster of nodes?" http://www.datastax.com/support-forums/topic/how-to-get-brisk-ami-working-for-a-whole-cluster-of-nodes#post-452 Thu, 18 Aug 2011 22:40:34 +0000 anthonyu 452@http://www.datastax.com/support-forums/ There was no workload, this was a freshly booted AMI on a cluster of m1.large instances that had never had any data loaded. joaquin on "How to get Brisk AMI working for a whole cluster of nodes?" http://www.datastax.com/support-forums/topic/how-to-get-brisk-ami-working-for-a-whole-cluster-of-nodes#post-451 Thu, 18 Aug 2011 21:40:10 +0000 joaquin 451@http://www.datastax.com/support-forums/ If you can try this setting as well: sudo bash -c "echo 1 > /proc/sys/vm/overcommit_memory" this will also help and alleviate some pressure. It should already be in the AMI codebase, but will be updated soon so that way the change can be permanent as well. Thanks, Joaquin joaquin on "How to get Brisk AMI working for a whole cluster of nodes?" http://www.datastax.com/support-forums/topic/how-to-get-brisk-ami-working-for-a-whole-cluster-of-nodes#post-450 Thu, 18 Aug 2011 21:35:01 +0000 joaquin 450@http://www.datastax.com/support-forums/ Hello, Looking at your logs everything seems to be in order for the AMI setup. It appears as though your cluster is in order and running for 2 hours until: ERROR [Thread-70] 2011-08-18 15:37:21,847 AbstractCassandraDaemon.java (line 113) Fatal exception in thread Thread[Thread-70,5,main] java.lang.OutOfMemoryError: Java heap space at org.apache.cassandra.net.Message$MessageSerializer.deserialize(Message.java:148) at org.apache.cassandra.net.Message$MessageSerializer.deserialize(Message.java:131) at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:116) The AMI is to help with the initial setup and launch of a Cassandra cluster and is typically a great dev and initial testing environment. The error that you are running into is hit because the memory isn't properly tuned to the current workload. You can visit this website here: <a href="http://datastax.com/support/tuning" rel="nofollow">http://datastax.com/support/tuning</a> for more information on correctly tuning for your application. Once the memory is correctly tuned, then by simply running 'sudo service cassandra start', the Cassandra service will relaunch and you should be in working order. Make sure to make the appropriate changes around the ring per node. May I ask what sort of workload you were running and how many keyspaces you were using? Thanks, Joaquin joaquin on "How to get Brisk AMI working for a whole cluster of nodes?" http://www.datastax.com/support-forums/topic/how-to-get-brisk-ami-working-for-a-whole-cluster-of-nodes#post-445 Thu, 18 Aug 2011 01:48:42 +0000 joaquin 445@http://www.datastax.com/support-forums/ If you could upload the ~/.startlog or send me an email at joaquin at datastax.com, I could further diagnose the problem. Looking over your options everything seems to be in order. Could you send me the tail end of your /var/log/cassandra/cassandra.log and /var/log/cassandra/system.log as well? Thanks, Joaquin anthonyu on "How to get Brisk AMI working for a whole cluster of nodes?" http://www.datastax.com/support-forums/topic/how-to-get-brisk-ami-working-for-a-whole-cluster-of-nodes#post-444 Thu, 18 Aug 2011 01:29:56 +0000 anthonyu 444@http://www.datastax.com/support-forums/ I cannot seem to be able to start a cluster where all nodes make it to the Up state. Even with only six nodes, at least one hangs forever when trying to log in: Cluster started with these options: -s 6 -c 2 -n pipeline Waiting for nodetool... (The cluster is now booting up. This should only take a moment.) ^CTraceback (most recent call last): File ".motd.py", line 60, in <module> retcode = subprocess.call(shlex.split(nodetoolStatement), stderr=subprocess.PIPE, stdout=subprocess.PIPE) File "/usr/lib/python2.6/subprocess.py", line 470, in call return Popen(*popenargs, **kwargs).wait() File "/usr/lib/python2.6/subprocess.py", line 1182, in wait pid, sts = _eintr_retry_call(os.waitpid, self.pid, 0) File "/usr/lib/python2.6/subprocess.py", line 455, in _eintr_retry_call return func(*args) KeyboardInterrupt I hit ctrl-c and broke out of the eternal wait which is caused by receiving this exception in a while loop: ubuntu@ip-10-251-135-80:~$ brisk/resources/cassandra/bin/nodetool -h localhost ring Error connection to remote JMX agent! java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: localhost; nested exception is: java.net.ConnectException: Connection refused] at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:338) at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:248) at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:141) at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111) at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:559) Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: localhost; nested exception is: java.net.ConnectException: Connection refused] at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:101) at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:185) at javax.naming.InitialContext.lookup(InitialContext.java:392) at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1886) at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1856) at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:257) ... 4 more Caused by: java.rmi.ConnectException: Connection refused to host: localhost; nested exception is: java.net.ConnectException: Connection refused at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601) at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198) at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184) at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322) at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source) at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:97) ... 9 more Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at java.net.Socket.connect(Socket.java:478) at java.net.Socket.<init>(Socket.java:375) at java.net.Socket.<init>(Socket.java:189) at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:22) at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:128) at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595) ... 14 more I am using ami-da22dab3 in EC2 zone us-east-1b. Is Brisk or this AMI just not yet ready for prime-time? Anyone have any suggestions? joaquin on "Can't build brisk from source" http://www.datastax.com/support-forums/topic/cant-build-brisk-from-source#post-433 Fri, 12 Aug 2011 01:59:14 +0000 joaquin 433@http://www.datastax.com/support-forums/ I didn't think to check for that. Glad it worked! hpjohnc on "Can't build brisk from source" http://www.datastax.com/support-forums/topic/cant-build-brisk-from-source#post-432 Fri, 12 Aug 2011 01:19:33 +0000 hpjohnc 432@http://www.datastax.com/support-forums/ It started working after the repo came back up - thanks! And thanks for letting me know in #datastax-brisk too! joaquin on "Can't build brisk from source" http://www.datastax.com/support-forums/topic/cant-build-brisk-from-source#post-428 Thu, 11 Aug 2011 22:27:52 +0000 joaquin 428@http://www.datastax.com/support-forums/ We were currently performing maintenance on the repository, but it should now be back up. In the future, if this were to ever happen again, feel free to use: the Debian package here: <a href="http://debian.datastax.com/" rel="nofollow">http://debian.datastax.com/</a>, the tarballs found here: <a href="https://github.com/riptano/brisk" rel="nofollow">https://github.com/riptano/brisk</a>, or this guide for a packaged install: <a href="http://www.datastax.com/docs/0.8/brisk/install_brisk_packages" rel="nofollow">http://www.datastax.com/docs/0.8/brisk/install_brisk_packages</a>. Sorry for the inconvenience this may have caused. hpjohnc on "Can't build brisk from source" http://www.datastax.com/support-forums/topic/cant-build-brisk-from-source#post-427 Thu, 11 Aug 2011 22:10:38 +0000 hpjohnc 427@http://www.datastax.com/support-forums/ I am trying to build brisk from scratch. I have tried from both a clone of git://github.com/riptano/brisk.git, and from the "official" source tarball linked from the website. I keep getting dependency failures seemingly because of a password-protected maven repo: <code> BUILD FAILED /tmp/brisk/brisk-1.0~beta2-src/build.xml:246: Unable to resolve artifact: Missing: ---------- 1) org.apache.cassandra.deps:libthrift:jar:0.6.0 Try downloading the file manually from the project website. Then, install it using the command: mvn install:install-file -DgroupId=org.apache.cassandra.deps -DartifactId=libthrift -Dversion=0.6.0 -Dpackaging=jar -Dfile=/path/to/file Alternatively, if you host your own repository you can deploy the file there: mvn deploy:deploy-file -DgroupId=org.apache.cassandra.deps -DartifactId=libthrift -Dversion=0.6.0 -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] Path to dependency: 1) org.apache.maven:super-pom:jar:2.0 2) org.apache.cassandra:apache-cassandra:jar:0.8.1-brisk1-beta2 3) org.apache.cassandra.deps:libthrift:jar:0.6.0 2) org.github:jamm:jar:0.2.1 Try downloading the file manually from the project website. Then, install it using the command: mvn install:install-file -DgroupId=org.github -DartifactId=jamm -Dversion=0.2.1 -Dpackaging=jar -Dfile=/path/to/file Alternatively, if you host your own repository you can deploy the file there: mvn deploy:deploy-file -DgroupId=org.github -DartifactId=jamm -Dversion=0.2.1 -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] Path to dependency: 1) org.apache.maven:super-pom:jar:2.0 2) org.apache.cassandra:apache-cassandra:jar:0.8.1-brisk1-beta2 3) org.github:jamm:jar:0.2.1 ---------- 2 required artifacts are missing. for artifact: org.apache.maven:super-pom:jar:2.0 from the specified remote repositories: datastax-release (<a href="http://mvn.riptano.com/content/repositories/releases)" rel="nofollow">http://mvn.riptano.com/content/repositories/releases)</a>, datastax-deps (<a href="http://mvn.riptano.com/content/repositories/public)" rel="nofollow">http://mvn.riptano.com/content/repositories/public)</a>, central (<a href="http://repo1.maven.org/maven2)" rel="nofollow">http://repo1.maven.org/maven2)</a>, xerial (<a href="http://maven.xerial.org/repository/snapshot)" rel="nofollow">http://maven.xerial.org/repository/snapshot)</a>, apache (<a href="https://repository.apache.org/content/repositories/releases)" rel="nofollow">https://repository.apache.org/content/repositories/releases)</a>, java.net2 (<a href="http://download.java.net/maven/2)" rel="nofollow">http://download.java.net/maven/2)</a>, datastax-snapshot (<a href="http://mvn.riptano.com/content/repositories/snapshots" rel="nofollow">http://mvn.riptano.com/content/repositories/snapshots</a>) </code> skwash on "Hive hwi 404 not found" http://www.datastax.com/support-forums/topic/hive-hwi-404-not-found#post-380 Thu, 28 Jul 2011 15:38:49 +0000 skwash 380@http://www.datastax.com/support-forums/ I seem to be getting a 404 when trying to access the Hive HWI. I'm starting it up with the following: <code> $ brisk hive --service hwi 11/07/28 08:32:00 INFO hwi.HWIServer: HWI is starting up 11/07/28 08:32:00 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 11/07/28 08:32:00 INFO mortbay.log: jetty-6.1.26 11/07/28 08:32:00 INFO mortbay.log: Extract /usr/share/brisk/hive/lib/hive-hwi-brisk.war to /tmp/Jetty_0_0_0_0_9999_hive.hwi.brisk.war__hwi__.luio7y/webapp 11/07/28 08:32:01 INFO mortbay.log: Started SocketConnector@0.0.0.0:9999 </code><code> And when I attempt to access it in a browser i receive a 404: </code><code> HTTP ERROR: 404 Problem accessing /. Reason: NOT_FOUND Powered by Jetty:// </code> Any ideas? Is there some configuration missing or incorrect somewhere? agriffith on "Brisk - Pig - Return RowKey and Timestamp" http://www.datastax.com/support-forums/topic/brisk-pig#post-292 Tue, 12 Jul 2011 23:17:28 +0000 agriffith 292@http://www.datastax.com/support-forums/ Is there an easy way to retrieve the RowKey and Timestamp from data in a cassandra column family? I can get back all the column names and values, but the RowKey value is always missing. When I try something like FOREACH rows GENERATE RowKey, COUNT($1); I get the correct result, I just can't see what RowKeys have what counts. ie: (,2) (,1) Where RowKey x has 2 values and RowKey Y has one value. I have no idea how to retrieve the timestamp information. Thanks!