Support Forums : DataStax

Pig and Hive queries not working in DSE-2.2.1

(3 posts) (3 voices)

Tags:

No tags yet.

habeebraja
Member

Hi,

We have 4 node cluster of DSE version 2.2.1. The nodes descriptions below,

1 - Cassandra
1 - Cassandra Seed
1 - Analytics Seed
1 - Analytics

We ran a pig script in analytics seed node. We could monitor the MapReduce job through browser(<public_ip>:50030).

The Maps jobs completed 100% and Reduce jobs completed only 23.17% after that its not moving further for so many hours.

The same issue with Hive queries also.

Note: The process is still running on that machine. The script also not complicated. Just a simple script to dump the records. Pig and Hive not used simultaneously.

Is there anything need to configure?

Thanks in advance.

Posted 5 months ago #
Piotr Kołaczkowski
Administrator

Are there any errors reported in system.log? E.g about failed tasks?
What is the load on the machines, when the task is "not moving further"?
Especially, have you given enough memory for your reducers? Can you check with jmap that the dse daemon process has enough free heap space?

Posted 4 months ago #
ssach03
Member

Had the same issue. In my case I increased the memory and that resolved my issue.

Posted 4 months ago #

You must log in to post.