I am having trouble running my map reduce job on my DSE 2.0-1 cluster. When I run the job, the mappers run for a while on all the analytics nodes in my cluster. When they try to spill the mapper output to disk, though, they fail. The message in the log is:
Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for output/spill1.out
I have tried setting mapred.local.dir in the $DSE_HOME/resources/hadoop/conf/taskcontroller.cfg file but I get the same error.
Any advice would be appreciated.