DataStax Support Forums » Topic: Problem with hadoop pi example...

DataStax Support Forums » Topic: Problem with hadoop pi example... http://www.datastax.com/support-forums/topic/problem-with-hadoop-pi-example Software, Support, and Training for Apache Cassandra en-US Fri, 24 May 2013 07:00:07 +0000 http://bbpress.org/?v=1.0.3 <![CDATA[Search]]> q http://www.datastax.com/support-forums/search.php matt on "Problem with hadoop pi example..." http://www.datastax.com/support-forums/topic/problem-with-hadoop-pi-example#post-155 Sat, 11 Jun 2011 13:44:46 +0000 matt 155@http://www.datastax.com/support-forums/ Not sure if this is indicative of anything, but I thought I should post these results just in case... I tried running the hadoop pi example, and after it gets all the way through the job, it fails with "java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result." brisk hadoop jar local/brisk/resources/hadoop/hadoop-examples-0.20.203.1-20110602.220139-6.jar pi 18 10000 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/cassandra/local/brisk-0.0.1-mrgeo2/resources/cassandra/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/cassandra/local/brisk-0.0.1-mrgeo2/resources/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See <a href="http://www.slf4j.org/codes.html#multiple_bindings" rel="nofollow">http://www.slf4j.org/codes.html#multiple_bindings</a> for an explanation. Number of Maps = 18 Samples per Map = 10000 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/cassandra/local/brisk-0.0.1-mrgeo2/resources/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/cassandra/local/brisk-0.0.1-mrgeo2/resources/cassandra/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See <a href="http://www.slf4j.org/codes.html#multiple_bindings" rel="nofollow">http://www.slf4j.org/codes.html#multiple_bindings</a> for an explanation. 11/06/11 00:13:55 INFO config.DatabaseDescriptor: Loading settings from file:/home/cassandra/local/brisk-0.0.1-mrgeo2/resources/cassandra/conf/cassandra.yaml 11/06/11 00:13:55 INFO config.DatabaseDescriptor: DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap 11/06/11 00:13:56 INFO fs.CassandraFileSystemThriftStore: Using storage:cfs Wrote input for Map #0 Wrote input for Map #1 Wrote input for Map #2 Wrote input for Map #3 Wrote input for Map #4 Wrote input for Map #5 Wrote input for Map #6 Wrote input for Map #7 Wrote input for Map #8 Wrote input for Map #9 Wrote input for Map #10 Wrote input for Map #11 Wrote input for Map #12 Wrote input for Map #13 Wrote input for Map #14 Wrote input for Map #15 Wrote input for Map #16 Wrote input for Map #17 Starting Job 11/06/11 00:13:56 INFO fs.CassandraFileSystemThriftStore: Using storage:cfs 11/06/11 00:13:56 INFO mapred.FileInputFormat: Total input paths to process : 18 11/06/11 00:13:57 INFO mapred.JobClient: Running job: job_201106101750_0001 11/06/11 00:13:58 INFO mapred.JobClient: map 0% reduce 0% 11/06/11 00:14:08 INFO mapred.JobClient: map 11% reduce 0% 11/06/11 00:14:12 INFO mapred.JobClient: map 55% reduce 0% d11/06/11 00:14:13 INFO mapred.JobClient: map 77% reduce 0% 11/06/11 00:14:15 INFO mapred.JobClient: map 100% reduce 0% 11/06/11 00:14:17 INFO mapred.JobClient: map 100% reduce 7% 11/06/11 00:15:11 INFO mapred.JobClient: map 100% reduce 100% 11/06/11 00:15:13 INFO mapred.JobClient: Job complete: job_201106101750_0001 11/06/11 00:15:13 INFO mapred.JobClient: Counters: 27 11/06/11 00:15:13 INFO mapred.JobClient: Job Counters 11/06/11 00:15:13 INFO mapred.JobClient: Launched reduce tasks=1 11/06/11 00:15:13 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=43305 11/06/11 00:15:13 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0 11/06/11 00:15:13 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0 11/06/11 00:15:13 INFO mapred.JobClient: Rack-local map tasks=1 11/06/11 00:15:13 INFO mapred.JobClient: Launched map tasks=18 11/06/11 00:15:13 INFO mapred.JobClient: Data-local map tasks=17 11/06/11 00:15:13 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=60999 11/06/11 00:15:13 INFO mapred.JobClient: File Input Format Counters 11/06/11 00:15:13 INFO mapred.JobClient: Bytes Read=2124 11/06/11 00:15:13 INFO mapred.JobClient: File Output Format Counters 11/06/11 00:15:13 INFO mapred.JobClient: Bytes Written=97 11/06/11 00:15:13 INFO mapred.JobClient: FileSystemCounters 11/06/11 00:15:13 INFO mapred.JobClient: FILE_BYTES_READ=147 11/06/11 00:15:13 INFO mapred.JobClient: FILE_BYTES_WRITTEN=339618 11/06/11 00:15:13 INFO mapred.JobClient: CFS_BYTES_READ=4202 11/06/11 00:15:13 INFO mapred.JobClient: CFS_BYTES_WRITTEN=215 11/06/11 00:15:13 INFO mapred.JobClient: Map-Reduce Framework 11/06/11 00:15:13 INFO mapred.JobClient: Map output materialized bytes=648 11/06/11 00:15:13 INFO mapred.JobClient: Map input records=18 11/06/11 00:15:13 INFO mapred.JobClient: Reduce shuffle bytes=612 11/06/11 00:15:13 INFO mapred.JobClient: Spilled Records=72 11/06/11 00:15:13 INFO mapred.JobClient: Map output bytes=324 11/06/11 00:15:13 INFO mapred.JobClient: Map input bytes=432 11/06/11 00:15:13 INFO mapred.JobClient: Combine input records=0 11/06/11 00:15:13 INFO mapred.JobClient: SPLIT_RAW_BYTES=2078 11/06/11 00:15:13 INFO mapred.JobClient: Reduce input records=36 11/06/11 00:15:13 INFO mapred.JobClient: Reduce input groups=36 11/06/11 00:15:13 INFO mapred.JobClient: Combine output records=0 11/06/11 00:15:13 INFO mapred.JobClient: Reduce output records=0 11/06/11 00:15:13 INFO mapred.JobClient: Map output records=36 Job Finished in 76.984 seconds java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result. at java.math.BigDecimal.divide(BigDecimal.java:1603) at org.apache.hadoop.examples.PiEstimator.estimate(PiEstimator.java:313) at org.apache.hadoop.examples.PiEstimator.run(PiEstimator.java:342) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.examples.PiEstimator.main(PiEstimator.java:351) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156)