2010-01-07 20:30:22,590 DEBUG org.apache.hadoop.mapred.TaskTracker: Child starting 2010-01-07 20:30:23,086 DEBUG org.apache.hadoop.mapred.TaskTracker: /tmp/hadoop-mgruber/mapred/local/taskTracker/jobcache/job_201001072026_0002/attempt_201001072026_0002_r_000000_0/job.xml 2010-01-07 20:30:23,086 DEBUG org.apache.hadoop.mapred.TaskTracker: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, /tmp/hadoop-mgruber/mapred/local/taskTracker/jobcache/job_201001072026_0002/attempt_201001072026_0002_r_000000_0/job.xml 2010-01-07 20:30:23,087 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId= 2010-01-07 20:30:23,234 DEBUG org.apache.hadoop.mapred.TaskTracker: /Users/mgruber/pp/hadoop-0.20.1/bin/../conf:/System/Library/Frameworks/JavaVM.framework/Versions/1.6/Home//lib/tools.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/classes:/Users/mgruber/pp/hadoop-0.20.1/bin/../build:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/test/classes:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/tools:/Users/mgruber/pp/hadoop-0.20.1/bin/..:/Users/mgruber/pp/hadoop-0.20.1/bin/../hadoop-*-core.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-cli-1.2.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-codec-1.3.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-el-1.0.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-httpclient-3.0.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-logging-1.0.4.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-logging-api-1.0.4.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/commons-net-1.4.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/core-3.1.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/hsqldb-1.8.0.10.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jasper-compiler-5.5.12.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jasper-runtime-5.5.12.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jets3t-0.6.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jetty-6.1.14.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jetty-util-6.1.14.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/junit-4.7.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/kfs-0.2.2.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/log4j-1.2.15.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/oro-2.0.8.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/slf4j-api-1.4.3.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/slf4j-log4j12-1.4.3.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/xmlenc-0.52.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-cli-1.2.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-codec-1.3.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-el-1.0.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-httpclient-3.0.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-logging-1.0.4.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-logging-api-1.0.4.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/commons-net-1.4.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/core-3.1.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/jasper-compiler-5.5.12.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/jasper-runtime-5.5.12.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/jets3t-0.6.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/jetty-6.1.14.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/jetty-util-6.1.14.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/log4j-1.2.15.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/oro-2.0.8.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/servlet-api-2.5-6.1.14.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/slf4j-api-1.4.3.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/slf4j-log4j12-1.4.3.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../build/ivy/lib/Hadoop/common/xmlenc-0.52.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jsp-2.1/jsp-2.1.jar:/Users/mgruber/pp/hadoop-0.20.1/bin/../lib/jsp-2.1/jsp-api-2.1.jar::/tmp/hadoop-mgruber/mapred/local/taskTracker/jobcache/job_201001072026_0002/jars/classes:/tmp/hadoop-mgruber/mapred/local/taskTracker/jobcache/job_201001072026_0002/jars:/tmp/hadoop-mgruber/mapred/local/taskTracker/archive/imac.local/Users/mgruber/pp/hadoop-0.20.1/lib/junit-4.7.jar/junit-4.7.jar:/tmp/hadoop-mgruber/mapred/local/taskTracker/jobcache/job_201001072026_0002/attempt_201001072026_0002_r_000000_0/work 2010-01-07 20:30:23,344 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=144506880, MaxSingleShuffleLimit=36126720 2010-01-07 20:30:23,397 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Thread started: Thread for merging on-disk files 2010-01-07 20:30:23,397 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Thread waiting: Thread for merging on-disk files 2010-01-07 20:30:23,397 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Thread started: Thread for merging in memory files 2010-01-07 20:30:23,399 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Thread started: Thread for polling Map Completion Events 2010-01-07 20:30:23,399 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Need another 1 map output(s) where 0 is already in progress 2010-01-07 20:30:23,400 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2010-01-07 20:30:23,404 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0: Got 1 new map-outputs 2010-01-07 20:30:28,401 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201001072026_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2010-01-07 20:30:28,549 INFO org.apache.hadoop.mapred.ReduceTask: header: attempt_201001072026_0002_m_000000_0, compressed len: 7572, decompressed len: 7568 2010-01-07 20:30:28,549 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 7568 bytes (7572 raw bytes) into RAM from attempt_201001072026_0002_m_000000_0 2010-01-07 20:30:28,571 INFO org.apache.hadoop.mapred.ReduceTask: Read 7568 bytes from map-output for attempt_201001072026_0002_m_000000_0 2010-01-07 20:30:28,576 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_201001072026_0002_m_000000_0 -> (17, 81) from 192.168.1.2 2010-01-07 20:30:29,426 INFO org.apache.hadoop.mapred.ReduceTask: GetMapEventsThread exiting 2010-01-07 20:30:29,426 INFO org.apache.hadoop.mapred.ReduceTask: getMapsEventsThread joined. 2010-01-07 20:30:29,426 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2010-01-07 20:30:29,426 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 0 files left. 2010-01-07 20:30:29,426 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 1 files left. 2010-01-07 20:30:29,601 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2010-01-07 20:30:29,602 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 7568 bytes 2010-01-07 20:30:29,607 INFO org.apache.hadoop.mapred.ReduceTask: Merged 1 segments, 7568 bytes to disk to satisfy reduce memory limit 2010-01-07 20:30:29,608 INFO org.apache.hadoop.mapred.ReduceTask: Merging 1 files, 7572 bytes from disk 2010-01-07 20:30:29,612 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce 2010-01-07 20:30:29,612 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2010-01-07 20:30:29,616 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 7568 bytes 2010-01-07 20:30:29,872 INFO org.apache.hadoop.mapred.TaskRunner: Task:attempt_201001072026_0002_r_000000_0 is done. And is in the process of commiting 2010-01-07 20:30:32,920 INFO org.apache.hadoop.mapred.TaskRunner: Task attempt_201001072026_0002_r_000000_0 is allowed to commit now 2010-01-07 20:30:32,946 INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_201001072026_0002_r_000000_0' to junit_results8465787555501898442 2010-01-07 20:30:32,950 INFO org.apache.hadoop.mapred.TaskRunner: Task 'attempt_201001072026_0002_r_000000_0' done.