Last change
on this file since 120 was
120,
checked in by (none), 14 years ago
|
Added the mail files for the Hadoop JUNit Project
|
-
Property svn:executable set to
*
|
File size:
680 bytes
|
Line | |
---|
1 | #!/usr/bin/env bash |
---|
2 | |
---|
3 | GRID_DIR=`dirname "$0"` |
---|
4 | GRID_DIR=`cd "$GRID_DIR"; pwd` |
---|
5 | source $GRID_DIR/../gridmix-env |
---|
6 | |
---|
7 | NUM_OF_REDUCERS=$NUM_OF_REDUCERS_FOR_MEDIUM_JOB |
---|
8 | INDIR="${VARINFLTEXT}/{part-000*0,part-000*1,part-000*2}" |
---|
9 | Date=`date +%F-%H-%M-%S-%N` |
---|
10 | |
---|
11 | OUTDIR=perf-out/pipe-out-dir-medium_$Date |
---|
12 | ${HADOOP_HOME}/bin/hadoop dfs -rmr $OUTDIR |
---|
13 | |
---|
14 | |
---|
15 | ${HADOOP_HOME}/bin/hadoop pipes -input $INDIR -output $OUTDIR -inputformat org.apache.hadoop.mapred.KeyValueTextInputFormat -program ${GRID_MIX_PROG}/pipes-sort -reduces $NUM_OF_REDUCERS -jobconf mapred.output.key.class=org.apache.hadoop.io.Text,mapred.output.value.class=org.apache.hadoop.io.Text -writer org.apache.hadoop.mapred.TextOutputFormat |
---|
16 | |
---|
Note: See
TracBrowser
for help on using the repository browser.