运行Mapreduce程序时出错

在运行Map-reduce程序时出现以下错误。运行Mapreduce程序时出错

The program is to sort the o/p using TotalOrderpartition. 

I have 2 node cluster. 
when i run teh program with -D mapred.reduce.tasks=2 its working fine 
But its failing with below error while running with -D mapred.reduce.tasks=3 option. 


java.lang.RuntimeException: Error in configuring object 
     at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) 
     at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) 
     at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) 
     at org.apache.hadoop.mapred.MapTask$OldOutputCollector.<init>(MapTask.java:448) 
     at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) 
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) 
     at org.apache.hadoop.mapred.Child.main(Child.java:170) 
Caused by: java.lang.reflect.InvocationTargetException 
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) 
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) 
     at java.lang.reflect.Method.invoke(Method.java:597) 
     at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) 
     ... 6 more 
Caused by: java.lang.IllegalArgumentException: Can't read partitions file 
     at org.apache.hadoop.mapred.lib.TotalOrderPartitioner.configure(TotalOrderPartitioner.java:91) 
     ... 11 more 
Caused by: java.io.IOException: Split points are out of order 
     at org.apache.hadoop.mapred.lib.TotalOrderPartitioner.configure(TotalOrderPartitioner.java:78) 
     ... 11 more 

Plese let me know whats wrong here? 

Thanks 
R

来源

2011-08-18 MRK