The number of tasks for this job 310335 exceeds the configured limit 200000

运行 hadoop mapreduce 任务报错:

The number of tasks for this job 310335 exceeds the configured limit 200000

解决方法:

TextInputFormat 修改为 CombineTextInputFormat

Reference:

https://stackoverflow.com/questions/25104752/avoiding-the-number-of-tasks-for-this-job-100325-exceeds-the-configured-limit


版权声明:本文为number59原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接和本声明。