欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页

eclipse提交mr到hadoop集群后任务卡住不执行

程序员文章站 2024-01-23 16:35:40
...

用eclipse远程提交mr到hadoop集群后,mr卡住后一直不执行,在控制台查日志发现错误如下:

org.apache.hadoop.ipc.Client: Retrying connect to server:127.0.0.1:8030. Already tried 0time(s).org.apache.hadoop.ipc.Client: Retrying connect to server:127.0.0.1:8030. Already tried 1time(s).org.apache.hadoop.ipc.Client: Retrying connect to server:127.0.0.1:8030. Already tried 2time(s).

果断把跟8030有关的端口配置到Configuration 里,问题解决,Configuration配置如下:

 Configuration conf = new Configuration();
 conf.set("fs.defaultFS", "hdfs://master190:9000/");
 conf.set("mapreduce.framework.name", "yarn");
 conf.set("yarn.resourcemanager.address", "master190:8032");
 conf.set("yarn.resourcemanager.scheduler.address", "master190:8030");
 conf.set("hbase.zookeeper.quorum", "master190,slave191,slave192,slave193");     

 

注:错误原因是没有配置红色部分