欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  数据库

Hadoop2.x安装启动错误

程序员文章站 2022-04-21 22:45:08
...

Hadoop2安装笔记可以参看:http://www.geedoo.info/hadoop2-development-environment-to-build-test.html 这里主要记录下hadoop安装和测试过程遇到的问题记录: 1.问题一 安装配置完成后执行start-dfs.sh出现如下异常: sed: -e expression #1, char 6: unkn

Hadoop2安装笔记可以参看:http://www.geedoo.info/hadoop2-development-environment-to-build-test.html

这里主要记录下hadoop安装和测试过程遇到的问题记录:

1.问题一

安装配置完成后执行start-dfs.sh出现如下异常:

sed: -e expression #1, char 6: unknown option to `s'
have: ssh: Could not resolve hostname have: Name or service not known
loaded: ssh: Could not resolve hostname loaded: Name or service not known
VM: ssh: Could not resolve hostname VM: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
which: ssh: Could not resolve hostname which: Name or service not known
You: ssh: Could not resolve hostname You: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
might: ssh: Could not resolve hostname might: Name or service not known
have: ssh: Could not resolve hostname have: Name or service not known
guard.: ssh: Could not resolve hostname guard.: Name or service not known
Java: ssh: Could not resolve hostname Java: Name or service not known
disabled: ssh: Could not resolve hostname disabled: Name or service not known
The: ssh: Could not resolve hostname The: Name or service not known
will: ssh: Could not resolve hostname will: Name or service not known
VM: ssh: Could not resolve hostname VM: Name or service not known
try: ssh: Could not resolve hostname try: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
fix: ssh: Could not resolve hostname fix: Name or service not known
stack: ssh: Could not resolve hostname stack: Name or service not known
Server: ssh: Could not resolve hostname Server: Name or service not known
guard: ssh: Could not resolve hostname guard: Name or service not known
to: ssh: Could not resolve hostname to: Name or service not known
64-Bit: ssh: Could not resolve hostname 64-Bit: Name or service not known
you: ssh: Could not resolve hostname you: Name or service not known
highly: ssh: Could not resolve hostname highly: Name or service not known
-c: Unknown cipher type 'cd'
fix: ssh: Could not resolve hostname fix: Name or service not known
recommended: ssh: Could not resolve hostname recommended: Name or service not known
that: ssh: Could not resolve hostname that: Name or service not known
now.: ssh: Could not resolve hostname now.: Name or service not known
library: ssh: Could not resolve hostname library: Name or service not known
the: ssh: Could not resolve hostname the: Name or service not known
link: ssh: Could not resolve hostname link: Name or service not known
with: ssh: Could not resolve hostname with: Name or service not known
or: ssh: Could not resolve hostname or: Name or service not known
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Name or service not known
with: ssh: Could not resolve hostname with: Name or service not known
The authenticity of host '0.0.0.0 (0.0.0.0)' can't be established.
RSA key fingerprint is fa:8e:e6:aa:3f:f9:f0:0b:48:6e:40:ca:c2:f1:02:21.
Are you sure you want to continue connecting (yes/no)? it: ssh: connect to host it port 22: Connection refused
HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Name or service not known
warning:: ssh: Could not resolve hostname warning:: Name or service not known

出现上述问题,之后谷歌了很久,大部分说是配置hosts的问题,检查之后没发现问题。

问题的原因是没有设置hadoop的native本地库。

解决方案:
输出native环境变量
export HADOOP_COMMON_LIB_NATIVE_DIR=/app/cloud/hadoop/hadoop-2.4.0/lib/native

参考
http://*.com/questions/19943766/hadoop-unable-to-load-native-hadoop-library-for-your-platform-error-on-centos
http://*.com/questions/19775808/messed-up-sed-syntactics-in-hadoop-startup-script-after-reinstalling-jvm
http://*.com/questions/20011252/hadoop-2-2-0-64-bit-installing-but-cannot-start