欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  数据库

hadoop1.2.1下编译及安装eclipse4.2插件

程序员文章站 2022-05-30 15:13:51
...

?xmlversion=”1.0″encoding=”UTF-8″standalone=”no”? !– LicensedtotheApacheSoftwareFoundation(ASF)underoneormore contributorlicenseagreements.SeetheNOTICEfiledistributedwith thisworkforadditionalinformationregardingcopyrightownership.

  1. ?xml version=”1.0″ encoding=”UTF-8″ standalone=”no”?>
  2. Licensed to the Apache Software Foundation (ASF) under one or more
  3. contributor license agreements. See the NOTICE file distributed with
  4. this work for additional information regarding copyright ownership.
  5. The ASF licenses this file to You under the Apache License, Version 2.0
  6. (the ”License”); you may not use this file except in compliance with
  7. the License. You may obtain a copy of the License at
  8. http://www.apache.org/licenses/LICENSE-2.0
  9. Unless required by applicable law or agreed to in writing, software
  10. distributed under the License is distributed on an ”AS IS” BASIS,
  11. WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  12. See the License for the specific language governing permissions and
  13. limitations under the License.
  14. –>
  15. encoding=”${build.encoding}”
  16. srcdir=”${src.dir}”
  17. includes=”**/*.java”
  18. destdir=”${build.classes}”
  19. debug=”${javac.debug}”
  20. deprecation=”${javac.deprecation}”>
  21. –>
  22. jarfile=”${build.dir}/hadoop-${name}-${version}.jar”
  23. manifest=”${root}/META-INF/MANIFEST.MF”>

5,修改build-contrib.xml文件

添加如下路径

6,修改META-INF/MANIFEST.MF文件

最终文件为:

  1. Manifest-Version: 1.0
  2. Bundle-ManifestVersion: 2
  3. Bundle-Name: MapReduce Tools for Eclipse
  4. Bundle-SymbolicName: org.apache.hadoop.eclipse;singleton:=true
  5. Bundle-Version: 0.18
  6. Bundle-Activator: org.apache.hadoop.eclipse.Activator
  7. Bundle-Localization: plugin
  8. Require-Bundle: org.eclipse.ui,
  9. org.eclipse.core.runtime,
  10. org.eclipse.jdt.launching,
  11. org.eclipse.debug.core,
  12. org.eclipse.jdt,
  13. org.eclipse.jdt.core,
  14. org.eclipse.core.resources,
  15. org.eclipse.ui.ide,
  16. org.eclipse.jdt.ui,
  17. org.eclipse.debug.ui,
  18. org.eclipse.jdt.debug.ui,
  19. org.eclipse.core.expressions,
  20. org.eclipse.ui.cheatsheets,
  21. org.eclipse.ui.console,
  22. org.eclipse.ui.navigator,
  23. org.eclipse.core.filesystem,
  24. org.apache.commons.logging
  25. Eclipse-LazyStart: true
  26. Bundle-ClassPath: classes/,lib/hadoop-core.jar,lib/jackson-core-asl-1.8.8.jar ,lib/jackson-mapper-asl-1.8.8.jar, lib/commons-configuration-1.6.jar,lib/commons-lang-2.4.jar, lib/commons-httpclient-3.0.1.jar,lib/commons-cli-1.2.jar
  27. Bundle-Vendor: Apache Hadoop

7,保存完毕后,开始编译我们自己的插件。右击MapReduceTools工程,选择Properties,选择Builders,点击右侧的New,命名为Plugin_Builder,选择Ant Builder,BuildFile选择MapReduceTools里的build.xml文件,然后点击确定。

8,开始编译。点击eclipse的Project选项,选择Build Project,然后编译成功。编译后的jar文件放在hadoop安装目录下的build文件夹里,contrib下,有个hadoop-eclipse-1.2.1.jar文件,将其赋值到eclipse下的plugin里。

Ps.我在这里遇到了一个问题,有一个警告,说是无法复制hadoop目录下的hadoop-core-${version}.jar文件,我暂时没解决,但是好像没什么影响,只是生成的jar文件是hadoop-eclipse-${version}.jar文件,如果有其他人遇到并且解决了,麻烦告诉我一下,我的解决方法是将名字改正确然后复制过去的,发现也可以用。

9.打开eclipse,打开Window——Preferences,选择左侧的Hadoop Map/Reduce,然后指定自己安装的hadoop目录,点击确定。再打开Window——Open Perspective——other,选择MapReduce蓝色的小象,此时下方出现MapReduce Location,右键单击New Hadoop Location,开始配置hadoop变量。

10,进入New Hadoop location后,定义你的location name,然后选择和你的hadoop目录下core-site.xml文件一致的主机名和端口,并在Advanced parameters里找到两个重要的参数,

修改 hadoop.tmp.dir 为你 hadoop 集群中设置的目录
修改 dfs.replication 为你 hdfs-site.xml 文件中配置的值

然后确定。此时确保你的hadoop服务已经开启,接下来就可以在左侧的DFS Location下找到你hadoop环境下的目录,以后如果编译程序也会很方便。

至此,hadoop-eclipse-1.2.1.jar安装完成。