Monday, May 16, 2016

install hadoop in ubuntu



1. link
http://www.bogotobogo.com/Hadoop/BigData_hadoop_Install_on_ubuntu_single_node_cluster.php



2.

 Exception in thread "main" java.lang.IllegalArgumentException: Invalid URI for NameNode address (check fs.defaultFS): file:/// has no authority.


hduser@layer1athome:/usr/local$ ls -all /app/hadoop/tmp
總計 8
drwxr-xr-x 2 hduser hadoop 4096  5月 16 11:49 .
drwxr-xr-x 3 root   root   4096  5月 16 11:49 ..
hduser@layer1athome:/usr/local$ 


3. 
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable


4. 
start-dfs.sh
16/05/16 15:58:24 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.

add this 有解:
export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/native"


Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.


解法:

結果:namenode and data node 出現了
manager-layer1athome.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-hduser-nodemanager-layer1athome.out
hduser@layer1athome:/$ jps
1804 SecondaryNameNode
2000 ResourceManager
2254 NodeManager
2679 Jps
1603 DataNode
1436 NameNode
hduser@layer1athome:/$ 


No comments:

Post a Comment