hadoop @ node1: ~ / hadoop $ bin / start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-mapred.sh
starting namenode, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-namenode-node1.out
node3: starting datanode, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-datanode-node3.out
node2: starting datanode, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-datanode-node2.out
node1: starting secondarynamenode, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-secondarynamenode-node1.out
starting jobtracker, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-jobtracker-node1.out
node3: starting tasktracker, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-tasktracker-node3.out
node2: starting tasktracker, logging to / home/hadoop/hadoop/bin/../logs/hadoop-hadoop-tasktracker-node2.out
hadoop @ node1: ~ / hadoop $ jps
16993 SecondaryNameNode
17210 Jps
hadoop @ node1: ~ / hadoop $
great God who said, according to the online delete all the files in the tmp and reformat namenode startup is still the same.
configuration is as follows:
hadoop @ node1: ~ / hadoop / conf $ cat core-site.xml
hadoop @ node1: ~ / hadoop / conf $ cat hdfs-site.xml
hadoop @ node1: ~ / hadoop / conf $ cat mapred-site.xml
jobtracker log file is as follows :
2006-03-11 23:54:44,348 FATAL org.apache.hadoop.mapred.JobTracker: java.net.BindException: Problem binding to masternode/122.72.28.136 : 54311: Cannot assign requested address
at org.apache.hadoop.ipc.Server.bind (Server.java: 218)
at org.apache.hadoop.ipc.Server $ Listener.
at org.apache.hadoop.ipc.Server.
at org.apache.hadoop.ipc.RPC $ Server.
at org.apache.hadoop.ipc.WritableRpcEngine $ Server.
at org.apache.hadoop.ipc.WritableRpcEngine.getServer (WritableRpcEngine.java: 284)
at org.apache.hadoop.ipc.WritableRpcEngine.getServer (WritableRpcEngine.java: 45)
at org.apache.hadoop.ipc.RPC.getServer (RPC.java: 331)
at org.apache.hadoop.mapred.JobTracker.
at org.apache.hadoop.mapred.JobTracker.startTracker (JobTracker.java: 258)
at org.apache.hadoop.mapred.JobTracker.startTracker (JobTracker.java: 250)
at org.apache.hadoop.mapred.JobTracker.startTracker (JobTracker.java: 245)
at org.apache.hadoop.mapred.JobTracker.main (JobTracker.java: 4164)
Caused by: java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.bind (Native Method)
at sun.nio.ch.ServerSocketChannelImpl.bind (ServerSocketChannelImpl.java: 119)
at sun.nio.ch.ServerSocketAdaptor.bind (ServerSocketAdaptor.java: 59)
at org.apache.hadoop.ipc.Server.bind (Server.java: 216)
... 12 more
2006-03-11 23:54:44,353 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG:
/ ********************************************* ***************
SHUTDOWN_MSG: Shutting down JobTracker at node1/192.168.10.237
********************************************** ************** /
namenode log file as follows:
2006-03-11 23:54:37,009 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.BindException: Problem binding to masternode / 122.72.28.136:54310: Cannot assign requested address
at org.apache.hadoop.ipc.Server.bind (Server.java: 218)
at org.apache.hadoop.ipc.Server $ Listener.
at org.apache.hadoop.ipc.Server.
at org.apache.hadoop.ipc.RPC $ Server.
at org.apache.hadoop.ipc.WritableRpcEngine $ Server.
at org.apache.hadoop.ipc.WritableRpcEngine.getServer (WritableRpcEngine.java: 284)
at org.apache.hadoop.ipc.WritableRpcEngine.getServer (WritableRpcEngine.java: 45)
at org.apache.hadoop.ipc.RPC.getServer (RPC.java: 331)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize (NameNode.java: 305)
at org.apache.hadoop.hdfs.server.namenode.NameNode.
at org.apache.hadoop.hdfs.server.namenode.NameNode.
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode (NameNode.java: 1359)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main (NameNode.java: 1368)
Caused by: java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.bind (Native Method)
at sun.nio.ch.ServerSocketChannelImpl.bind (ServerSocketChannelImpl.java: 119)
at sun.nio.ch.ServerSocketAdaptor.bind (ServerSocketAdaptor.java: 59)
at org.apache.hadoop.ipc.Server.bind (Server.java: 216)
... 12 more
2006-03-11 23:54:37,010 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/ ********************************************* ***************
SHUTDOWN_MSG: Shutting down NameNode at node1/192.168.10.237
********************************************** ************** /
Guiqiu solution
------ Solution ----------------------- ---------------------
posted about other configurations
HADOOP MASTER
HADOOP SLAVER
/ etc / hosts file
/ etc / profile file
/ etc / sysconfig / network file
------ Solution ---------------------------- ----------------
your configuration bit strange
HDFS:
fs.default.name => hdfs :/ / masternode: 54310
MAPREDUCE:
mapred.job.tracker => masternode: 54311
But your HOST file / etc / hosts
did not masternode
NAMENODE and JOBTRACKER in the end of your deployment Where?
192.168.10.237 node1.node1 node1
192.168.10.238 node2
192.168.10.239 node3
If you NAMENODE and JOBTRACKER deployed on 192.168.10.237
That configuration should be done
fs.default.name => hdfs :/ / node1: 54310
mapred.job.tracker => http://node1:54311
be reconfigured according to this method, and update each machine HOST, ensuring no problem.
If not enough, the / etc / sysconfig / network file posted out reanalysis
------ Solution ------------------- -------------------------
changed the configuration file masternode try
------ For 192.168.10.237 reference only ---------------------------------------
hadoop @ node1: ~ / hadoop / conf $ cat masters
node1
hadoop @ node1: ~ / hadoop / conf $ cat slaves
node2
node3
hadoop @ node1: ~ / hadoop / conf $ cat / etc / hosts
127.0.0.1 localhost
192.168.10.237 node1.node1 node1
192.168.10.238 node2
192.168.10.239 node3
my environment variables are placed. bashrc inside
cat. bashrc
export JAVA_HOME = / usr/lib/jvm/sunjdk6
export JRE_HOME = $ {JAVA_HOME} / jre
export CLASS_PATH =.: $ {JAVA_HOME} / lib: $ {JRE_HOME} / lib
export HADOOP_HOME = / home / hadoop / hadoop
export PATH = $ JAVA_HOME / bin: $ HADOOP_HOME / bin: $ PATH
------ For reference only ---------------------------------- -----
determine your log files more
masternode domain names point to the IP address is 122.72.28.136
you have a cluster of four or three?
make sure NAMENODE and JOBTRACKER deployment location, and then reconfigure fs.default.name and mapred.job.tracker
------ For reference only ------ ---------------------------------
Thank you very much "tntzbzc" heroes, Oh, that is the problem here, my host name called "nodeX" in the configuration hdfs and mapred time but with a master and a slave, so namenode above procedures should be started Can not find the host name.
Thank you one! ! ! !
没有评论:
发表评论