2013年8月18日星期日

hadoop fs-put error

start-all starts normally, turn off the firewall, safemode also been closed, the pseudo fractions windows cygwin environment, in-put operation will still report the following error, experts advise yourselves, already tired one afternoon, fourth year hadoop, I have really no way out.

org.apache.hadoop.ipc.RemoteException: java.io.IOException: File / user/dz64/input4/wordcount.txt cou
ld only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock (FSNamesystem.java:
1271)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock (NameNode.java: 422)
at sun.reflect.GeneratedMethodAccessor9.invoke (Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 25)
at java.lang.reflect.Method.invoke (Method.java: 597)
at org.apache.hadoop.ipc.RPC $ Server.call (RPC.java: 508)
at org.apache.hadoop.ipc.Server $ Handler $ 1.run (Server.java: 959)
at org.apache.hadoop.ipc.Server $ Handler $ 1.run (Server.java: 955)
at java.security.AccessController.doPrivileged (Native Method)
at javax.security.auth.Subject.doAs (Subject.java: 396)
at org.apache.hadoop.ipc.Server $ Handler.run (Server.java: 953)

at org.apache.hadoop.ipc.Client.call (Client.java: 740)
at org.apache.hadoop.ipc.RPC $ Invoker.invoke (RPC.java: 220)
at $ Proxy0.addBlock (Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java: 39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 25)
at java.lang.reflect.Method.invoke (Method.java: 597)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod (RetryInvocationHandler.jav
a: 82)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke (RetryInvocationHandler.java: 59)
at $ Proxy0.addBlock (Unknown Source)
at org.apache.hadoop.hdfs.DFSClient $ DFSOutputStream.locateFollowingBlock (DFSClient.java: 2937
)
at org.apache.hadoop.hdfs.DFSClient $ DFSOutputStream.nextBlockOutputStream (DFSClient.java: 281
9)
at org.apache.hadoop.hdfs.DFSClient $ DFSOutputStream.access $ 2000 (DFSClient.java: 2102)
at org.apache.hadoop.hdfs.DFSClient $ DFSOutputStream $ DataStreamer.run (DFSClient.java: 2288)
--- --- Solution --------------------------------------------
PS you first look to see is not all processes are started. . .
I guess you datanode process did not start successfully. .

then re-format

re-format, pay attention to first remove the original format generated data
------ Solution ---------------------- ----------------------
look datanode the logs there will be errors, datanode did not start successfully

没有评论:

发表评论