Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer =
In order to limit the maximum number of reducers:
set hive.exec.reducers.max =
In order to set a constant number of reducers:
set mapred.reduce.tasks =
java.net.ConnectException: Call to localhost/127.0.0.1: 9000 failed on connection exception: java.net.ConnectException: Connection refused
at org.apache.hadoop.ipc.Client.wrapException (Client.java: 767)
at org.apache.hadoop.ipc.Client.call (Client.java: 743)
at org.apache.hadoop.ipc.RPC $ Invoker.invoke (RPC.java: 220)
at $ Proxy4.getProtocolVersion (Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy (RPC.java: 359)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode (DFSClient.java: 106)
at org.apache.hadoop.hdfs.DFSClient.
at org.apache.hadoop.hdfs.DFSClient.
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize (DistributedFileSystem.java: 82)
at org.apache.hadoop.fs.FileSystem.createFileSystem (FileSystem.java: 1378)
at org.apache.hadoop.fs.FileSystem.access $ 200 (FileSystem.java: 66)
at org.apache.hadoop.fs.FileSystem $ Cache.get (FileSystem.java: 1390)
at org.apache.hadoop.fs.FileSystem.get (FileSystem.java: 196)
at org.apache.hadoop.fs.Path.getFileSystem (Path.java: 175)
at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath (Utilities.java: 1475)
at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths (ExecDriver.java: 1253)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute (ExecDriver.java: 632)
at org.apache.hadoop.hive.ql.exec.MapRedTask.execute (MapRedTask.java: 123)
at org.apache.hadoop.hive.ql.exec.Task.executeTask (Task.java: 130)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential (TaskRunner.java: 57)
at org.apache.hadoop.hive.ql.Driver.launchTask (Driver.java: 1063)
at org.apache.hadoop.hive.ql.Driver.execute (Driver.java: 900)
at org.apache.hadoop.hive.ql.Driver.run (Driver.java: 748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd (CliDriver.java: 164)
at org.apache.hadoop.hive.cli.CliDriver.processLine (CliDriver.java: 241)
at org.apache.hadoop.hive.cli.CliDriver.main (CliDriver.java: 456)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java: 57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 43)
at java.lang.reflect.Method.invoke (Method.java: 616)
at org.apache.hadoop.util.RunJar.main (RunJar.java: 156)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect (Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect (SocketChannelImpl.java: 592)
at org.apache.hadoop.net.SocketIOWithTimeout.connect (SocketIOWithTimeout.java: 206)
at org.apache.hadoop.net.NetUtils.connect (NetUtils.java: 404)
at org.apache.hadoop.ipc.Client $ Connection.setupIOstreams (Client.java: 304)
at org.apache.hadoop.ipc.Client $ Connection.access $ 1700 (Client.java: 176)
at org.apache.hadoop.ipc.Client.getConnection (Client.java: 860)
at org.apache.hadoop.ipc.Client.call (Client.java: 720)
... 29 more
Job Submission failed with exception 'java.net.ConnectException (Call to localhost/127.0.0.1: 9000 failed on connection exception: java.net.ConnectException: ; Connection refused) '
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
------ Solution ------------------------------------ --------
This should be your hive and the number of input files, since the map reduce the number of tasks, the more easily blocked.
------ For reference only -------------------------------------- -
I also encountered the same problem, how to solve it? I have the same problem in standalone mode
------ For reference only ------------------------------- --------
solution to this problem is what? Same encounter
------ For reference only ----------------------------------- ----
implementation of what hadoop namenode-format
then restart hadoop enough
没有评论:
发表评论