Ошибка Hadoop при запуске NodeManager с исходным кодом Hadoop 2.8.5 - PullRequest
Новая
       95

Ошибка Hadoop при запуске NodeManager с исходным кодом Hadoop 2.8.5

0 голосов
/ 30 марта 2019

Я хочу запустить hadoop в Intellij IDEA из исходного кода, и я запустил hdfs, запустив основные классы NameNode и DataNode, но у меня возникают некоторые ошибки при запуске NodeManager с помощью NodeManager.java. 


2019-03-30 08:49:10,845 INFO  [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(210)) - Stopping NodeManager metrics system...
2019-03-30 08:49:10,846 INFO  [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(216)) - NodeManager metrics system stopped.
2019-03-30 08:49:10,846 INFO  [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(609)) - NodeManager metrics system shutdown complete.
2019-03-30 08:49:10,846 FATAL [main] nodemanager.NodeManager (NodeManager.java:initAndStartNodeManager(639)) - Error starting NodeManager
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2401)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:124)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:268)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:357)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:636)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2369)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2393)
        ... 10 more
Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2273)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2367)
        ... 11 more
2019-03-30 08:49:10,851 INFO  [pool-1-thread-1] nodemanager.NodeManager (LogAdapter.java:info(45)) - SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NodeManager at 20s207/10.11.1.207
************************************************************/

Process finished with exit code 255
...