Когда я запускал программу MapReduce, я столкнулся с этой проблемой, я проверил каталог /usr/local/bin/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1541401616752_0019/filecache/11_tmp/tmp_job.jar на datanode slave1 и slave2, который упоминался в журналах, но я обнаружил, что dict остановился на /usr/local/bin/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/, есть ничего не последовало, я новичок в hadoop, не знаю, как это исправить.
/usr/local/bin/java/jdk1.8.0_181/bin/java -javaagent:/home/richard/Softwares/JetBrains/apps/IDEA-U/ch-0/182.4892.20/lib/idea_rt.jar=45521:/home/richard/Softwares/JetBrains/apps/IDEA-U/ch-0/182.4892.20/bin -Dfile.encoding=UTF-8 -classpath /usr/local/bin/java/jdk1.8.0_181/jre/lib/charsets.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/deploy.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/cldrdata.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/dnsns.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/jaccess.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/jfxrt.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/localedata.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/nashorn.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/sunec.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/sunjce_provider.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/sunpkcs11.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/ext/zipfs.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/javaws.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/jce.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/jfr.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/jfxswt.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/jsse.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/management-agent.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/plugin.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/resources.jar:/usr/local/bin/java/jdk1.8.0_181/jre/lib/rt.jar:/home/richard/WorkSpace/hadoop-book-4e/hadoop-book-4e/first/target/classes:/home/richard/.m2/repository/org/apache/hadoop/hadoop-common/2.8.5/hadoop-common-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-annotations/2.8.5/hadoop-annotations-2.8.5.jar:/home/richard/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/home/richard/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/richard/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/home/richard/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/richard/.m2/repository/org/apache/httpcomponents/httpclient/4.5.2/httpclient-4.5.2.jar:/home/richard/.m2/repository/org/apache/httpcomponents/httpcore/4.4.4/httpcore-4.4.4.jar:/home/richard/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/richard/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/richard/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/richard/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/richard/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/richard/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/richard/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/richard/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/richard/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/richard/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/home/richard/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/home/richard/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/richard/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/richard/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.3/jackson-jaxrs-1.8.3.jar:/home/richard/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar:/home/richard/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/home/richard/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/richard/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/richard/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/richard/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/home/richard/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/home/richard/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/richard/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/richard/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/richard/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/richard/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/richard/.m2/repository/org/slf4j/slf4j-api/1.7.10/slf4j-api-1.7.10.jar:/home/richard/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar:/home/richard/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/richard/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/richard/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar:/home/richard/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/richard/.m2/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/home/richard/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/richard/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-auth/2.8.5/hadoop-auth-2.8.5.jar:/home/richard/.m2/repository/com/nimbusds/nimbus-jose-jwt/4.41.1/nimbus-jose-jwt-4.41.1.jar:/home/richard/.m2/repository/com/github/stephenc/jcip/jcip-annotations/1.0-1/jcip-annotations-1.0-1.jar:/home/richard/.m2/repository/net/minidev/json-smart/2.3/json-smart-2.3.jar:/home/richard/.m2/repository/net/minidev/accessors-smart/1.2/accessors-smart-1.2.jar:/home/richard/.m2/repository/org/ow2/asm/asm/5.0.4/asm-5.0.4.jar:/home/richard/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/richard/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/richard/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/richard/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/richard/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/richard/.m2/repository/com/jcraft/jsch/0.1.54/jsch-0.1.54.jar:/home/richard/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/richard/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/richard/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/richard/.m2/repository/org/apache/htrace/htrace-core4/4.0.1-incubating/htrace-core4-4.0.1-incubating.jar:/home/richard/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/home/richard/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/richard/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.8.5/hadoop-hdfs-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-hdfs-client/2.8.5/hadoop-hdfs-client-2.8.5.jar:/home/richard/.m2/repository/com/squareup/okhttp/okhttp/2.4.0/okhttp-2.4.0.jar:/home/richard/.m2/repository/com/squareup/okio/okio/1.4.0/okio-1.4.0.jar:/home/richard/.m2/repository/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/home/richard/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/home/richard/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/home/richard/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/home/richard/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/home/richard/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.8.5/hadoop-mapreduce-client-core-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.8.5/hadoop-yarn-common-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.8.5/hadoop-yarn-api-2.8.5.jar:/home/richard/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/richard/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/richard/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/richard/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/home/richard/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/home/richard/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/home/richard/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/richard/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/home/richard/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.8.5/hadoop-mapreduce-client-jobclient-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.8.5/hadoop-mapreduce-client-shuffle-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.8.5/hadoop-yarn-server-nodemanager-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.8.5/hadoop-mapreduce-client-common-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.8.5/hadoop-yarn-client-2.8.5.jar:/home/richard/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.8.5/hadoop-yarn-server-common-2.8.5.jar:/usr/local/bin/java/jdk1.8.0_181/lib/tools.jar first.test1 hdfs://master:9000/input/ hdfs://master:9000/output/
18/11/05 17:27:11 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
18/11/05 17:27:12 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/11/05 17:27:12 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.1.138:8032
18/11/05 17:27:13 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
18/11/05 17:27:14 INFO input.FileInputFormat: Total input files to process : 1
18/11/05 17:27:14 INFO mapreduce.JobSubmitter: number of splits:1
18/11/05 17:27:14 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
18/11/05 17:27:14 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
18/11/05 17:27:14 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1541401616752_0019
18/11/05 17:27:14 INFO impl.YarnClientImpl: Submitted application application_1541401616752_0019
18/11/05 17:27:14 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1541401616752_0019/
18/11/05 17:27:14 INFO mapreduce.Job: Running job: job_1541401616752_0019
18/11/05 17:27:17 INFO mapreduce.Job: Job job_1541401616752_0019 running in uber mode : false
18/11/05 17:27:17 INFO mapreduce.Job: map 0% reduce 0%
18/11/05 17:27:17 INFO mapreduce.Job: Job job_1541401616752_0019 failed with state FAILED due to: Application application_1541401616752_0019 failed 2 times due to AM Container for appattempt_1541401616752_0019_000002 exited with exitCode: -1000
Failing this attempt.Diagnostics: /usr/local/bin/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1541401616752_0019/filecache/11_tmp/tmp_job.jar (Is a directory)
java.io.FileNotFoundException: /usr/local/bin/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1541401616752_0019/filecache/11_tmp/tmp_job.jar (Is a directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:225)
at java.util.zip.ZipFile.<init>(ZipFile.java:155)
at java.util.jar.JarFile.<init>(JarFile.java:166)
at java.util.jar.JarFile.<init>(JarFile.java:130)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:98)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:297)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:364)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
For more detailed output, check the application tracking page: http://master:8088/cluster/app/application_1541401616752_0019 Then click on links to logs of each attempt.
. Failing the application.
18/11/05 17:27:17 INFO mapreduce.Job: Counters: 0
Process finished with exit code 1