sq oop импорт не выполнен для класса не найден - PullRequest
Новая
       27

sq oop импорт не выполнен для класса не найден

0 голосов
/ 23 марта 2020

Я попробовал команду ниже:

sq oop import -D mapreduce.job.queuename = crm --connect 'jdb c: mysql: // mysql: 3306 / db? UseUnicode = true & characterEncoding = utf-8 '--username xx --password xx --query' выбрать идентификатор, идентификатор_программы, идентификатор_пользователя, моб. из user_centerblock, где $ CONDITIONS '--split-by id --hive-import --hive-таблица db.ods_user_centerblock --hive-overwrite --null-string' \ N '--null-non-string' \ N ' --fields-terminated-by, --target-dir / user / xx / tmp / sq oop --delete-target-dir --hive-drop-import-delims --lines-terminated-by '\ n '--bindir / tmp / sqoop / --num-mappers 4 --verbose

тогда я получил ошибку в syslog рабочего узла: 

2020-03-23 23:12:52,639 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1584350885459_40052_000001
2020-03-23 23:12:52,788 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2020-03-23 23:12:52,860 INFO [main] org.apache.hadoop.security.SecurityUtil: Updating Configuration
2020-03-23 23:12:52,860 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2020-03-23 23:12:52,861 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 40052 cluster_timestamp: 1584350885459 } attemptId: 1 } keyId: 229193194)
2020-03-23 23:12:53,075 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2020-03-23 23:12:53,076 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
2020-03-23 23:12:53,108 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.sqoop.mapreduce.RawKeyTextOutputFormat not found
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.sqoop.mapreduce.RawKeyTextOutputFormat not found
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:521)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:501)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1640)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:501)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:287)
  at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$5.run(MRAppMaster.java:1598)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Subject.java:422)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1595)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1526)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.sqoop.mapreduce.RawKeyTextOutputFormat not found
  at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2308)
  at org.apache.hadoop.mapreduce.task.JobContextImpl.getOutputFormatClass(JobContextImpl.java:223)
  at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:518)
  ... 11 more
Caused by: java.lang.ClassNotFoundException: Class org.apache.sqoop.mapreduce.RawKeyTextOutputFormat not found
  at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2214)
  at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2306)
  ... 13 more

однако я нашел класс RawKeyTextOutputFormat находится в $ {SQOOP_HOME} /sqoop-1.4.6.jar и загружает его в каталог ./libjars

20/03/23 23:12:49 DEBUG db.DBConfiguration: Securing password into job credentials store
20/03/23 23:12:49 DEBUG mapreduce.DataDrivenImportJob: Using table class: QueryResult
20/03/23 23:12:49 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat: class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
20/03/23 23:12:49 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/sqoop-1.4.6.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/mysql-connector-java.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/sqoop-1.4.6.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/sqoop-1.4.6.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-data-mapreduce-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-generator-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-jackson-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/opencsv-2.3.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-common-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/avro-1.7.5.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/avro-mapred-1.7.5-hadoop2.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-core-asl-1.9.13.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-format-2.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/paranamer-2.3.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-mapper-asl-1.9.13.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-annotations-2.3.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-hadoop-compatibility-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-column-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-avro-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-jexl-2.1.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/hsqldb-1.8.0.10.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-data-core-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-compress-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-data-hive-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-hadoop-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-io-1.4.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/mysql-connector-java.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/ant-eclipse-1.0-jvm1.2.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/ant-contrib-1.0b3.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-core-2.3.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-codec-1.4.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/snappy-java-1.0.5.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/slf4j-api-1.6.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-databind-2.3.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-encoding-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/xz-1.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-logging-1.1.1.jar
20/03/23 23:12:49 INFO client.RequestHedgingRMFailoverProxyProvider: Created wrapped proxy for [rm1, rm2]
20/03/23 23:12:49 INFO client.AHSProxy: Connecting to Application History server at hadoop-master001/172.22.222.109:10200
20/03/23 23:12:49 INFO client.RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]...
20/03/23 23:12:49 INFO client.RequestHedgingRMFailoverProxyProvider: Found active RM [rm2]
20/03/23 23:12:50 DEBUG db.DBConfiguration: Fetching password from job credentials store

здесь локальный вывод: 

20/03/23 23:12:48 DEBUG orm.CompilationManager: Could not rename /tmp/sqoop/QueryResult.java to /usr/hdp/2.6.5.0-292/sqoop-client/./QueryResult.java
20/03/23 23:12:48 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop/QueryResult.jar
20/03/23 23:12:48 DEBUG orm.CompilationManager: Found existing jar (/tmp/sqoop/QueryResult.jar); removing.
20/03/23 23:12:48 DEBUG orm.CompilationManager: Scanning for .class files in directory: /tmp/sqoop
20/03/23 23:12:48 DEBUG orm.CompilationManager: Got classfile: /tmp/sqoop/QueryResult.class -> QueryResult.class
20/03/23 23:12:48 DEBUG orm.CompilationManager: Finished writing jar file /tmp/sqoop/QueryResult.jar
20/03/23 23:12:49 INFO tool.ImportTool: Destination directory /user/zhanggui1/tmp/sqoop is not present, hence not deleting.
20/03/23 23:12:49 INFO mapreduce.ImportJobBase: Beginning query import.
20/03/23 23:12:49 DEBUG util.ClassLoaderStack: Checking for existing class: QueryResult
20/03/23 23:12:49 DEBUG util.ClassLoaderStack: Attempting to load jar through URL: jar:file:/tmp/sqoop/QueryResult.jar!/
20/03/23 23:12:49 DEBUG util.ClassLoaderStack: Previous classloader is sun.misc.Launcher$AppClassLoader@3ac3fd8b
20/03/23 23:12:49 DEBUG util.ClassLoaderStack: Testing class in jar: QueryResult
20/03/23 23:12:49 DEBUG util.ClassLoaderStack: Loaded jar into current JVM: jar:file:/tmp/sqoop/QueryResult.jar!/
20/03/23 23:12:49 DEBUG util.ClassLoaderStack: Added classloader for jar /tmp/sqoop/QueryResult.jar: java.net.FactoryURLClassLoader@46678e49
20/03/23 23:12:49 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
20/03/23 23:12:49 DEBUG db.DBConfiguration: Securing password into job credentials store
20/03/23 23:12:49 DEBUG mapreduce.DataDrivenImportJob: Using table class: QueryResult
20/03/23 23:12:49 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat: class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
20/03/23 23:12:49 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/sqoop-1.4.6.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/mysql-connector-java.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/sqoop-1.4.6.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/sqoop-1.4.6.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-data-mapreduce-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-generator-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-jackson-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/opencsv-2.3.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-common-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/avro-1.7.5.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/avro-mapred-1.7.5-hadoop2.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-core-asl-1.9.13.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-format-2.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/paranamer-2.3.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-mapper-asl-1.9.13.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-annotations-2.3.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-hadoop-compatibility-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-column-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-avro-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-jexl-2.1.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/hsqldb-1.8.0.10.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-data-core-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-compress-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/kite-data-hive-1.0.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-hadoop-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-io-1.4.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/mysql-connector-java.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/ant-eclipse-1.0-jvm1.2.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/ant-contrib-1.0b3.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-core-2.3.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-codec-1.4.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/snappy-java-1.0.5.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/slf4j-api-1.6.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/jackson-databind-2.3.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/parquet-encoding-1.4.1.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/xz-1.0.jar
20/03/23 23:12:49 DEBUG mapreduce.JobBase: Adding to job classpath: file:/usr/hdp/2.6.5.0-292/sqoop-client/lib/commons-logging-1.1.1.jar
20/03/23 23:12:49 INFO client.RequestHedgingRMFailoverProxyProvider: Created wrapped proxy for [rm1, rm2]
20/03/23 23:12:49 INFO client.AHSProxy: Connecting to Application History server at hadoop-master001/172.22.222.109:10200
20/03/23 23:12:49 INFO client.RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]...
20/03/23 23:12:49 INFO client.RequestHedgingRMFailoverProxyProvider: Found active RM [rm2]
20/03/23 23:12:50 DEBUG db.DBConfiguration: Fetching password from job credentials store
20/03/23 23:12:50 INFO db.DBInputFormat: Using read commited transaction isolation
20/03/23 23:12:50 DEBUG db.DataDrivenDBInputFormat: Creating input split with lower bound '1=1' and upper bound '1=1'
20/03/23 23:12:50 INFO mapreduce.JobSubmitter: number of splits:1
20/03/23 23:12:50 INFO Configuration.deprecation: yarn.resourcemanager.zk-num-retries is deprecated. Instead, use hadoop.zk.num-retries
20/03/23 23:12:50 INFO Configuration.deprecation: yarn.resourcemanager.zk-address is deprecated. Instead, use hadoop.zk.address
20/03/23 23:12:50 INFO Configuration.deprecation: yarn.resourcemanager.zk-timeout-ms is deprecated. Instead, use hadoop.zk.timeout-ms
20/03/23 23:12:50 INFO Configuration.deprecation: yarn.resourcemanager.zk-acl is deprecated. Instead, use hadoop.zk.acl
20/03/23 23:12:50 INFO Configuration.deprecation: yarn.resourcemanager.zk-retry-interval-ms is deprecated. Instead, use hadoop.zk.retry-interval-ms
20/03/23 23:12:50 INFO Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
20/03/23 23:12:51 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1584350885459_40052
20/03/23 23:12:51 INFO impl.YarnClientImpl: Submitted application application_1584350885459_40052
20/03/23 23:12:51 INFO mapreduce.Job: The url to track the job: http://hadoop-master002:8088/proxy/application_1584350885459_40052/
20/03/23 23:12:51 INFO mapreduce.Job: Running job: job_1584350885459_40052
20/03/23 23:12:55 INFO mapreduce.Job: Job job_1584350885459_40052 running in uber mode : false
20/03/23 23:12:55 INFO mapreduce.Job:  map 0% reduce 0%
20/03/23 23:12:55 INFO mapreduce.Job: Job job_1584350885459_40052 failed with state FAILED due to: Application application_1584350885459_40052 failed 2 times due to AM Container for appattempt_1584350885459_40052_000002 exited with  exitCode: 1
For more detailed output, check the application tracking page: http://hadoop-master002:8088/cluster/app/application_1584350885459_40052 Then click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_e49_1584350885459_40052_02_000001
Exit code: 1

Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Failing this attempt. Failing the application.
20/03/23 23:12:55 INFO mapreduce.Job: Counters: 0
20/03/23 23:12:55 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
20/03/23 23:12:55 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 6.0784 seconds (0 bytes/sec)
20/03/23 23:12:55 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
20/03/23 23:12:55 INFO mapreduce.ImportJobBase: Retrieved 0 records.
20/03/23 23:12:55 DEBUG util.ClassLoaderStack: Restoring classloader: sun.misc.Launcher$AppClassLoader@3ac3fd8b
20/03/23 23:12:55 ERROR tool.ImportTool: Error during import: Import job failed!

любой предложения будут оценены

...