Первый ， Я упаковываю все соответствующие эталонные файлы и пакеты python (просто включаю redis). Затем запускаю мой код в кластере, хотя spark-submit
состояние всегда работает и «окончательный статус: НЕ УКАЗАНО». Затем, проверяя журналы, я обнаружил, что «AttributeError: модуль« redis »не имеет атрибута« Redis »». Но когда я использую «spark-submit --master local XXX», ошибки не возникает.
19/04/25 17:24:09 INFO Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead
19/04/25 17:24:09 INFO Client: Setting up container launch context for our AM
19/04/25 17:24:09 INFO Client: Setting up the launch environment for our AM container
19/04/25 17:24:09 INFO Client: Preparing resources for our AM container
19/04/25 17:24:12 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
19/04/25 17:24:17 INFO Client: Uploading resource file:/tmp/spark-0a0c515b-4c2e-4f49-b224-613748d9a8a5/__spark_libs__5047651549743212649.zip -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/__spark_libs__5047651549743212649.zip
19/04/25 17:24:19 INFO Client: Uploading resource file:/etc/ecm/spark-conf/hive-site.xml -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/hive-site.xml
19/04/25 17:24:19 INFO Client: Uploading resource file:/tmp/cm/compute/r1_spark.py -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/r1_spark.py
19/04/25 17:24:19 INFO Client: Uploading resource file:/usr/lib/spark-current/python/lib/pyspark.zip -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/pyspark.zip
19/04/25 17:24:19 INFO Client: Uploading resource file:/usr/lib/spark-current/python/lib/py4j-0.10.7-src.zip -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/py4j-0.10.7-src.zip
19/04/25 17:24:19 INFO Client: Uploading resource file:/tmp/cm/compute/new_mydeps.zip -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/new_mydeps.zip
19/04/25 17:24:19 INFO Client: Uploading resource file:/tmp/spark-0a0c515b-4c2e-4f49-b224-613748d9a8a5/__spark_conf__7225367117289460370.zip -> hdfs://emr-header-1.cluster-92499:9000/user/emr-user/.sparkStaging/application_1555656422102_0172/__spark_conf__.zip
19/04/25 17:24:19 INFO SecurityManager: Changing view acls to: emr-user,*
19/04/25 17:24:19 INFO SecurityManager: Changing modify acls to: emr-user
19/04/25 17:24:19 INFO SecurityManager: Changing view acls groups to:
19/04/25 17:24:19 INFO SecurityManager: Changing modify acls groups to:
19/04/25 17:24:19 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(emr-user, *); groups with view permissions: Set(); users with modify permissions: Set(emr-user); groups with modify permissions: Set()
19/04/25 17:24:19 INFO Client: Submitting application application_1555656422102_0172 to ResourceManager
19/04/25 17:24:19 INFO YarnClientImpl: Submitted application application_1555656422102_0172
19/04/25 17:24:20 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:24:20 INFO Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1556184259768
final status: UNDEFINED
tracking URL: http://emr-header-1.cluster-92499:20888/proxy/application_1555656422102_0172/
user: emr-user
19/04/25 17:24:21 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:24:22 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:24:23 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:24:24 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:24:25 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:24:26 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:26 INFO Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: 10.7.11.88
ApplicationMaster RPC port: 0
queue: default
start time: 1556184259768
final status: UNDEFINED
tracking URL: http://emr-header-1.cluster-92499:20888/proxy/application_1555656422102_0172/
user: emr-user
19/04/25 17:24:27 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:28 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:29 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:30 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:31 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:32 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:33 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:34 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:35 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:37 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:38 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:39 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:40 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:41 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:42 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:43 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:44 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:45 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:46 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:47 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:48 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:49 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:50 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:51 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:52 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:53 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:54 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:55 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:56 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:57 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:58 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:24:59 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:00 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:01 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:02 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:03 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:04 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:05 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:06 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:07 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:08 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:09 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:10 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:11 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:12 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:13 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:14 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:15 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:16 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:17 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:18 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:19 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:20 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:21 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:22 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:23 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:24 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:25 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:26 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:27 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:28 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:29 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:30 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:31 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:32 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:33 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:34 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:35 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:36 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:37 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:38 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:39 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:40 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:41 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:42 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:43 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:44 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:45 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:46 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:47 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:48 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:49 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:50 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:51 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:52 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:53 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:54 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:55 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:56 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:57 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:58 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:25:59 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:00 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:01 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:02 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:03 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:04 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:05 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:06 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:07 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:08 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:09 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:10 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:12 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:13 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:14 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:15 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:16 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:17 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:18 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:19 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:20 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:21 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:22 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:23 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:24 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:25 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:26 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:27 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:28 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:29 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:30 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:31 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:32 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:33 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:34 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:35 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:36 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:37 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:38 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:39 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:40 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:41 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:42 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:43 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:44 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:45 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:46 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:47 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:48 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:49 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:50 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:51 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:52 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:53 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:54 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:55 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:56 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:57 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:58 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:26:59 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:00 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:01 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:02 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:03 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:04 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:05 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:06 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:07 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:08 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:09 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:10 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:11 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:12 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:13 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:14 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:15 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:16 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:17 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:18 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:19 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:20 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:21 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:22 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:23 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:24 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:25 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:26 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:27 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:28 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:29 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:30 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:31 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:32 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:33 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:34 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:35 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:36 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:37 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:38 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:39 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:40 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:41 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:42 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:43 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:44 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:45 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:46 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:47 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:48 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:49 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:50 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:51 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:27:51 INFO Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1556184259768
final status: UNDEFINED
tracking URL: http://emr-header-1.cluster-92499:20888/proxy/application_1555656422102_0172/
user: emr-user
19/04/25 17:27:52 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:27:53 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:27:55 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:27:56 INFO Client: Application report for application_1555656422102_0172 (state: ACCEPTED)
19/04/25 17:27:57 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:57 INFO Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: 10.7.11.88
ApplicationMaster RPC port: 0
queue: default
start time: 1556184259768
final status: UNDEFINED
tracking URL: http://emr-header-1.cluster-92499:20888/proxy/application_1555656422102_0172/
user: emr-user
19/04/25 17:27:58 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:27:59 INFO Client: Application report for application_1555656422102_0172 (state: RUNNING)
19/04/25 17:28:00 INFO Client: Application report for
.....
журналы:
LogType:stdout
Log Upload Time:星期四 四月 25 17:20:40 +0800 2019
LogLength:297
Log Contents:
Traceback (most recent call last):
File "r1_spark.py", line 223, in <module>
r = redis.Redis(host=redis_host, port=6379, decode_responses=True) # host是redis主机，需要redis服务端和客户端都启动 redis默认端口是6379
AttributeError: module 'redis' has no attribute 'Redis'
End of LogType:stdout