Я запускаю цеппелин и искру на кубернетах.
Я сталкиваюсь с этим сообщением об исключении, когда пытаюсь выполнить абзац искры.
Короткое сообщение:
ИНФОРМАЦИЯ [2020-05-28 15: 59: 57,709] ({SchedulerFactory7} Kubectl.java [execAndGet]: 121) - kubectl [get, pods / spark-agqtvn, -o, json, --namespace = ra-iot-dev]
ОШИБКА [2020-05-28 15: 59: 57,976] ({SchedulerFactory7} K8sRemoteInterpreterProcess.java [isRunning]: 200) - Не удается получить статус модуля java .io.IOException: Ошибка сервера (NotFound): pods "spark-agqtvn" не найдены
Полное сообщение:
INFO [2020-05-28 15:59:57,682] ({qtp540159270-191} NotebookService.java[runParagraph]:293) - Start to run paragraph: 20150210-015259_1403135953 of note: 2A94M5J1Z
INFO [2020-05-28 15:59:57,684] ({qtp540159270-191} VFSNotebookRepo.java[save]:145) - Saving note 2A94M5J1Z to Spark Tutorial/Spark Basic Features_2A94M5J1Z.zpln
INFO [2020-05-28 15:59:57,692] ({SchedulerFactory7} AbstractScheduler.java[runJob]:125) - Job 20150210-015259_1403135953 started by scheduler RemoteInterpreter-spark-shared_process-shared_session
INFO [2020-05-28 15:59:57,693] ({SchedulerFactory7} Paragraph.java[jobRun]:407) - Run paragraph [paragraph_id: 20150210-015259_1403135953, interpreter: org.apache.zeppelin.spark.SparkInterpreter, note_id: 2A94M5J1Z, user: anonymous]
INFO [2020-05-28 15:59:57,709] ({SchedulerFactory7} Kubectl.java[execAndGet]:121) - kubectl [get, pods/spark-agqtvn, -o, json, --namespace=ra-iot-dev]
ERROR [2020-05-28 15:59:57,976] ({SchedulerFactory7} K8sRemoteInterpreterProcess.java[isRunning]:200) - Can't get pod status
java.io.IOException: Error from server (NotFound): pods "spark-agqtvn" not found
at org.apache.zeppelin.interpreter.launcher.Kubectl.execAndGet(Kubectl.java:141)
at org.apache.zeppelin.interpreter.launcher.Kubectl.execAndGet(Kubectl.java:106)
at org.apache.zeppelin.interpreter.launcher.K8sRemoteInterpreterProcess.isRunning(K8sRemoteInterpreterProcess.java:177)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:164)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:131)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:298)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:431)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:74)
at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:159)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at org.apache.zeppelin.interpreter.launcher.Kubectl.execute(Kubectl.java:155)
at org.apache.zeppelin.interpreter.launcher.Kubectl.execAndGet(Kubectl.java:125)
... 17 more
WARN [2020-05-28 15:59:57,978] ({SchedulerFactory7} NotebookServer.java[onStatusChange]:1901) - Job 20150210-015259_1403135953 is finished, status: ERROR, exception: null, result: %text org.apache.zeppelin.interpreter.InterpreterException: java.io.IOException: Interpreter process is not running
null
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:134)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:298)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:431)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:74)
at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:159)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Interpreter process is not running
null
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:166)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:131)
... 13 more
INFO [2020-05-28 15:59:57,979] ({SchedulerFactory7} VFSNotebookRepo.java[save]:145) - Saving note 2A94M5J1Z to Spark Tutorial/Spark Basic Features_2A94M5J1Z.zpln
INFO [2020-05-28 15:59:57,982] ({SchedulerFactory7} AbstractScheduler.java[runJob]:152) - Job 20150210-015259_1403135953 finished by scheduler RemoteInterpreter-spark-shared_process-shared_session
Я смотрю, если любой под создается, когда paragrah выполняется с использованием kubectl get pods --watch. Однако создается любой контейнер. Для меня странно, что zeppelin запрашивает состояние пода с именем spark-agqtvn