Невозможно настроить многоузловой кластер - PullRequest
0 голосов
/ 07 января 2019

Я пытаюсь настроить кластер с несколькими узлами snappy data

Конфигурация локатора:

a.com -dir=/snappydatafiles/server1 -heap-size=7096m -locators=b.com:8888,a.com:9999
b.com -dir=/snappydatafiles/server2 -heap-size=7096m -locators=b.com:8888,a.com:9999

Конфигурация сервера:

a.com -dir=/snappydatafiles/server1 -heap-size=7096m -locators=b.com:8888,a.com:9999
b.com -dir=/snappydatafiles/server2 -heap-size=7096m -locators=b.com:8888,a.com:9999

Ведущий конфиг:

a.com -heap-size=2096m -spark.ui.port=9090 -locators=b.com:8888,a.com:9999 -spark.executor.cores=8

Выдает эту ошибку, когда я запускаю с использованием /sbin/snappy-start-all.sh или bash /sbin/snappy-start-all.sh:

a.com: Warning: untrusted X11 forwarding setup failed: xauth key data not generated
a.com: export: Command not found.
a.com: perl: warning: Setting locale failed.
a.com: perl: warning: Please check that your locale settings:
a.com:  LANGUAGE = (unset),
a.com:  LC_ALL = (unset),
a.com:  LC_CTYPE = "UTF-8",
a.com:  LANG = "en_US.UTF-8"
a.com:     are supported and installed on your system.
a.com: perl: warning: Falling back to the standard locale ("C").
a.com: opendir(/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh/..): Not a directory at -e line 1
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 33: ./snappy-config.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 34: ./spark-config.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 37: /bin/load-spark-env.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 38: /bin/load-snappy-env.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 44: /bin/snappy: No such file or directory
b.com: Warning: untrusted X11 forwarding setup failed: xauth key data not generated
b.com: export: Command not found.
b.com: export: Command not found.
b.com: opendir(/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh/..): Not a directory at -e line 1
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 33: ./snappy-config.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 34: ./spark-config.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 37: /bin/load-spark-env.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 38: /bin/load-snappy-env.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-locator.sh: line 44: /bin/snappy: No such file or directory
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LC_CTYPE = "UTF-8",
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
a.com: Warning: untrusted X11 forwarding setup failed: xauth key data not generated
a.com: export: Command not found.
a.com: perl: warning: Setting locale failed.
a.com: perl: warning: Please check that your locale settings:
a.com:  LANGUAGE = (unset),
a.com:  LC_ALL = (unset),
a.com:  LC_CTYPE = "UTF-8",
a.com:  LANG = "en_US.UTF-8"
a.com:     are supported and installed on your system.
a.com: perl: warning: Falling back to the standard locale ("C").
a.com: opendir(/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh/..): Not a directory at -e line 1
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 33: ./snappy-config.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 34: ./spark-config.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 36: /bin/load-spark-env.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 37: /bin/load-snappy-env.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 43: /bin/snappy: No such file or directory
b.com: Warning: untrusted X11 forwarding setup failed: xauth key data not generated
b.com: export: Command not found.
b.com: export: Command not found.
b.com: perl: warning: Setting locale failed.
b.com: perl: warning: Please check that your locale settings:
b.com:  LANGUAGE = (unset),
b.com:  LC_ALL = (unset),
b.com:  LC_CTYPE = "UTF-8",
b.com:  LANG = "en_US.UTF-8"
b.com:     are supported and installed on your system.
b.com: perl: warning: Falling back to the standard locale ("C").
b.com: opendir(/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh/..): Not a directory at -e line 1
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 33: ./snappy-config.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 34: ./spark-config.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 36: /bin/load-spark-env.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 37: /bin/load-snappy-env.sh: No such file or directory
b.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-server.sh: line 43: /bin/snappy: No such file or directory

a.com: opendir(/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-lead.sh/..): Not a directory at -e line 1
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-lead.sh: line 33: ./snappy-config.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-lead.sh: line 34: ./spark-config.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-lead.sh: line 36: /bin/load-spark-env.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-lead.sh: line 37: /bin/load-snappy-env.sh: No such file or directory
a.com:/snappydata/snappydata-1.0.2.1-bin/sbin/snappy-lead.sh: line 43: /bin/snappy: No such file or directory

Примечание: когда я заменяю имя хоста на localhost и запускаю после установки этой переменной пути (setenv SPARK_LOCAL_IP 127.0.0.1), она работает нормально, и все члены запускаются.

Средой по умолчанию является csh

echo $SHELL
/bin/csh

Установка Bash

ls -l /bin/bash
-rwxr-xr-x 1 root root 941880 Mar 22  2016 /bin/bash
ls -l /usr/bin/env
lrwxrwxrwx. 1 root root 13 Dec 13  2017 /usr/bin/env -> ../../bin/env

команда экспорта не работает при запуске в обычном терминале Но в корневом терминале команда экспорта работает.

...