Я использую docker -создать для запуска среды Hbase на моем ECS, но я столкнулся с некоторыми проблемами.
2020-04-03 05:58:32,133 [myid:] - INFO [SyncThread:0:ZooKeeperServer@687] - Established session 0x1713e9a995d0000 with negotiated timeout 40000 for client /172.19.0.6:38738
2020-04-03 05:58:32,147 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0000 type:create cxid:0x1 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
2020-04-03 05:58:32,640 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0000 type:create cxid:0x10 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/hbase/master Error:KeeperErrorCode = NodeExists for /hbase/master
2020-04-03 05:58:32,705 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /172.19.0.6:38740
2020-04-03 05:58:32,706 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@942] - Client attempting to establish new session at /172.19.0.6:38740
2020-04-03 05:58:32,709 [myid:] - INFO [SyncThread:0:ZooKeeperServer@687] - Established session 0x1713e9a995d0001 with negotiated timeout 40000 for client /172.19.0.6:38740
2020-04-03 05:58:32,983 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /172.19.0.6:38746
2020-04-03 05:58:32,983 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@942] - Client attempting to establish new session at /172.19.0.6:38746
2020-04-03 05:58:32,985 [myid:] - INFO [SyncThread:0:ZooKeeperServer@687] - Established session 0x1713e9a995d0002 with negotiated timeout 40000 for client /172.19.0.6:38746
2020-04-03 05:58:33,058 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0000 type:create cxid:0x2e zxid:0x50 txntype:-1 reqpath:n/a Error Path:/hbase/flush-table-proc/acquired Error:KeeperErrorCode = NodeExists for /hbase/flush-table-proc/acquired
2020-04-03 05:58:33,068 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0000 type:create cxid:0x34 zxid:0x51 txntype:-1 reqpath:n/a Error Path:/hbase/online-snapshot/acquired Error:KeeperErrorCode = NodeExists for /hbase/online-snapshot/acquired
2020-04-03 05:58:33,159 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /172.19.0.6:38748
2020-04-03 05:58:33,160 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@942] - Client attempting to establish new session at /172.19.0.6:38748
2020-04-03 05:58:33,162 [myid:] - INFO [SyncThread:0:ZooKeeperServer@687] - Established session 0x1713e9a995d0003 with negotiated timeout 40000 for client /172.19.0.6:38748
2020-04-03 05:58:33,163 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0003 type:create cxid:0x1 zxid:0x53 txntype:-1 reqpath:n/a Error Path:/hbase/replication/rs Error:KeeperErrorCode = NodeExists for /hbase/replication/rs
2020-04-03 05:58:37,969 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0000 type:create cxid:0x56 zxid:0x54 txntype:-1 reqpath:n/a Error Path:/hbase/namespace/default Error:KeeperErrorCode = NodeExists for /hbase/namespace/default
2020-04-03 05:58:37,976 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@648] - Got user-level KeeperException when processing sessionid:0x1713e9a995d0000 type:create cxid:0x59 zxid:0x56 txntype:-1 reqpath:n/a Error Path:/hbase/namespace/hbase Error:KeeperErrorCode = NodeExists for /hbase/namespace/hbase
2020-04-03 05:58:52,972 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@368] - caught end of stream exception
EndOfStreamException: Unable to read additional data from client sessionid 0x1713e7928f70001, likely client has closed socket
Я получил это в логах zookeeper, я мог получить доступ к Hbase через Hbase bash, но я не мог использовать его через Java API. вот состояние сети в моем docker
cdbcfa7458fa bridge bridge local
b4d9cb14e982 host host local
7fb74b768552 none null local
9e0ac80b03bc zookeeper_default bridge local
, а это docker контейнеры
48fbcde76cd7 bde2020/hadoop-resourcemanager:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 42 minutes ago Up 42 minutes (healthy) 0.0.0.0:8088->8088/tcp resourcemanager
2fbfb32b6942 bde2020/hadoop-datanode:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 42 minutes ago Up 42 minutes (healthy) 0.0.0.0:50075->50075/tcp datanode
cf6c5b7eea33 bde2020/hadoop-namenode:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 42 minutes ago Up 42 minutes (healthy) 0.0.0.0:50070->50070/tcp namenode
8addc56fca71 bde2020/hadoop-nodemanager:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 42 minutes ago Up 42 minutes (healthy) 0.0.0.0:8042->8042/tcp nodemanager
202886aea46e bde2020/hadoop-historyserver:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 42 minutes ago Up 42 minutes (healthy) 0.0.0.0:8188->8188/tcp historyserver
90bdb6b6ab7d bde2020/hbase-master:1.0.0-hbase1.2.6 "/entrypoint.sh /run…" 42 minutes ago Up About a minute 16000/tcp, 0.0.0.0:16010->16010/tcp hbase-master
15e3de521f1b zookeeper:3.4.10 "/docker-entrypoint.…" 42 minutes ago Up 6 minutes 2888/tcp, 0.0.0.0:2181->2181/tcp, 3888/tcp zoo
c53c8bf8f478 bde2020/hbase-regionserver:1.0.0-hbase1.2.6 "/entrypoint.sh /run…" 42 minutes ago Up About a minute 16020/tcp, 0.0.0.0:16030->16030/tcp hbase-regionserver
что я могу сделать, или как я могу настроить Hbase, который я могу использовать через Java API в Spring Boot, docker работает на удаленной ECS.