Я пытаюсь импортировать данные в Hbase, используя следующую команду
hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator="," -Dimporttsv.columns="HBASE_ROW_KEY,cf:SepalLength, cf:SepalWidth, cf:PetalLength, cf:PetalWidth, cf:Species" iris_data data/iris.csv
где data / iris.csv - файл, сохраненный в формате hdf.
CMD> hdfs dfs -ls data / iris.csv
-rw-r - r-- 1 user1 супергруппа 5108 2019-05-15 15:36 data / iris.csv
Я получаю следующую ошибку
ChangeFileModeByMask error (3): The system cannot find the path specified.
это полный вывод команды hbase:
The system cannot find the path specified.
The system cannot find the path specified.
The system cannot find the path specified.
2019-05-17 08:26:08,003 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-05-17 08:26:09,707 INFO [main] zookeeper.ReadOnlyZKClient: Connect 0x143640d5 to 127.0.0.1:2181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms
2019-05-17 08:26:09,736 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2019-05-17 08:26:09,738 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:host.name=pc1
2019-05-17 08:26:09,740 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_211
2019-05-17 08:26:09,742 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2019-05-17 08:26:09,743 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:java.home=C:\Java\jdk1.8.0_211\jre
2019-05-17 08:26:09,745 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: .0.5\lib\jetty-webapp-9.3.19.v20170502.jar;C:\opt\hbase-2.0.5\lib\jetty-xml-9.3.19.v20170502.jar;C:\opt\hbase-2.0.5\lib\joni-2.1.11.jar;C:\opt\hbase-2.0.5\lib\jsch-0.1.54.jar;C:\opt\hbase-2.0.5\lib\junit-4.12.jar;C:\opt\hbase-2.0.5\lib\leveldbjni-all-1.8.jar;C:\opt\hbase-2.0.5\lib\libthrift-0.12.0.jar;C:\opt\hbase-2.0.5\lib\log4j-1.2.17.jar;C:\opt\hbase-2.0.5\lib\metrics-core-3.2.1.jar;C:\opt\hbase-2.0.5\lib\netty-all-4.0.23.Final.jar;C:\opt\hbase-2.0.5\lib\org.eclipse.jdt.core-3.8.2.v20130121.jar;C:\opt\hbase-2.0.5\lib\osgi-resource-locator-1.0.1.jar;C:\opt\hbase-2.0.5\lib\paranamer-2.3.jar;C:\opt\hbase-2.0.5\lib\protobuf-java-2.5.0.jar;C:\opt\hbase-2.0.5\lib\slf4j-api-1.7.25.jar;C:\opt\hbase-2.0.5\lib\slf4j-log4j12-1.7.25.jar;C:\opt\hbase-2.0.5\lib\snappy-java-1.0.5.jar;C:\opt\hbase-2.0.5\lib\spymemcached-2.12.2.jar;C:\opt\hbase-2.0.5\lib\validation-api-1.1.0.Final.jar;C:\opt\hbase-2.0.5\lib\xmlenc-0.52.jar;C:\opt\hbase-2.0.5\lib\xz-1.0.jar;C:\opt\hbase-2.0.5\lib\zookeeper-3.4.10.jar
2019-05-17 08:26:09,746 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:java.library.path=
2019-05-17 08:26:09,746 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=C:\Users\user1\AppData\Local\Temp\
2019-05-17 08:26:09,747 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2019-05-17 08:26:09,748 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:os.name=Windows 10
2019-05-17 08:26:09,752 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:os.arch=amd64
2019-05-17 08:26:09,752 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:os.version=10.0
2019-05-17 08:26:09,753 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:user.name=user1
2019-05-17 08:26:09,754 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:user.home=C:\Users\user1
2019-05-17 08:26:09,755 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Client environment:user.dir=C:\Users\user1\proj\FutureSmartID
2019-05-17 08:26:09,759 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$6/2110130495@69dc885b
2019-05-17 08:26:10,526 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2019-05-17 08:26:10,533 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session
2019-05-17 08:26:10,569 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x16ac32c6a8a0009, negotiated timeout = 40000
2019-05-17 08:26:13,915 INFO [main] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x143640d5 to 127.0.0.1:2181
2019-05-17 08:26:13,948 INFO [main] Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
2019-05-17 08:26:13,954 INFO [main] jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
2019-05-17 08:26:13,961 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5] zookeeper.ZooKeeper: Session: 0x16ac32c6a8a0009 closed
2019-05-17 08:26:13,962 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x143640d5-EventThread] zookeeper.ClientCnxn: EventThread shut down for session: 0x16ac32c6a8a0009
2019-05-17 08:26:14,047 INFO [main] zookeeper.ReadOnlyZKClient: Connect 0x615091b8 to 127.0.0.1:2181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms
2019-05-17 08:26:14,057 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x615091b8] zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$6/2110130495@69dc885b
2019-05-17 08:26:14,066 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x615091b8-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2019-05-17 08:26:14,071 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x615091b8-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session
2019-05-17 08:26:14,111 INFO [ReadOnlyZKClient-127.0.0.1:2181@0x615091b8-SendThread(127.0.0.1:2181)] zookeeper.ClientCnxn: Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x16ac32c6a8a000a, negotiated timeout = 40000
2019-05-17 08:26:15,184 INFO [main] mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-user1/mapred/staging/user1562595199/.staging/job_local562595199_0001
Exception in thread "main" ExitCodeException exitCode=1: ChangeFileModeByMask error (3): The system cannot find the path specified.
at org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
at org.apache.hadoop.util.Shell.run(Shell.java:482)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:869)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:852)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:505)
at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:486)
at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:502)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:601)
at org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:94)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:95)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:190)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:778)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:790)
FYI,
Я пытался указать с конкурентами местоположение hdfs: hdfs://<ip_address>:9000/data/iris.csv
но тоже не сработало
на hbase master start экране командной строки,
2019-05-17 08:26:10,532 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxnFactory: Accepted socket connection from /127.0.0.1:54376
2019-05-17 08:26:10,538 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer: Client attempting to establish new session at /127.0.0.1:54376
2019-05-17 08:26:10,565 INFO [SyncThread:0] server.ZooKeeperServer: Established session 0x16ac32c6a8a0009 with negotiated timeout 40000 for client /127.0.0.1:54376
2019-05-17 08:26:13,917 INFO [ProcessThread(sid:0 cport:2181):] server.PrepRequestProcessor: Processed session termination for sessionid: 0x16ac32c6a8a0009
2019-05-17 08:26:13,962 WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: caught end of stream exception
EndOfStreamException: Unable to read additional data from client sessionid 0x16ac32c6a8a0009, likely client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
at java.lang.Thread.run(Thread.java:748)
2019-05-17 08:26:13,962 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:54376 which had sessionid 0x16ac32c6a8a0009
2019-05-17 08:26:14,069 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxnFactory: Accepted socket connection from /127.0.0.1:54396
2019-05-17 08:26:14,073 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer: Client attempting to establish new session at /127.0.0.1:54396
2019-05-17 08:26:14,110 INFO [SyncThread:0] server.ZooKeeperServer: Established session 0x16ac32c6a8a000a with negotiated timeout 40000 for client /127.0.0.1:54396
2019-05-17 08:26:15,596 WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: Exception causing close of session 0x16ac32c6a8a000a due to java.io.IOException: An existing connection was forcibly closed by the remote host
2019-05-17 08:26:15,596 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:54396 which had sessionid 0x16ac32c6a8a000a
К вашему сведению, я работаю на Windows 10 и выполняю на Командная строка (cmd)