Kafka HDFS разъем не показывает никаких данных - PullRequest
0 голосов
/ 05 июля 2018

Я получил это сообщение:

 WorkerSinkTask{id=hdfs-test-0} Sink task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask)
[2018-07-05 10:58:43,913] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Discovered group coordinator broker:19092 (id: 2147482646 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-07-05 10:58:43,919] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Revoking previously assigned partitions [] (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2018-07-05 10:58:43,920] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] (Re-)joining group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-07-05 10:58:46,950] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Successfully joined group with generation 9 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-07-05 10:58:46,953] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Setting newly assigned partitions [hdfs-test-0] (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2018-07-05 10:58:46,967] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Resetting offset for partition hdfs-test-0 to offset 0. (org.apache.kafka.clients.consumer.internals.Fetcher)
[2018-07-05 10:58:46,978] INFO Started recovery for topic partition hdfs-test-0 (io.confluent.connect.hdfs.TopicPartitionWriter)
[2018-07-05 10:58:47,004] INFO Finished recovery for topic partition hdfs-test-0 (io.confluent.connect.hdfs.TopicPartitionWriter)

но когда я хочу проверить, что данные доступны в HDFS:

Я нашел только это:

$ hadoop fs -ls /topics/
Found 1 items
drwxr-xr-x   - root supergroup          0 2018-07-05 10:10 /topics/+tmp

что мне делать ?? Может кто-нибудь, помогите мне, пожалуйста?

...