Проблема загрузки потока в кластер Hadoop HA - PullRequest
Новая
       27

Проблема загрузки потока в кластер Hadoop HA

0 голосов
/ 30 января 2019

Hadoop версия 2.77
версия лотка 1.8 

java.io.IOException: Callable timed out after 20000 ms on file: hdfs://xx.xx.xx.xx:9000/data/hadoop/test//2019-01-28.1548669625680.txt.tmp
            at org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:715)
            at org.apache.flume.sink.hdfs.BucketWriter.doFlush(BucketWriter.java:486)
            at org.apache.flume.sink.hdfs.BucketWriter.flush(BucketWriter.java:448)
            at org.apache.flume.sink.hdfs.BucketWriter.close(BucketWriter.java:388)
            at org.apache.flume.sink.hdfs.BucketWriter$2.call(BucketWriter.java:295)
            at org.apache.flume.sink.hdfs.BucketWriter$2.call(BucketWriter.java:289)
            at java.util.concurrent.FutureTask.run(FutureTask.java:266)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    Caused by: java.util.concurrent.TimeoutException
            at java.util.concurrent.FutureTask.get(FutureTask.java:205)
            at org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:708)
            ... 11 more
...