druid Transaction failure publishing segments, aborting

一、任务日志:

WARN  IndexerSQLMetadataStorageCoordinator:97 - Cannot allocate new segment for dataSource[useractive], 
				interval[2018-02-19T00:00:00.000Z/2018-02-26T00:00:00.000Z], maxVersion[2018-02-24T08:59:16.832Z]: 
				conflicting segment[useractive_2018-02-19T00:00:00.000Z_2018-02-20T00:00:00.000Z_2018-02-24T06:30:53.746Z_11].

二、任务日志:

2018-02-26 17:17:17 3474 [task-runner-0-priority-0] ERROR ThreadPoolTaskRunner:121 - Exception while running task[KafkaIndexTask{id=index_kafka_useractive_480e1352143ca85_fajmniii, type=index_kafka, dataSource=useractive}]
io.druid.java.util.common.ISE: Transaction failure publishing segments, aborting
        at io.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:589) ~[?:?]
        at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.11.0.jar:0.11.0]
        at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.11.0.jar:0.11.0]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_71]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_71]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_71]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_71]
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] INFO  TaskRunnerUtils:69 - Task [index_kafka_useractive_480e1352143ca85_fajmniii] status changed to [FAILED].
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] INFO  ExecutorLifecycle:69 - Task completed with status: {
  "id" : "index_kafka_useractive_480e1352143ca85_fajmniii",
  "status" : "FAILED",
  "duration" : 597848

解析

  • 一、druid_pendingSegments 中对应的时间段存在冲突
  • 二、查看overlord日志,标识 中存在 Not updating metadata, existing state is not the expected start state ,这是因为修改topic 致使校验异常,删除druid_dataSource 对应的 数据便可

异常会致使,segment hand off 失败,没法保留数据 缘由:druid_pendingSegments 中对应的时间段存在冲突 解决方案:清理 druid_pendingSegments 对应的时间段java

相关文章
相关标签/搜索