1、问题：集群 red 后，全部节点所有重启恢复很差，查看节点下的数据目录，发现对应索引目录下没有文件html
参照博客： http://www.wklken.me/posts/2015/05/23/elasticsearch-issues.htmlnode
（还有说法，再加一个节点就会自动分配，我加了节点发现此方法行不通，如下方法操做后，集群状态就 green 了）
bash
经过一系列排查，发现是由于有4个分片未分配到节点上，重启后还没法分配，经过 head 插件能够看到没法分配节点的分片，经过如下命令也能够看到 unassigned shards 有4个没法分配curl
curl http://192.168.224.188:9200/_cluster/health\?prettyelasticsearch
{ide
"cluster_name" : "gag-prod",post
"status" : "red",fetch
"timed_out" : false,ui
"number_of_nodes" : 3,url
"number_of_data_nodes" : 3,
"active_primary_shards" : 233,
"active_shards" : 466,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 4, \\ 这个就是
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 99.14893617021276
}
curl http://192.168.224.188:9200/_cat/shards 从这里找到 UNASSIGNED 类型的索引名字。（和从 head 插件里看到的剩余的分片名字同样）
items22 4 p STARTED 2273 571.1kb 192.168.224.187 gag-prod-node-187
items22 4 r STARTED 2273 571.1kb 192.168.224.188 gag-prod-node-188
items22 2 p UNASSIGNED
items22 2 r UNASSIGNED
items22 1 p STARTED 2284 555.2kb 192.168.224.187 gag-prod-node-187
items22 1 r STARTED 2284 555.2kb 192.168.224.188 gag-prod-node-188
items22 3 p STARTED 2276 641.5kb 192.168.224.187 gag-prod-node-187
items22 3 r STARTED 2276 641.5kb 192.168.224.188 gag-prod-node-188
items22 0 p UNASSIGNED
items22 0 r UNASSIGNED
shop_entity7 4 p STARTED 53 29.6kb 192.168.224.187 gag-prod-node-187
curl http://192.168.224.188:9200_nodes/process?pretty 查看 master节点的惟一标识
{
"cluster_name" : "gag-prod",
"nodes" : {
"tdp1G9DbRseQm8xS9v8jng" : { \\这个是 187 节点的惟一标识
"name" : "gag-prod-node-187",
"transport_address" : "192.168.224.187:9300",
"host" : "192.168.224.187",
"ip" : "192.168.224.187",
"version" : "2.3.2",
"build" : "b9e4a6a",
"http_address" : "192.168.224.187:9200",
"attributes" : {
"master" : "true"
},
"process" : {
"refresh_interval_in_millis" : 1000,
"id" : 10009,
"mlockall" : false
}
},
"a6tktPPYSCOGv4uw8uRclg" : { \\这个是 186 节点的惟一标识
"name" : "gag-prod-node-186",
"transport_address" : "192.168.224.186:9300",
"host" : "192.168.224.186",
"ip" : "192.168.224.186",
"version" : "2.3.2",
"build" : "b9e4a6a",
"http_address" : "192.168.224.186:9200",
"attributes" : {
"master" : "false"
},
"process" : {
"refresh_interval_in_millis" : 1000,
"id" : 24049,
"mlockall" : false
}
},
"d5DvDdr6SLak8YCC099jRg" : { \\这个是 188 节点的惟一标识
"name" : "gag-prod-node-188",
"transport_address" : "192.168.224.188:9300",
"host" : "192.168.224.188",
"ip" : "192.168.224.188",
"version" : "2.3.2",
"build" : "b9e4a6a",
"http_address" : "192.168.224.188:9200",
"attributes" : {
"master" : "true"
},
"process" : {
"refresh_interval_in_millis" : 1000,
"id" : 13058,
"mlockall" : false
}
}
}
}
经过以上操做咱们已经找到了 “问题分片”、“节点惟一标识”，如今咱们就能够强制把问题分片分配到其中一个节点上了。下面咱们将问题分片分到 gag-prod-node-187 上
编辑脚本：（若是有不少unassigned shards，那么能够写循环脚本）
#!/bin/bash
# 将 items22 0 强制分配到 gag-prod-node-187（tdp1G9DbRseQm8xS9v8jng）
curl -XPOST '192.168.224.187:9200/_cluster/reroute' -d '{
"commands" : [ {
"allocate" : {
"index" : "items22",
"shard" : 0,
"node" : "tdp1G9DbRseQm8xS9v8jng",
"allow_primary" : true
}
}
]
}'
# 将 items22 2 强制分配到 gag-prod-node-187（tdp1G9DbRseQm8xS9v8jng）
curl -XPOST '192.168.224.187:9200/_cluster/reroute' -d '{
"commands" : [ {
"allocate" : {
"index" : "items22",
"shard" : 2,
"node" : "tdp1G9DbRseQm8xS9v8jng",
"allow_primary" : true
}
}
]
}'
运行完此脚本后，再查看集群状态，已经恢复，等到此分片自动备份到另外一个节点上后，中止 gag-prod-node-187 节点，分片已经能够自动分片节点。