在了解了ES的基础知识后,接下来就是实际操做了。git
环境准备:
jdk 1.8
ElasticSearch 6.4.0
window7github
步骤:spring
在启动过程当中默认的jvm内存参数设置比较大,能够在config目录下面的jvm.options中将-Xms和-Xmx调小sql
git clone git://github.com/mobz/elasticsearch-head.git
cd elasticsearch-head
npm install
npm run start
复制代码
启动后,能够在浏览器中访问9100端口npm
经过上述的几个步骤,咱们就成功的搭建了一个能够试验的ES环境,使用header插件能够更加方便的查看ES中索引,分片和文档的信息。json
因为存在跨域问题,因此须要在elasticsearch目录中config下的elasticsearch.yml文件中添加跨域
http.cors.enabled: true
http.cors.allow-origin: "*"
复制代码
ES是基于http和json来和客户端交互的,所以官方也提供了一个RESTClient客户端,因此咱们也借助这个client来实现增删改查的操做。浏览器
依赖:bash
org.elasticsearch:elasticsearch:5.4.2 ->ES 平台版本
org.elasticsearch.client:rest:5.4.2 -> restClient 版本
io.searchbox:jest:5.3.3 -> 基于RestClient的一个封装
复制代码
在使用jest时,会建立一个全局单例的JestClient,而后在整个应用的生命周期中都会使用该client多线程
JestClientFactory factory = new JestClientFactory();
List<String> urls = new ArrayList<>();
// urls.add("http://10.37.2.142:9900");
urls.add("http://127.0.0.1:9200");
// urls.add("http://10.37.2.144:9900");
factory.setHttpClientConfig(new HttpClientConfig
.Builder(urls)//集群中全部的节点地址
.multiThreaded(true)//是否使用多线程
.defaultMaxTotalConnectionPerRoute(2)//每一个路由最大链接数
.maxTotalConnection(20)//整个应用最大的链接数
.readTimeout(30000)//超时时间
.build());
JestClient client = factory.getObject();
复制代码
在应用中能够经过spring对client进行管理,在应用关闭时须要调用client.shutdownClient();将资源进行释放
Settings.Builder settingsBuilder = Settings.builder();
settingsBuilder.put("number_of_shards",5);//主分片数
settingsBuilder.put("number_of_replicas",1);//副本数
jestClient.execute(new CreateIndex.Builder("index").settings(settingsBuilder.build().getAsMap()).build());
//建立映射-mapping
PutMapping putMapping = new PutMapping.Builder(
"my_index",
"my_type",
"{ \"my_type\" : { \"properties\" : { \"message\" : {\"type\" : \"string\", \"store\" : \"yes\"} } } }"
).build();
client.execute(putMapping);
复制代码
ES默认是容许动态建立的,因此在建立index时能够不用建立类型的mapping,而后存储document时会动态的建立mapping,查询index下全部类型的mapping
GET 127.0.0.1:9200/db1/_mapping
删除index
jestClient.execute(new DeleteIndex.Builder(index)
.build());
复制代码
增长document
document的增长是比较简单的
String source = "{\"user\":\"kimchy\"}";//使用接送字符串
String source = jsonBuilder()
.startObject()
.field("user", "kimchy")
.field("postDate", "date")
.field("message", "trying out Elastic Search")
.endObject().string();//使用构造的json
Map<String, String> source = new LinkedHashMap<String,String>();//使用map
source.put("user", "kimchy");
Article source = new Article();//使用pojo对象
source.setAuthor("John Ronald Reuel Tolkien");
source.setContent("The Lord of the Rings is an epic high fantasy novel");
Index index = new Index.Builder(source)
.index("twitter")//指定index
.type("tweet")//指定type
.id("1")//指定id,能够不指定则ES自动生成id
.build();
jestClient.execute(index);
复制代码
以上是单个增长,咱们一样可使用Bulk批量的插入ES:
List<Index> indexList = new ArrayList<>();
for (OrderDto t : datas) {
Index indexDoc = new Index.Builder(t).index(index).type(type).build();
indexList.add(indexDoc);
Bulk.Builder bulkBuilder = new Bulk.Builder();
bulkBuilder.addAction(indexList);
BulkResult br = jestClient.execute(bulkBuilder.build());
}
复制代码
删除document
每一个document都是由index,type,id三者共同惟一肯定的,因此能够指定删除某个document:
jestClient.execute(new Delete.Builder("1")//id =1
.index("index")// index = index
.type("type")// type = type
.build());
复制代码
一样的咱们能够根据条件进行删除:
String query ="\"{\n"+
"\"query\": {\n"+
"\"match_all\": {}\n"+
"}\"";//查询条件
DeleteByQuery deleteByQuery = new DeleteByQuery.Builder(query).build();
JestResult deleteResult = jestClient.execute(deleteByQuery);
复制代码
如上,表示删除全部的document,查询的条件后面会介绍。
一切都是为了检索
检索才是ES的最诱人的特性,首先先简单感觉一下
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
TermQueryBuilder memberTerm = QueryBuilders.termQuery("memberId", memberId);//等值查询
Integer[] channels = {101, 106};
TermsQueryBuilder orderChannelTerm = QueryBuilders.termsQuery("orderChannel", channels);//in查询
Integer[] activeType = {0, 8, 9, 7};
TermsQueryBuilder activeTypeTerm = QueryBuilders.termsQuery("activeType", activeType);
AggregationBuilder orderItemIdAgg = .field("b2corditemid").size(Integer.MAX_VALUE);
Date now = new Date();
Calendar calendar = Calendar.getInstance(); //获得日历
calendar.setTime(now);//把当前时间赋给日历
calendar.add(calendar.MONTH, -3); //设置为前3月
Date dBefore = calendar.getTime(); //获得前3月的时间
RangeQueryBuilder payTimeRange = QueryBuilders.rangeQuery("payTime").gt(dBefore).lt(now);//范围查询
searchSourceBuilder.query(QueryBuilders.boolQuery()
.must(memberTerm)// and查询
.filter(orderChannelTerm)//
.filter(activeTypeTerm)
.filter(payTimeRange)
);
Sort placeTimeSort = new Sort("placeTime", Sort.Sorting.DESC);
Sort idSort = new Sort("orderId", Sort.Sorting.ASC);
searchSourceBuilder.aggregation(orderItemIdAgg);// group by 分组
searchSourceBuilder.from(0).size(20);
Search search = new Search.Builder(searchSourceBuilder.toString())
.addType(type)
.addIndex(index)
.addSort(placeTimeSort)//结果排序
.addSort(idSort)
.build();
复制代码
如上的查询能够相似于sql:
SELECT
*
FROM
bm_client_order_detail o
WHERE
o.`payTime` >= DATE_SUB(NOW(), INTERVAL 3 MONTH)
AND o.memberId = 101204389
AND o.orderChannel IN (101, 106)
AND activeType IN (0, 8, 9, 17)
GROUP BY
o.b2corditemid
ORDER BY
o.placeTime DESC,
o.id ASC
LIMIT 0,20
复制代码
未完待续!!!