环境是使用二进制安装的，使用kubeadm则很难遇到这种状况
初步部署prometheus-operator会遇到两个问题：
一、配置安装中遇到的坑
二、配置完成后数据的持久化问题
这篇博客首先解决安装中遇到的坑，下一篇作持久化node
1、下载安装文件
[root@k8s-master1 prometheus]# git clone https://github.com/coreos/kube-prometheus.git [root@k8s-master1 prometheus]# cd ./kube-prometheus/manifests/
2、修改yaml文件（开启nodeport,方便外网用户访问）
[root@k8s-master1 manifests]# vim ./grafana-service.yaml apiVersion: v1 kind: Service metadata: labels: app: grafana name: grafana namespace: monitoring spec: type: NodePort #添加的内容 ports: - name: http port: 3000 targetPort: http nodePort: 30100 #添加的内容 selector: app: grafana [root@k8s-master1 manifests]# vim prometheus-service.yaml apiVersion: v1 kind: Service metadata: labels: prometheus: k8s name: prometheus-k8s namespace: monitoring spec: type: NodePort #添加的内容 ports: - name: web port: 9090 targetPort: web nodePort: 30200 #添加的内容 selector: app: prometheus prometheus: k8s #删除最后一行 [root@k8s-master1 manifests]# vim alertmanager-service.yaml apiVersion: v1 kind: Service metadata: labels: alertmanager: main name: alertmanager-main namespace: monitoring spec: type: NodePort #添加的内容 ports: - name: web port: 9093 targetPort: web nodePort: 30300 #添加的内容 selector: alertmanager: main app: alertmanager #删除最后一行
3、开启聚合层及HPA功能（入坑一）
不开启聚合层的报错内容大概是： I0514 16:31:41.896256 1 adapter.go:91] successfully using in-cluster auth F0514 16:31:42.216596 1 adapter.go:252] unable to install resource metrics API: cluster doesn't provide requestheader-client-ca-file [root@k8s-master1 ~]# vim /opt/kubernetes/cfg/kube-apiserver --requestheader-client-ca-file=/opt/kubernetes/ssl/ca.pem \ --requestheader-allowed-names=aggregator \ --requestheader-extra-headers-prefix=X-Remote-Extra- \ --requestheader-group-headers=X-Remote-Group \ --requestheader-username-headers=X-Remote-User \ --runtime-config=api/all=true \ --enable-aggregator-routing=true" [root@k8s-master1 ~]# vim /op t/kubernetes/cfg/kube-controller-manager --horizontal-pod-autoscaler-use-rest-clients=true" [root@k8s-node1 ~]# vim /opt/kubernetes/cfg/kubelet --authentication-token-webhook=true
4、在master节点中安装kubelet kube-proxy，否则会报错（入坑二）
将master也做为一个node节点配置（配置方法相同与node相同，否则会显示安装失败）,建议在安装集群的时候就安装上，而不是出现问题后在排查安装
5、在每台node节点中安装kube-apiserver组件(将node节点用到的证书拷贝到指定目录中，)（入坑三）
#若是不执行此步骤，kubectl top node：只能查看master节点的信息 [root@k8s-master1 ~]# scp /opt/kubernetes/cfg/kube-apiserver root@192.168.100.30:/opt/kubernetes/cfg/ [root@k8s-master1 ~]# scp /opt/kubernetes/bin/kube-apiserver root@192.168.100.30:/opt/kubernetes/bin/ [root@k8s-master1 ~]# scp /usr/lib/systemd/system/kube-apiserver.service root@192.168.100.30:/usr/lib/systemd/system/ [root@k8s-master1 ~]# scp /opt/kubernetes/cfg/token.csv root@192.168.100.30:/opt/kubernetes/cfg/ [root@k8s-node1 ~]# vim /opt/kubernetes/cfg/kube-apiserver KUBE_APISERVER_OPTS="--logtostderr=true \ --v=4 \ --etcd-servers=https://192.168.100.10:2379,https://192.168.100.30:2379,https://192.168.100.40:2379 \ --enable-bootstrap-token-auth \ --token-auth-file=/opt/kubernetes/cfg/token.csv \ --service-node-port-range=30000-50000 \ --tls-cert-file=/opt/kubernetes/ssl/server.pem \ --tls-private-key-file=/opt/kubernetes/ssl/server-key.pem \ --client-ca-file=/opt/kubernetes/ssl/ca.pem \ --service-account-key-file=/opt/kubernetes/ssl/ca-key.pem \ --etcd-cafile=/opt/etcd/ssl/ca.pem \ --etcd-certfile=/opt/etcd/ssl/server.pem \ --etcd-keyfile=/opt/etcd/ssl/server-key.pem \ --requestheader-client-ca-file=/opt/kubernetes/ssl/ca.pem \ --requestheader-allowed-names=aggregator \ --requestheader-extra-headers-prefix=X-Remote-Extra- \ --requestheader-group-headers=X-Remote-Group \ --requestheader-username-headers=X-Remote-User \ --proxy-client-cert-file=/opt/kubernetes/ssl/kube-proxy.pem \ --proxy-client-key-file=/opt/kubernetes/ssl/kube-proxy-key.pem \ --runtime-config=api/all=true \ --enable-aggregator-routing=true" [root@k8s-node1 ~]# systemctl restart kube-apiserver
6、配置core-dns（入坑四）
内部组件须要dns的支持
连接：部署k8s组件(13)：core-dns的做用和配置的方法git
7、准备工做完成后，进入yaml文件的目录进行建立
[root@k8s-master1 ~]# cd /root/helm/prometheus/kube-prometheus/manifests/ [root@k8s-master1 manifests]# kubectl apply -f ./*
8、检查是否配置成功
[root@k8s-master1 ~]# kubectl top nodes NAME CPU(cores) CPU% MEMORY(bytes) MEMORY% 192.168.100.10 109m 5% 809Mi 42% 192.168.100.30 115m 5% 1264Mi 32% 192.168.100.40 121m 6% 1443Mi 37%
1）查看非健康状态，若是没有则说明配置成功http://192.168.100.30:30200
2）查看生成的图像
github
9、登陆到grafana(http://192.168.100.30:30100/login)
默认帐户：admin
默认密码：admin
1）配置prometheus
2）测试是否可以否正常使用
3）导入插件
4）回到home，点击查看node节点图像
5）查看图像web
10、若是遇到如下报错，须要使用如下命令解决（入坑五）
Error from server (BadRequest): a container name must be specified for pod kube-state-metrics-56998d67b9-xcndn, choose one of: [kube-rbac-proxy-main kube-rbac-proxy-self kube-state-metrics addon-resizer]
kubectl delete clusterrolebinding system:anonymous --clusterrole=cluster-admin --user=system:kube-proxybootstrap
11、配置dns时更改网络可能出现的问题（入坑六）
错误： A dependency job for kubelet.service failed. See ‘journalctl -xe’ for details
解决办法：
flannel或者是其余如calico程序启动失败致使
A dependency job for kubelet.service failed. See ‘journalctl -xe’ for details
[root@k8s-node2 ~]# systemctl restart flanneld
[root@k8s-node2 ~]# systemctl restart kubeletvim