前言:
後端小夥伴們準備搞pvp對戰服務。配置中心選型選擇了阿裡雲的nacos服務。參照https://nacos.io/zh-cn/docs。由于業務規劃都在kubernetes叢集上,就簡單參照https://nacos.io/zh-cn/docs/use-nacos-with-kubernetes.html做了一個demo讓他們先玩一下。
關于nacos:
參照:https://nacos.io/zh-cn/docs/what-is-nacos.html
- 服務發現和健康監測: 支援基于 DNS 和基于 RPC 的服務發現。服務提供者使用 原生SDK、OpenAPI、或一個獨立的Agent TODO注冊 Service 後,服務消費者可以使用DNS TODO 或HTTP&API查找和發現服務。提供對服務的實時的健康檢查,阻止向不健康的主機或服務執行個體發送請求
- 動态配置服務: Nacos 提供配置統一管理功能,能夠幫助我們将配置以中心化、外部化和動态化的方式管理所有環境的應用配置和服務配置。
- 動态 DNS 服務: Nacos 支援動态 DNS 服務權重路由,能夠讓我們很容易地實作中間層負載均衡、更靈活的路由政策、流量控制以及資料中心内網的簡單 DNS 解析服務。
- 服務及其中繼資料管理: Nacos 支援從微服務平台建設的視角管理資料中心的所有服務及中繼資料,包括管理服務的描述、生命周期、服務的靜态依賴分析、服務的健康狀态、服務的流量管理、路由及安全政策、服務的 SLA 以及最首要的 metrics 統計資料。
- 嗯 還有更多的特性清單…
一. nacos on kubernetes
基本的安裝過程參照:https://github.com/nacos-group/nacos-k8s/blob/master/README-CN.md
1. 建立命名空間
嗯當然了第一步還是先建立一個搭建nacos服務的namespace了:
kubectl create ns nacos
2. git clone 倉庫
git clone https://github.com/nacos-group/nacos-k8s.git
基本都會因為網絡原因無法clone,我是直接下載下傳包到本地 然後上傳到伺服器了。
3. 部署初始化mysql伺服器
生産的話肯定是用雲商的雲資料庫了,比如騰訊雲的rds服務。由于隻是給程式整一個demo讓他們玩一下,就講mysql 整合在kubernetes中了。個人存儲storageclass都是使用預設的騰訊雲的cbs-csi。
cd /nacos-k8s/mysql(當然了我是上傳的目錄路徑是/root/nacos/nacos-k8s-master/deploy/mysql**)**
1. 部署mysql服務
cat pvc.yaml
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: nacos-mysql-pvc
namespace: nacos
spec:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 10Gi
storageClassName: cbs-csi
mysql的部署檔案直接複制了mysql-ceph.yaml的修改了一下:
cat mysql.yaml
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: nacos-mysql-pvc
namespace: nacos
spec:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 10Gi
storageClassName: cbs-csi
[root@sh-master-01 mysql]# cat mysql.yaml
apiVersion: v1
kind: ReplicationController
metadata:
name: mysql
labels:
name: mysql
spec:
replicas: 1
selector:
name: mysql
template:
metadata:
labels:
name: mysql
spec:
containers:
- name: mysql
image: nacos/nacos-mysql:5.7
ports:
- containerPort: 3306
env:
- name: MYSQL_ROOT_PASSWORD
value: "root"
- name: MYSQL_DATABASE
value: "nacos_devtest"
- name: MYSQL_USER
value: "nacos"
- name: MYSQL_PASSWORD
value: "nacos"
volumeMounts:
- name: mysql-persistent-storage
mountPath: /var/lib/mysql
subPath: mysql
readOnly: false
volumes:
- name: mysql-persistent-storage
persistentVolumeClaim:
claimName: nacos-mysql-pvc
---
apiVersion: v1
kind: Service
metadata:
name: mysql
labels:
name: mysql
spec:
ports:
- port: 3306
targetPort: 3306
selector:
name: mysql
kubectl apply -f pvc.yaml
kubectl apply -f mysql.yaml -n nacos
kubectl get pods -n nacos
等待mysql pods running
$kubectl get pods -n nacos
NAME READY STATUS RESTARTS AGE
mysql-hhs5q 1/1 Running 0 3h51m
2. 進入mysql 容器執行初始化腳本
kubectl exec -it mysql-hhs5q bash -n nacos
mysql -uroot -p root *****
create database nacos_devtest;
use nacos_devtest;
### 我是圖省事,把這sql腳本裡面直接複制進去搞了...
https://github.com/alibaba/nacos/blob/develop/distribution/conf/nacos-mysql.sql
-------
退出mysql控制台,并退出容器
quit;
exit
4. 部署nacos
從mysql目錄 cd …/nacos
cat nacos.yaml
---
apiVersion: v1
kind: Service
metadata:
name: nacos-headless
labels:
app: nacos
annotations:
service.alpha.kubernetes.io/tolerate-unready-endpoints: "true"
spec:
ports:
- port: 8848
name: server
targetPort: 8848
- port: 7848
name: rpc
targetPort: 7848
clusterIP: None
selector:
app: nacos
---
apiVersion: v1
kind: ConfigMap
metadata:
name: nacos-cm
data:
mysql.db.name: "nacos_devtest"
mysql.port: "3306"
mysql.user: "nacos"
mysql.password: "nacos"
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
name: nacos
spec:
serviceName: nacos-headless
replicas: 3
template:
metadata:
labels:
app: nacos
annotations:
pod.alpha.kubernetes.io/initialized: "true"
spec:
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: "app"
operator: In
values:
- nacos
topologyKey: "kubernetes.io/hostname"
initContainers:
- name: peer-finder-plugin-install
image: nacos/nacos-peer-finder-plugin:1.0
imagePullPolicy: Always
volumeMounts:
- mountPath: /home/nacos/plugins/peer-finder
name: plguindir
containers:
- name: nacos
imagePullPolicy: Always
image: nacos/nacos-server:latest
resources:
requests:
memory: "2Gi"
cpu: "500m"
ports:
- containerPort: 8848
name: client-port
- containerPort: 7848
name: rpc
env:
- name: NACOS_REPLICAS
value: "2"
- name: SERVICE_NAME
value: "nacos-headless"
- name: DOMAIN_NAME
value: "layabox.daemon"
- name: POD_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: MYSQL_SERVICE_DB_NAME
valueFrom:
configMapKeyRef:
name: nacos-cm
key: mysql.db.name
- name: MYSQL_SERVICE_PORT
valueFrom:
configMapKeyRef:
name: nacos-cm
key: mysql.port
- name: MYSQL_SERVICE_USER
valueFrom:
configMapKeyRef:
name: nacos-cm
key: mysql.user
- name: MYSQL_SERVICE_PASSWORD
valueFrom:
configMapKeyRef:
name: nacos-cm
key: mysql.password
- name: NACOS_SERVER_PORT
value: "8848"
- name: NACOS_APPLICATION_PORT
value: "8848"
- name: PREFER_HOST_MODE
value: "hostname"
volumeMounts:
- name: plguindir
mountPath: /home/nacos/plugins/peer-finder
- name: datadir
mountPath: /home/nacos/data
- name: logdir
mountPath: /home/nacos/logs
volumeClaimTemplates:
- metadata:
name: plguindir
spec:
accessModes: [ "ReadWriteOnce" ]
storageClassName: "cbs-csi"
resources:
requests:
storage: 10Gi
- metadata:
name: datadir
spec:
accessModes: [ "ReadWriteOnce" ]
storageClassName: "cbs-csi"
resources:
requests:
storage: 10Gi
- metadata:
name: logdir
spec:
accessModes: [ "ReadWriteOnce" ]
storageClassName: "cbs-csi"
resources:
requests:
storage: 10Gi
selector:
matchLabels:
app: nacos
主要就是修改了storageclassName為 cbs-csi。并修改了accessmodes,還有DOMAIN_NAME變量修改為自己命名的叢集字尾.簡單demo不做詳細論述。
kubectl apply -f nacos.yaml -n nacos
等待服務running
5. 對外暴露服務
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: nacos-headless-http
namespace: nacos
annotations:
kubernetes.io/ingress.class: traefik
traefik.ingress.kubernetes.io/router.entrypoints: web
spec:
rules:
- host: nacos-server.saynaihe.com
http:
paths:
- pathType: Prefix
path: /
backend:
service:
name: nacos-headless
port:
number: 8848