1款開源工具,實(shí)現(xiàn)自動(dòng)化升級(jí)K3S集群!
即便你的集群能夠平穩(wěn)運(yùn)行,Kubernetes升級(jí)依舊是一項(xiàng)艱難的任務(wù)。由于每3個(gè)月Kubernetes會(huì)發(fā)布一個(gè)新版本,所以升級(jí)是十分必要的。如果一年內(nèi)你不升級(jí)你的Kubernetes集群,你就會(huì)落后許多。Rancher致力于解決開發(fā)運(yùn)維人員的痛點(diǎn),于是創(chuàng)建了新的開源項(xiàng)目System Upgrade Controller可以幫助開發(fā)人員平滑升級(jí)。
System Upgrade Controller引入了一個(gè)新的Kubernetes自定義資源定義(CRD),稱為Plan?,F(xiàn)在Plan是處理升級(jí)進(jìn)程的主要組件。以下是從git repo獲取的架構(gòu)圖:

使用System Upgrade Controller
自動(dòng)升級(jí)K3s
升級(jí)K3s Kubernetes集群有兩個(gè)主要要求:
CRD安裝
創(chuàng)建Plan
首先,讓我們檢查當(dāng)前正在運(yùn)行的K3s集群版本。
運(yùn)行以下命令,即可快速安裝:
curl -sfL https://get.k3s.io | INSTALL_K3S_VERSION=v1.16.3-k3s.2 shK3S_TOKEN is created at /var/lib/rancher/k3s/server/node-token on the server.For adding nodes, K3S_URL and K3S_TOKEN needs to be passed:curl -sfL https://get.k3s.io | K3S_URL=https://myserver:6443 K3S_TOKEN=XXX sh -KUBECONFIG file is create at /etc/rancher/k3s/k3s.yaml location
kubectl get nodesNAME STATUS ROLES AGE VERSIONkube-node-c155 Ready <none> 25h v1.16.3-k3s.2kube-node-2404 Ready <none> 25h v1.16.3-k3s.2kube-master-303d Ready master 25h v1.16.3-k3s.2
現(xiàn)在,我們部署CRD:
apiVersion: v1kind: Namespacemetadata:name: system-upgrade---apiVersion: v1kind: ServiceAccountmetadata:name: system-upgradenamespace: system-upgrade---apiVersion: rbac.authorization.k8s.io/v1kind: ClusterRoleBindingmetadata:name: system-upgraderoleRef:apiGroup: rbac.authorization.k8s.iokind: ClusterRolename: cluster-adminsubjects:kind: ServiceAccountname: system-upgradenamespace: system-upgrade---apiVersion: v1kind: ConfigMapmetadata:name: default-controller-envnamespace: system-upgradedata:SYSTEM_UPGRADE_CONTROLLER_DEBUG: "false"SYSTEM_UPGRADE_CONTROLLER_THREADS: "2"SYSTEM_UPGRADE_JOB_ACTIVE_DEADLINE_SECONDS: "900"SYSTEM_UPGRADE_JOB_BACKOFF_LIMIT: "99"SYSTEM_UPGRADE_JOB_IMAGE_PULL_POLICY: "Always"SYSTEM_UPGRADE_JOB_KUBECTL_IMAGE: "rancher/kubectl:v1.18.3"SYSTEM_UPGRADE_JOB_PRIVILEGED: "true"SYSTEM_UPGRADE_JOB_TTL_SECONDS_AFTER_FINISH: "900"SYSTEM_UPGRADE_PLAN_POLLING_INTERVAL: "15m"---apiVersion: apps/v1kind: Deploymentmetadata:name: system-upgrade-controllernamespace: system-upgradespec:selector:matchLabels:: system-upgrade-controllertemplate:metadata:labels:: system-upgrade-controller # necessary to avoid drainspec:affinity:nodeAffinity:requiredDuringSchedulingIgnoredDuringExecution:nodeSelectorTerms:matchExpressions:{key: "node-role.kubernetes.io/master", operator: In, values: ["true"]}serviceAccountName: system-upgradetolerations:key: "CriticalAddonsOnly"operator: "Exists"key: "node-role.kubernetes.io/master"operator: "Exists"effect: "NoSchedule"containers:name: system-upgrade-controllerimage: rancher/system-upgrade-controller:v0.5.0imagePullPolicy: IfNotPresentenvFrom:configMapRef:name: default-controller-envenv:name: SYSTEM_UPGRADE_CONTROLLER_NAMEvalueFrom:fieldRef:fieldPath: metadata.labels['upgrade.cattle.io/controller']name: SYSTEM_UPGRADE_CONTROLLER_NAMESPACEvalueFrom:fieldRef:fieldPath: metadata.namespacevolumeMounts:name: etc-sslmountPath: /etc/sslname: tmpmountPath: /tmpvolumes:name: etc-sslhostPath:path: /etc/ssltype: Directoryname: tmpemptyDir: {}
將上面的yaml分解,它將創(chuàng)建以下組件:
system-upgrade命名空間
system-upgrade服務(wù)賬戶
system-upgrade ClusterRoleBinding
用于設(shè)置容器中環(huán)境變量的config map
實(shí)際部署
現(xiàn)在,我們來部署yaml:
#Get the Lateest release tagcurl -s "https://api.github.com/repos/rancher/system-upgrade-controller/releases/latest" | awk -F '"' '/tag_name/{print $4}'v0.6.2# Apply the controller manifestkubectl apply -f https://raw.githubusercontent.com/rancher/system-upgrade-controller/v0.6.2/manifests/system-upgrade-controller.yamlnamespace/system-upgrade createdserviceaccount/system-upgrade createdclusterrolebinding.rbac.authorization.k8s.io/system-upgrade createdconfigmap/default-controller-env createddeployment.apps/system-upgrade-controller created# Verify everything is runningkubectl get all -n system-upgradeNAME READY STATUS RESTARTS AGEpod/system-upgrade-controller-7fff98589f-blcxs 1/1 Running 0 5m26sNAME READY UP-TO-DATE AVAILABLE AGEdeployment.apps/system-upgrade-controller 1/1 1 1 5m28sNAME DESIRED CURRENT READY AGEreplicaset.apps/system-upgrade-controller-7fff98589f 1 1 1 5m28s
創(chuàng)建一個(gè)K3s升級(jí)Plan
現(xiàn)在,是時(shí)候創(chuàng)建一個(gè)升級(jí)Plan。我們將使用在Git repo示例文件夾中提到的示例Plan。
---apiVersion: upgrade.cattle.io/v1kind: Planmetadata:name: k3s-servernamespace: system-upgradelabels:: serverspec:concurrency: 1version: v1.17.4+k3s1nodeSelector:matchExpressions:{key: k3s-upgrade, operator: Exists}{key: k3s-upgrade, operator: NotIn, values: ["disabled", "false"]}{key: k3s.io/hostname, operator: Exists}{key: k3os.io/mode, operator: DoesNotExist}{key: node-role.kubernetes.io/master, operator: In, values: ["true"]}serviceAccountName: system-upgradecordon: true# drain:# force: trueupgrade:image: rancher/k3s-upgrade---apiVersion: upgrade.cattle.io/v1kind: Planmetadata:name: k3s-agentnamespace: system-upgradelabels:: agentspec:concurrency: 2version: v1.17.4+k3s1nodeSelector:matchExpressions:{key: k3s-upgrade, operator: Exists}{key: k3s-upgrade, operator: NotIn, values: ["disabled", "false"]}{key: k3s.io/hostname, operator: Exists}{key: k3os.io/mode, operator: DoesNotExist}{key: node-role.kubernetes.io/master, operator: NotIn, values: ["true"]}serviceAccountName: system-upgradeprepare:# Since v0.5.0-m1 SUC will use the resolved version of the plan for the tag on the prepare container.# image: rancher/k3s-upgrade:v1.17.4-k3s1image: rancher/k3s-upgradeargs: ["prepare", "k3s-server"]drain:force: trueupgrade:image: rancher/k3s-upgrade
拆解以上yaml,它將創(chuàng)建:
與表達(dá)式匹配的Plan,以了解需要升級(jí)的內(nèi)容。所以在上述例子中,我們有2個(gè)plan:k3s-server和k3s-agent。node-role.kubernetes.io/master為true和k3s-upgrade的節(jié)點(diǎn)將被server Plan占用。帶false的將由client Plan占用。所以標(biāo)簽必須要設(shè)置正確。接下來,我們來apply Plan。
#Set the Node Labelskubectl label node kube-master-303d node-role.kubernetes.io/master=true# Apply the plan manifestkubectl apply -f https://raw.githubusercontent.com/rancher/system-upgrade-controller/master/examples/k3s-upgrade.yamlplan.upgrade.cattle.io/k3s-server createdplan.upgrade.cattle.io/k3s-agent created# We see that the jobs have startedkubectl get jobs -n system-upgradeNAME COMPLETIONS DURATION AGEapply-k3s-server-on-kube-master-303d-with-9efdeac5f6ede78-125aa 0/1 40s 40sapply-k3s-agent-on-kube-node-2404-with-9efdeac5f6ede78917-07df3 0/1 39s 39sapply-k3s-agent-on-kube-node-c155-with-9efdeac5f6ede78917-9a585 0/1 39s 39s# Upgrade in-progress, completed on the `node-role.kubernetes.io/master=true` nodekubectl get nodesNAME STATUS ROLES AGE VERSIONkube-node-2404 Ready,SchedulingDisabled <none> 26h v1.16.3-k3s.2kube-node-c155 Ready,SchedulingDisabled <none> 26h v1.16.3-k3s.2kube-master-303d Ready master 26h v1.17.4+k3s1# In a few minutes all nodes get upgraded to latest version as per the plankubectl get nodesNAME STATUS ROLES AGE VERSIONkube-node-2404 Ready <none> 26h v1.17.4+k3s1kube-node-c155 Ready <none> 26h v1.17.4+k3s1kube-master-303d Ready master 26h v1.17.4+k3s1
我們的K3s Kubernetes升級(jí)完成!極為輕松而且十分順利。Project可以更新底層操作系統(tǒng)并重啟節(jié)點(diǎn)。歡迎嘗試喲!
Github地址:
https://github.com/rancher/system-upgrade-controller
推薦閱讀
掃碼添加k3s中文社區(qū)助手
加入官方中文技術(shù)社區(qū)
官網(wǎng):https://k3s.io
