K8s-Evicted-Pod处理

K8s-Evicted-Pod处理

现象

k8s出现很多Evicted Pod

排查

kubectl describe pods farm-server-789ddb7b4c-5jltb -n dev-3 |grep -i message
Message: Pod The node had condition: [DiskPressure].

原因

k8s节点磁盘达到85%触发node驱逐pod

解决

## 1.降低磁盘使用率

## 2.修改kubelet启动参数
vi /usr/lib/systemd/system/kubelet.service.d/10-kubeadm.conf
Environment="KUBELET_KUBECONFIG_ARGS=--bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf --eviction-hard=nodefs.available<5%"
systemctl daemon-reload
systemctl restart kubelet

## 删除evicted的pod
kubectl -n base get pods |grep Evicted |awk '{print $1}' |xargs kubectl -n base delete pods