最近部门内需要进行私有化部署,所以这个系列主要是以docker+Kubernetes 技术选型和的调研为主了。
很久没有更新博客,这里把自己的随笔记录到博客中,后续再进行详细整理吧
为什么不纯手动安全k8s呢?
首先我们是想选购一个成型的标准封装尽量简化我们的安装流程。
其次我们如果实现这个标品是ok的那么,其实就获得了它的离线安装能力。
当然也有一些缺点,我们不清楚内部构造,重启服务遇到问题时,我们也无法进行问题解决,所以我感觉先试用这个服务后续还要进行一把纯手动安装这样要清楚的知道哪部分出了啥问题。
我是用mac电脑安装的vmware进行的操作,因为它只能支持linux下的操作环境。然后你需要下载centos7的镜像,然后把你的虚拟机安装才行。
参照网址安装:
https://kubesphere.com.cn/docs/quick-start/all-in-one-on-linux/
安装步骤如下:
#需要先下个叫kk的小东西
export KKZONE=cn
curl -sfL https://get-kk.kubesphere.io | VERSION=v2.0.0 sh -
#开始安装,设置版本号
./kk create cluster --with-kubernetes v1.21.5 --with-kubesphere v3.2.1
#然后大体操作流程就是它会从各种数据源中获取到镜像文件
downloading amd64 kubelet v1.21.5 ...
21:56:43 PDT message: [localhost]
#执行安装这些镜像和install的镜像
21:59:53 PDT [InstallETCDBinaryModule] Install etcd using binary
21:59:54 PDT success: [localhost.localdomain.cluster.local]
#最后会卡到这里,最后那个点就是菊花了,一直等它转完就ok了
#这里的速度取决于机器配置了,2CPU 4G内存,至少半小时。
clusterconfiguration.installer.kubesphere.io/ks-installer created
22:00:43 PDT success: [localhost.localdomain.cluster.local]
Please wait for the installation to complete: >>--->
#安装完毕是这个界面:
#####################################################
### Welcome to KubeSphere! ###
#####################################################
Console: http://192.168.3.64:30880
Account: admin
Password: P@88w0rd
NOTES:
1. After you log into the console, please check the
monitoring status of service components in
"Cluster Management". If any service is not
ready, please wait patiently until all components
are up and running.
2. Please change the default password after login.
#####################################################
https://kubesphere.io 2022-06-02 22:14:25
#####################################################
22:14:29 PDT success: [localhost.localdomain.cluster.local]
22:14:29 PDT Pipeline[CreateClusterPipeline] execute successful
Installation is complete.
Please check the result using the command:
kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l app=ks-install -o jsonpath='{.items[0].metadata.name}') -f
记录一下当前机器的images和ps容器,方便后续排查问题。真是感觉后续可能有问题不好排查,因为k8s的文档才是最全的。
[root@localhost ~]# docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
kubesphere/ks-installer v3.2.1 7f833c28ad87 5 months ago 383MB
kubesphere/ks-controller-manager v3.2.1 ea90d211235f 5 months ago 168MB
kubesphere/ks-apiserver v3.2.1 be3514bdedbc 5 months ago 191MB
kubesphere/ks-console v3.2.1 d7026f326408 5 months ago 112MB
kubesphere/kubectl v1.21.0 f1e3bb4ed882 7 months ago 79MB
kubesphere/notification-manager v1.4.0 b8b2f6b3790f 7 months ago 51.8MB
kubesphere/notification-tenant-sidecar v3.2.0 4b47c43ec6ab 8 months ago 52.8MB
kubesphere/notification-manager-operator v1.4.0 08ca8def2520 8 months ago 46.2MB
kubesphere/kube-apiserver v1.21.5 7b2ac941d4c3 8 months ago 126MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver v1.21.5 7b2ac941d4c3 8 months ago 126MB
kubesphere/kube-proxy v1.21.5 e08abd2be730 8 months ago 104MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-proxy v1.21.5 e08abd2be730 8 months ago 104MB
kubesphere/kube-controller-manager v1.21.5 184ef4d127b4 8 months ago 120MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controller-manager v1.21.5 184ef4d127b4 8 months ago 120MB
kubesphere/kube-scheduler v1.21.5 8e60ea3644d6 8 months ago 50.8MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-scheduler v1.21.5 8e60ea3644d6 8 months ago 50.8MB
calico/node v3.20.0 5ef66b403f4f 10 months ago 170MB
calico/pod2daemon-flexvol v3.20.0 5991877ebc11 10 months ago 21.7MB
calico/cni v3.20.0 4945b742b8e6 10 months ago 146MB
calico/kube-controllers v3.20.0 76ba70f4748f 10 months ago 63.2MB
openebs/provisioner-localpv 2.10.1 b5e01d57c971 11 months ago 62.7MB
kubesphere/pause 3.4.1 0f8457a4c2ec 16 months ago 683kB
registry.cn-beijing.aliyuncs.com/kubesphereio/pause 3.4.1 0f8457a4c2ec 16 months ago 683kB
csiplugin/snapshot-controller v4.0.0 f1d8a00ae690 17 months ago 46.6MB
kubesphere/prometheus-config-reloader v0.43.2 08ed6bfd22b5 19 months ago 13.4MB
kubesphere/prometheus-operator v0.43.2 4ad0a8e16901 19 months ago 41.9MB
kubesphere/kube-rbac-proxy v0.8.0 ad393d6a4d1b 19 months ago 49MB
coredns/coredns 1.8.0 296a6d5035e2 19 months ago 42.5MB
registry.cn-beijing.aliyuncs.com/kubesphereio/coredns 1.8.0 296a6d5035e2 19 months ago 42.5MB
prom/alertmanager v0.21.0 c876f5897d7b 23 months ago 55.5MB
kubesphere/kube-state-metrics v1.9.7 6497f02dbdad 24 months ago 32.8MB
kubesphere/k8s-dns-node-cache 1.15.12 5340ba194ec9 2 years ago 107MB
prom/node-exporter v0.18.1 e5a616e4b9cf 2 years ago 22.9MB
mirrorgooglecontainers/defaultbackend-amd64 1.4 846921f0fe0e 4 years ago 4.84MB
[root@localhost ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
7182bd2263bc kubesphere/kubectl "entrypoint.sh" 2 minutes ago Up 2 minutes k8s_kubectl_kubectl-admin-6667774bb-8hdbr_kubesphere-controls-system_71f76418-3d48-4f0a-bc24-39c0ddfcdd8b_0
e5f7d753fc8b kubesphere/pause:3.4.1 "/pause" 3 minutes ago Up 3 minutes k8s_POD_kubectl-admin-6667774bb-8hdbr_kubesphere-controls-system_71f76418-3d48-4f0a-bc24-39c0ddfcdd8b_0
c404189a1b3f kubesphere/ks-controller-manager "controller-manager …" 3 minutes ago Up 3 minutes k8s_ks-controller-manager_ks-controller-manager-6bdbc4d56-qgqc8_kubesphere-system_a5813eaa-f457-4500-91a6-81c23711db2e_0
7a10ca1c5d6d kubesphere/ks-apiserver "ks-apiserver --logt…" 3 minutes ago Up 3 minutes k8s_ks-apiserver_ks-apiserver-8484959456-k5fqx_kubesphere-system_759c72b1-36c5-46b5-9cfa-2dd2ddd86bfd_0
9d7af515835e kubesphere/pause:3.4.1 "/pause" 3 minutes ago Up 3 minutes k8s_POD_ks-controller-manager-6bdbc4d56-qgqc8_kubesphere-system_a5813eaa-f457-4500-91a6-81c23711db2e_0
06a75444266b kubesphere/pause:3.4.1 "/pause" 3 minutes ago Up 3 minutes k8s_POD_ks-apiserver-8484959456-k5fqx_kubesphere-system_759c72b1-36c5-46b5-9cfa-2dd2ddd86bfd_0
f29dc368c6f3 kubesphere/notification-tenant-sidecar "/tenant-sidecar" 4 minutes ago Up 4 minutes k8s_tenant_notification-manager-deployment-78664576cb-k4xkt_kubesphere-monitoring-system_17e94aa1-150f-44e4-958d-6706e3db83a9_0
70dc8d507884 kubesphere/notification-manager "/notification-manag…" 4 minutes ago Up 4 minutes k8s_notification-manager_notification-manager-deployment-78664576cb-k4xkt_kubesphere-monitoring-system_17e94aa1-150f-44e4-958d-6706e3db83a9_0
1f30e708aa3f kubesphere/pause:3.4.1 "/pause" 4 minutes ago Up 4 minutes k8s_POD_notification-manager-deployment-78664576cb-k4xkt_kubesphere-monitoring-system_17e94aa1-150f-44e4-958d-6706e3db83a9_0
15c9d9c549a2 kubesphere/notification-manager-operator "/notification-manag…" 5 minutes ago Up 5 minutes k8s_notification-manager-operator_notification-manager-operator-7d44854f54-lmvt8_kubesphere-monitoring-system_abf70a62-f110-492c-983c-174230dbe354_0
d56a4d6b30fb kubesphere/prometheus-config-reloader "/bin/prometheus-con…" 5 minutes ago Up 5 minutes k8s_config-reloader_alertmanager-main-0_kubesphere-monitoring-system_d4d538de-a7fc-4990-92bb-67a05e8b5fb3_0
8d5dd9365770 ad393d6a4d1b "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy-self_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
e1ffb874c1c1 kubesphere/kube-rbac-proxy "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy-main_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
e18fcadb2e05 kubesphere/kube-rbac-proxy "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy_node-exporter-px22q_kubesphere-monitoring-system_5770efd5-7df5-4b40-b9d0-fd1f67abf0a4_0
06513567f672 ad393d6a4d1b "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy_notification-manager-operator-7d44854f54-lmvt8_kubesphere-monitoring-system_abf70a62-f110-492c-983c-174230dbe354_0
18fcbbb9c4e0 prom/alertmanager "/bin/alertmanager -…" 5 minutes ago Up 5 minutes k8s_alertmanager_alertmanager-main-0_kubesphere-monitoring-system_d4d538de-a7fc-4990-92bb-67a05e8b5fb3_0
285402dd9ef4 kubesphere/pause:3.4.1 "/pause" 5 minutes ago Up 5 minutes k8s_POD_notification-manager-operator-7d44854f54-lmvt8_kubesphere-monitoring-system_abf70a62-f110-492c-983c-174230dbe354_0
c7d91da7b61a kubesphere/kube-rbac-proxy "/usr/local/bin/kube…" 6 minutes ago Up 6 minutes k8s_kube-rbac-proxy_prometheus-operator-5c5db79546-cs47w_kubesphere-monitoring-system_9c234076-e562-4b5d-8d0a-36a957a8e783_0
e416db2686d9 kubesphere/kube-state-metrics "/kube-state-metrics…" 6 minutes ago Up 6 minutes k8s_kube-state-metrics_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
c1d8c91dcaca prom/node-exporter "/bin/node_exporter …" 6 minutes ago Up 6 minutes k8s_node-exporter_node-exporter-px22q_kubesphere-monitoring-system_5770efd5-7df5-4b40-b9d0-fd1f67abf0a4_0
ad6043cffaee kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_alertmanager-main-0_kubesphere-monitoring-system_d4d538de-a7fc-4990-92bb-67a05e8b5fb3_0
a3393a75fbfa kubesphere/prometheus-operator "/bin/operator --kub…" 7 minutes ago Up 7 minutes k8s_prometheus-operator_prometheus-operator-5c5db79546-cs47w_kubesphere-monitoring-system_9c234076-e562-4b5d-8d0a-36a957a8e783_0
41f30e2f4518 kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
880e0ec23330 kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_node-exporter-px22q_kubesphere-monitoring-system_5770efd5-7df5-4b40-b9d0-fd1f67abf0a4_0
a4423b96f988 kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_prometheus-operator-5c5db79546-cs47w_kubesphere-monitoring-system_9c234076-e562-4b5d-8d0a-36a957a8e783_0
0713f577689d mirrorgooglecontainers/defaultbackend-amd64 "/server" 10 minutes ago Up 10 minutes k8s_default-http-backend_default-http-backend-5bf68ff9b8-s8fg9_kubesphere-controls-system_334554f8-742c-4916-9602-20c41fb46687_0
c476b185eca2 kubesphere/ks-console "docker-entrypoint.s…" 11 minutes ago Up 11 minutes k8s_ks-console_ks-console-65f4d44d88-lhrhn_kubesphere-system_1eebb6e1-77a6-4f2b-b6dd-5d06201ba50a_0
915269bad362 kubesphere/pause:3.4.1 "/pause" 11 minutes ago Up 10 minutes k8s_POD_default-http-backend-5bf68ff9b8-s8fg9_kubesphere-controls-system_334554f8-742c-4916-9602-20c41fb46687_0
892afa1d6f41 kubesphere/pause:3.4.1 "/pause" 11 minutes ago Up 11 minutes k8s_POD_ks-console-65f4d44d88-lhrhn_kubesphere-system_1eebb6e1-77a6-4f2b-b6dd-5d06201ba50a_0
87ade779eb4b csiplugin/snapshot-controller "/snapshot-controlle…" 13 minutes ago Up 13 minutes k8s_snapshot-controller_snapshot-controller-0_kube-system_57b2b84d-73f7-4f73-be2c-fe5b644d2166_0
d409d6877100 kubesphere/pause:3.4.1 "/pause" 14 minutes ago Up 14 minutes k8s_POD_snapshot-controller-0_kube-system_57b2b84d-73f7-4f73-be2c-fe5b644d2166_0
701e02c0e155 kubesphere/ks-installer "/shell-operator sta…" 14 minutes ago Up 14 minutes k8s_installer_ks-installer-57bdbbf866-rflmb_kubesphere-system_19fe77fd-e284-4a1b-8001-8ad9ab8bb72a_0
fea3a2dd2bbe openebs/provisioner-localpv "/usr/local/bin/prov…" 15 minutes ago Up 15 minutes k8s_openebs-provisioner-hostpath_openebs-localpv-provisioner-5bfb67894-ss5rr_kube-system_1a5a1562-6290-44b4-9832-46275abab02e_0
44d585914e7c 76ba70f4748f "/usr/bin/kube-contr…" 16 minutes ago Up 16 minutes k8s_calico-kube-controllers_calico-kube-controllers-846b5f484d-zhhfz_kube-system_98d57d33-cde2-4e53-9a80-1d4725cb4854_0
505861c73e9d 296a6d5035e2 "/coredns -conf /etc…" 16 minutes ago Up 16 minutes k8s_coredns_coredns-b5648d655-jq7c9_kube-system_c588a69a-2bb1-40d8-9af9-de413002be1c_0
5cabab158b9b 296a6d5035e2 "/coredns -conf /etc…" 16 minutes ago Up 16 minutes k8s_coredns_coredns-b5648d655-vj27d_kube-system_22a5751f-cbe3-4502-9946-8195f4857af0_0
8a79445d4d23 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_calico-kube-controllers-846b5f484d-zhhfz_kube-system_98d57d33-cde2-4e53-9a80-1d4725cb4854_0
8c1fbe9f2505 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_coredns-b5648d655-jq7c9_kube-system_c588a69a-2bb1-40d8-9af9-de413002be1c_0
91986c7d5aac kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_coredns-b5648d655-vj27d_kube-system_22a5751f-cbe3-4502-9946-8195f4857af0_0
eea07d7ac04f kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_ks-installer-57bdbbf866-rflmb_kubesphere-system_19fe77fd-e284-4a1b-8001-8ad9ab8bb72a_0
a5a53bbef628 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_openebs-localpv-provisioner-5bfb67894-ss5rr_kube-system_1a5a1562-6290-44b4-9832-46275abab02e_0
1ecb779dc559 5ef66b403f4f "start_runit" 16 minutes ago Up 16 minutes k8s_calico-node_calico-node-6tcxw_kube-system_f9e3f88a-7a93-46ef-bc1d-169499d4b46c_0
b915ae317cb9 5340ba194ec9 "/node-cache -locali…" 16 minutes ago Up 16 minutes k8s_node-cache_nodelocaldns-rrjm4_kube-system_fa933637-3820-4928-824c-786d9d04726d_0
811c9a921570 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_calico-node-6tcxw_kube-system_f9e3f88a-7a93-46ef-bc1d-169499d4b46c_0
9132527c3b84 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_nodelocaldns-rrjm4_kube-system_fa933637-3820-4928-824c-786d9d04726d_0
052654e47894 e08abd2be730 "/usr/local/bin/kube…" 16 minutes ago Up 16 minutes k8s_kube-proxy_kube-proxy-rl6cd_kube-system_30bd16dc-d903-43ac-9097-7ca81d8d50a3_0
3f8fc2c40807 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-proxy-rl6cd_kube-system_30bd16dc-d903-43ac-9097-7ca81d8d50a3_0
fcb14f803f14 8e60ea3644d6 "kube-scheduler --au…" 16 minutes ago Up 16 minutes k8s_kube-scheduler_kube-scheduler-localhost.localdomain.cluster.local_kube-system_7cf4cd863cc5ab487dd736d4522d6f12_0
ab6bcef42a15 7b2ac941d4c3 "kube-apiserver --ad…" 16 minutes ago Up 16 minutes k8s_kube-apiserver_kube-apiserver-localhost.localdomain.cluster.local_kube-system_0adb32c5ad26f03fb28bb9ab8edaa102_0
a8b4d6f447e1 184ef4d127b4 "kube-controller-man…" 16 minutes ago Up 16 minutes k8s_kube-controller-manager_kube-controller-manager-localhost.localdomain.cluster.local_kube-system_b9a94bd9cc5c6634574a714b347777e4_0
d47a1ecabaec kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-scheduler-localhost.localdomain.cluster.local_kube-system_7cf4cd863cc5ab487dd736d4522d6f12_0
747bb4a37c24 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-controller-manager-localhost.localdomain.cluster.local_kube-system_b9a94bd9cc5c6634574a714b347777e4_0
7af423fd5f87 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-apiserver-localhost.localdomain.cluster.local_kube-system_0adb32c5ad26f03fb28bb9ab8edaa102_0
以优先级高地排名吧