Files
Biohazard/kube
2022-05-17 23:13:43 +08:00
..
2022-05-17 23:13:43 +08:00
2022-04-17 04:17:39 +08:00

Kuberhazard

Let's-a Go!

Clone repo

git clone git@github.com:JJGadgets/Biohazard.git && cd ./Biohazard/kube

Install Kubernetes

  • Use Talos Linux to install, the install script & patches are in `0-install` folder.
cd ./0-install && chmod +x ./talosInstall.sh && ./talosInstall.sh
  • Or use Sidero, whatever floats your boat.

Install & Bootstrap Flux

Run `kubectl apply` twice due to CRD race conditions, and applying the same manifests multiple times won't duplicate deployed resources anyway so it's probably a good idea. (TODO: add SOPS steps after deploying it)

cd .. && kubectl apply -k ./1-bootstrap/flux/flux-system && kubectl apply -k ./1-bootstrap/flux/flux-system

Hardware & Network Grid

Name OS Role CPU RAM Storage VLAN IP
thunder Proxmox Hypervisor (R730xd) 20C40T 2xE5-2660v3 64GB DDR4 + 32GB zstd zram ZFS Mirror SN550 1TB + TrueNAS ZFS HDDs HBA LAN masked
pve2 Proxmox Hypervisor (Supermicro 1) 16C32T 2xE5-2670v1 64GB DDR3 + 32GB zstd zram ZFS 1x870 Evo 1TB + ext4 1TB HDD boot LAN masked
Blackhawk Void kubectl client 8C16T Ryzen 4750U 48GB SODIMM ext4 SN520 512GB OS + ZFS 1xSN550 1TB /home LAN/JJ DHCP
OPNsense FreeBSD Firewall Router (VM) vCPU E5-2660v3 8GB VM 40GB zvol boot LAN/58 masked
Sidero Alpine Talos Manager (inactive) vCPU E5-2660v3 6GB VM 50GB zvol boot 58 172.27.27.28
cp-vip Talos Control Plane VIP - - - 58 172.27.27.27
kube-control1 Talos Control Plane & Master 1 6C vCPU E5-2660v3 4GB VM 100GB qcow2 boot 58 172.27.27.18
kube-control2 Talos Control Plane & Master 2 6C vCPU E5-2670v1 4GB VM 100GB qcow2 boot 58 172.27.27.19
kube-control3 Talos Control Plane & Master 3 6C vCPU E5-2660v3 4GB VM 100GB qcow2 boot 58 172.27.27.20
kube-worker1 Talos Worker Node 1 6C vCPU E5-2660v3 6GB VM 100GB qcow2 boot + 100GB qcow2 Ceph 58 172.27.27.21
kube-worker2 Talos Worker Node 2 6C vCPU E5-2670v2 6GB VM 100GB qcow2 boot + 100GB qcow2 Ceph 58 172.27.27.22
kube-worker3 Talos Worker Node 3 6C vCPU E5-2660v3 4GB VM (till 3rd Proxmox node) 100GB qcow2 boot + 100GB qcow2 Ceph 58 172.27.27.23