📖  Overview

This repo is my Kubernetes cluster in a declarative state. Flux and Helm Operator watch my clusters folder and makes the changes to my cluster based on the yaml manifests. Renovate auto updates images and helm charts based on upstream changes.

Feel free to join our Discord if you have any questions.

⚓  k8s Distro

Currently using k0s by way of k0sctl. These configurations can be viewed in provision/k0s.

🚤  Deploying the cluster

1. nix-shell --command 'k0sctl apply -f ./provision/k0s/production.yaml'
2. nix-shell --command 'k0sctl kubeconfig -c ./provision/k0s/production.yaml > ./hack/main'
3. sops -d provision/cilium/production.yaml | helm install cilium cilium/cilium -f -

Installing and bootstrapping flux

1. nix-shell --command 'k0sctl kubeconfig -c ./provision/k0s/production.yaml > ./hack/main'

2. Have flux installed (need to nixify this)

3. set GITHUB_TOKEN ghp_Qk5eLNaaaaaaaaaaaaaaaaaaaaaaaaaaa

4. To boostrap the cluster:

    flux bootstrap github \
    --components=source-controller,kustomize-controller,helm-controller,notification-controller \
    --path=clusters/env/production \
    --version=latest \
    --owner=crutonjohn \
    --repository=gitops
   

5. sops -d sops-secret.enc.yaml | kubectl apply -f -

Required node labels

1. k label nodes horus lion magnus dorn guilliman sanguinius lorgar ${FAMILY_DOMAIN}/bgp=worker
2. k label nodes lorgar ${FAMILY_DOMAIN}/role=nas
3. k label nodes dorn guilliman sanguinius ${FAMILY_DOMAIN}/rook=distributed

💻  Hardware Configuration

All my nodes below are running bare metal Ubuntu or Debian

💻  Supporting Infrastructure

• Opnsense DEC2750 Router
• TP-Link TL-SG3428XMP Core Switch
• TP-Link TL-SG3428XMP Upstairs Distribution Switch
• TP-Link SX3008F 10Gig Distribution Switch
• x2 TP-Link EAP660 HD WAPs
• TP-Link EAP615-Wall Still trying to work out where this will physically go

📝  IP addresses

Can generally be viewed at settings.yaml

🤝  Community

A lot of inspiration for my cluster came from the people that have shared their cluster configuration with me. Thanks to all the people who donate their time to the Home Operations community. Join us on Discord!