WanderLust is a simple MERN travel blog website ✈ This project is aimed to help people to contribute in open source, upskill in react and also master git.

• GitHub (Code)
• Docker (Containerization)
• Jenkins (CI)
• OWASP (Dependency check)
• SonarQube (Quality)
• Trivy (Filesystem Scan)
• ArgoCD (CD)
• Redis (Caching)
• AWS EKS (Kubernetes)
• Helm (Monitoring using grafana and prometheus)

• CI pipeline to build and push

• CD pipeline to update application version

• ArgoCD application for deployment on EKS

• Create 1 Master machine on AWS with 2CPU, 8GB of RAM (t2.large) and 29 GB of storage and install Docker on it.

• Open the below ports in security group of master machine and also attach same security group to Jenkins worker node (We will create worker node shortly)

Install & Configure Docker by using below command, "NewGrp docker" will refresh the group config hence no need to restart the EC2 machine.

sudo apt-get update

sudo apt-get install docker.io -y
sudo usermod -aG docker ubuntu && newgrp docker

• Install and configure Jenkins (Master machine)

sudo apt update -y
sudo apt install fontconfig openjdk-17-jre -y

sudo wget -O /usr/share/keyrings/jenkins-keyring.asc \
  https://pkg.jenkins.io/debian-stable/jenkins.io-2023.key
  
echo "deb [signed-by=/usr/share/keyrings/jenkins-keyring.asc]" \
  https://pkg.jenkins.io/debian-stable binary/ | sudo tee \
  /etc/apt/sources.list.d/jenkins.list > /dev/null
  
sudo apt-get update -y
sudo apt-get install jenkins -y

• Now, access Jenkins Master on the browser on port 8080 and configure it.

• Create EKS Cluster on AWS (Master machine)

  • IAM user with access keys and secret access keys
  • AWSCLI should be configured (Setup AWSCLI)

  curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
  sudo apt install unzip
  unzip awscliv2.zip
  sudo ./aws/install
  aws configure

  • Install kubectl (Master machine)(Setup kubectl )

  curl -o kubectl https://amazon-eks.s3.us-west-2.amazonaws.com/1.19.6/2021-01-05/bin/linux/amd64/kubectl
  chmod +x ./kubectl
  sudo mv ./kubectl /usr/local/bin
  kubectl version --short --client

  • Install eksctl (Master machine) (Setup eksctl)

  curl --silent --location "https://github.com/weaveworks/eksctl/releases/latest/download/eksctl_$(uname -s)_amd64.tar.gz" | tar xz -C /tmp
  sudo mv /tmp/eksctl /usr/local/bin
  eksctl version

  • Create EKS Cluster (Master machine)

  eksctl create cluster --name=wanderlust \
                      --region=us-east-1 \
                      --version=1.30 \
                      --without-nodegroup

  • Associate IAM OIDC Provider (Master machine)

  eksctl utils associate-iam-oidc-provider \
    --region us-east-1 \
    --cluster wanderlust \
    --approve

  • Create Nodegroup (Master machine)

  eksctl create nodegroup --cluster=wanderlust \
                       --region=us-east-1 \
                       --name=wanderlust \
                       --node-type=t2.large \
                       --nodes=2 \
                       --nodes-min=2 \
                       --nodes-max=2 \
                       --node-volume-size=29 \
                       --ssh-access \
                       --ssh-public-key=eks-nodegroup-key 

• Setting up jenkins worker node

  • Create a new EC2 instance (Jenkins Worker) with 2CPU, 8GB of RAM (t2.large) and 29 GB of storage and install java on it

  sudo apt update -y
  sudo apt install fontconfig openjdk-17-jre -y

  • Configure AWSCLI (Setup AWSCLI)

  sudo su

  curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
  sudo apt install unzip
  unzip awscliv2.zip
  sudo ./aws/install
  aws configure

• generate ssh keys (Master machine) to setup jenkins master-slave

ssh-keygen

• Now move to directory where your ssh keys are generated and copy the content of public key and paste to authorized_keys file of the Jenkins worker node.

• Now, go to the jenkins master and navigate to Manage jenkins --> Nodes, and click on Add node
  • name: Node
  • type: permanent agent
  • Number of executors: 2
  • Remote root directory
  • Labels: Node
  • Usage: Only build jobs with label expressions matching this node
  • Launch method: Via ssh
  • Host: <public-ip-worker-jenkins>
  • Credentials: Add --> Kind: ssh username with private key --> ID: Worker --> Description: Worker --> Username: root --> Private key: Enter directly --> Add Private key
  • Host Key Verification Strategy: Non verifying Verification Strategy
  • Availability: Keep this agent online as much as possible

• And your jenkins worker node is added

• Install and configure SonarQube (Master machine)

docker run -itd --name SonarQube-Server -p 9000:9000 sonarqube:lts-community

• Install Trivy (Jenkins Worker)

sudo apt-get install wget apt-transport-https gnupg lsb-release -y
wget -qO - https://aquasecurity.github.io/trivy-repo/deb/public.key | sudo apt-key add -
echo deb https://aquasecurity.github.io/trivy-repo/deb $(lsb_release -sc) main | sudo tee -a /etc/apt/sources.list.d/trivy.list
sudo apt-get update -y
sudo apt-get install trivy -y

• Install and Configure ArgoCD (Master Machine)

  • Create argocd namespace

  kubectl create namespace argocd

  • Apply argocd manifest

  kubectl apply -n argocd -f https://raw.githubusercontent.com/argoproj/argo-cd/stable/manifests/install.yaml

  • Make sure all pods are running in argocd namespace

  watch kubectl get pods -n argocd

  • Install argocd CLI

  sudo curl --silent --location -o /usr/local/bin/argocd https://github.com/argoproj/argo-cd/releases/download/v2.4.7/argocd-linux-amd64

  • Provide executable permission

  sudo chmod +x /usr/local/bin/argocd

  • Check argocd services

  kubectl get svc -n argocd

  • Change argocd server's service from ClusterIP to NodePort

  kubectl patch svc argocd-server -n argocd -p '{"spec": {"type": "NodePort"}}'

  • Confirm service is patched or not

  kubectl get svc -n argocd

  • Check the port where ArgoCD server is running and expose it on security groups of a worker node
  • Access it on browser, click on advance and proceed with

  <public-ip-worker>:<port>

  

  • Fetch the initial password of argocd server

  kubectl -n argocd get secret argocd-initial-admin-secret -o jsonpath="{.data.password}" | base64 -d; echo

  • Username: admin
  • Now, go to User Info and update your argocd password

chmod 777 /var/run/docker.sock

argocd cluster list

kubectl config get-contexts

argocd cluster add Wanderlust@wanderlust.us-west-1.eksctl.io --name wanderlust-eks-cluster

<worker-public-ip>:31000

curl -fsSL -o get_helm.sh https://raw.githubusercontent.com/helm/helm/main/scripts/get-helm-3

chmod 700 get_helm.sh

./get_helm.sh

helm repo add stable https://charts.helm.sh/stable

helm repo add prometheus-community https://prometheus-community.github.io/helm-charts

kubectl create namespace prometheus

kubectl get ns

helm install stable prometheus-community/kube-prometheus-stack -n prometheus

kubectl get pods -n prometheus

kubectl get svc -n prometheus

kubectl edit svc stable-kube-prometheus-sta-prometheus -n prometheus

kubectl get svc -n prometheus

kubectl edit svc stable-grafana -n prometheus

kubectl get svc -n prometheus

kubectl get secret --namespace prometheus stable-grafana -o jsonpath="{.data.admin-password}" | base64 --decode ; echo

eksctl delete cluster --name=wanderlust --region=us-west-1