How to Optimize and scale Kubernetes clusters for performance and reliability

https://overcast.blog/13-ways-to-optimize-kubernetes-performance-in-2024-73d518e7e1f4 1. Fine-Tune Resource Requests and Limits 2. Implement Cluster Autoscaling 3. Leverage Node Affinity and Anti-Affinity 4. Optimize Pod Networking 5. Use Service Meshes Intelligently 6. Efficient Logging and Monitoring 7. Optimize Persistent Storage Usage 8. Implement Workload-Specific Garbage Collection Tuning 9. Optimize Image Sizes and Registry Performance 10. Adopt GitOps for Configuration Management 11. Continuous Performance Benchmarking 12. Utilize Advanced Scheduling Techniques 13. Leverage Kernel Tuning and Optimization https://www.aquasec.com/cloud-native-academy/kubernetes-in-production/kubernetes-security-best-practices-10-steps-to-securing-k8s/#:~:text=4.-,Isolate%20Kubernetes%20Nodes,and%20data%20traffic%20are%20isolated.

5 9s (99.999%) or higher scenario with a recovery time under one minute

 https://docs.aws.amazon.com/wellarchitected/latest/reliability-pillar/s-99.999-or-higher-scenario-with-a-recovery-time-under-1-minute.html

GCP Overview

Refernces:

 https://cloud.google.com/kubernetes-engine/docs/

https://cloud.google.com/free/

https://cloud.google.com/architecture/best-practices-for-running-cost-effective-kubernetes-applications-on-gke?hl=en

Technologies and Tools -Devops

 Technologies and Tools 

• Cloud platform - AWS
• SDLC Methodologies: Agile /Scrum
• Version Control Tools – GitHub/ Bitbucket/GitLab
• CI/CD Automation Tools – Jenkins/ CloudBees CI, CD / Bamboo/ Octopus /Team City/ AWS DevOps / Harness
• Container Management Tools – Docker/Kubernetes/Docker Swarm
• Application Performance Management Tools – Prometheus/ Dynatrace/ AppDynamics
• Monitoring Tools – ELK/Splunk/ Datadog/ Grafana
• IAC Tools – Terraform/ Cloud Formation 
• Config Management Tools – Chef/ Puppet/ Ansible
• Artifact Management Tools – Jfrog Artifactory/Nexus/CloudRepo
• Scripting - Python/Groovy/PowerShell/Shell Scripting
• SAST/ DAST: SonarQube / Veracode/ Fortify
• GitOps Tool – Argo CD/ Flux CD

platform.linkedin.com/badge

 <script src="https://platform.linkedin.com/badges/js/profile.js" async defer type="text/javascript"></script>

<div class="badge-base LI-profile-badge" data-locale="en_US" data-size="medium" data-theme="dark" data-type="VERTICAL" data-vanity="amitanand123" data-version="v1"><a class="badge-base__link LI-simple-link" href="https://in.linkedin.com/in/amitanand123?trk=profile-badge">Amit Anand</a></div>

              

kubernetes Commands

•     4  kubectl get replicaset
•     5  kubectl describe replicaset
•     7  kubectl get pods
•     8  kubectl delete new-replica-set-fx2tw
•     9  kubectl delete pods new-replica-set-fx2tw
•    10  kubectl get pods
•    11  kubectl describe replicaset
•    12  kubectl create replicaset replicaset-definition-1.yaml 
•    13  kubectl api-resources | grep replicaset
•    14  kubectl explain replicaset | grep VERSION
•    15  kubectl create -f /root/replicaset-definition-1.yaml
• 1 kubectl get pods
•   42 .\minikube.exe get pods
•   43 .\minikube.exe get pods
•   44 ./minikube dashboard
•   45 .\minikube.exe start
•   46 .\minikube.exe start
•   47 ./minikube dashboard
• 
  

Exam Details

https://www.youtube.com/watch?v=dHXgg9fbP8E

https://www.youtube.com/watch?v=1hF-HRq5Mww

Also check out, my other videos: CKA Exam Questions -    • REAL CKA Exam Questions to Practice a...   What is Kubernetes and How it works?    • Kubernetes Explained - What is Kubern...   Prerequisites to Learn Kubernetes: How I would learn DevOps from scratch    • How I would Learn DevOps from scratch...   DevOps Roadmap 2024:    • DevOps ROADMAP 2024: How to learn and...   How I passed my Terraform Associate Exam:    • How I passed my Hashicorp Certified T...   How I Passed my AWS SAA Exam:    • How I Passed AWS Solutions Architect ...   Top DevOps Certifications for 2024:    • Top 3 DevOps Certification in 2024 ♾️...   All about AWS CCP Certification:    • Everything you need to know about AWS...   DevSecOps Project to deploy Netflix :    • DevSecOps Pipeline Project: Deploy Ne...   DevOps Interview Questions and Answers:    • DevOps Interview Questions and Answer...   GitOps Explained with Examples:    • What is GitOps | GitOps explained wit...   Monitoring explained with popular tools:    • Popular DevOps Monitoring Tools in 2024   CICD explained with a project:    • What is CICD Pipeline? CICD process e...   How much Programming is required in DevOps :    • Is CODING required for Devops? How mu...   How I use Python as DevOps engineer:    • How I use Python as DevOps Engineer |...   How to use ChatGPT as a DevOps Engineer:    • 5 EFFECTIVE ways to use ChatGPT as a ...   CICD Pipeline explained:    • What is CICD Pipeline? CICD process e...   Terraform Tutorial :    • Master Terraform in 60 minutes | Terr...   Terraform Project on AWS:    • Simple DevOps Project to Practice Ter...   How I make money as Devops Freelancer:    • How I make money remotely as Freelanc...   Most used AWS services for DevOps Engineer:    • Important AWS services for DevOps you...  

https://github.com/killercoda/scenario-examples

Kubernetes – Cluster IP vs Node-Port

1. ClusterIP service: A ClusterIP service is an internal IP address that is allocated by Kubernetes and can only be accessed within the cluster. It's useful for communication between pods in the same cluster.

2. NodePort service: A NodePort service assigns a fixed port on each node in the cluster, allowing external clients to access the service from outside the cluster using the cluster's IP address and the assigned port number

Gitlab Security update

 [Slides] Intro to Security & Compliance Tech Demo - APAC (gitlab.com)

GitLab 2023 Global DevSecOps Report: Security Without Sacrifices

Minikube setup-Dashboard

 http://127.0.0.1:51298/

Dashboard | minikube (k8s.io)

https://minikube.sigs.k8s.io/docs/handbook/dashboard/

 Id CommandLine

  -- -----------

•    1 minikube
•    2 minikube addons list
•    4 minikube config view
•    5 cd C:\minikube\
•    6 dir
•    7 .\minikube.exe config view
•    8 minikube config view
•    9 minikube start --container-runtime=docker
•   12 kubectl get pod --output=wide
• kubectl expose deployment hello-minikube --type=NodePort --port=8080
•     kubectl get pod --output=wide
•    kubectl get services hello-minikube
•    minikube service hello-minikube
•    ./minikube dashboard
•  kubectl create deployment hello-minikube --image=kicbase/echo-server:1.0

 docker ps

Knowledge articles-Hystax

 Hystax OptScale

Resource Assignment - Welcome to OptScale documentation! (hystax.com)

Hystax OptScale

ACA- Exam details

 Atlassian Certified Associate - Jira Software Essentials Exam Details : Atlassian

Atlassian Certified Associate - Jira Software Board Configuration : Atlassian

Kubernetes --Plateform

 "Kubernetes Config Syncer (previously kubed)" is a tool that enables users to synchronize secrets and other data across multiple Kubernetes namespaces. It was previously known as "kubed," but was renamed to Config Syncer in 2022. Config Syncer uses Ansible and Kubernetes Secrets to synchronize and update the data as necessary, making it easier to manage the configuration and data within a cluster.

It is part of the Config Syncer project on GitHub, which involves the creation of Kubernetes Resources such as ConfigMaps and Services. Config Syncer can be installed using Kubeadm, and can be used in conjunction with other tools and frameworks to automate the configuration and management of Kubernetes clusters.

Amazon EKS (Elastic Kubernetes Service): Complete Workflow (k21academy.com)

Kubernetes on AWS: Create EKS Step By Step for Beginners (youtube.com)

Synchronize Configuration across Namespaces (config-syncer.com)

Synchronize Configuration across Kubernetes Clusters (config-syncer.com)

CATS vs DOGS + FLASK + DOCKER + KUBERNETES | by Rietesh Amminabhavi | Medium

Container Runtimes | Kubernetes

Kubeadm | Kubernetes

Kubeadm vs. Kops

We briefly touched on the differences between the tools earlier. But more specifically these are the differences between the two tools:

• Kubeadm is in the middle of the stack and it runs on each node, and basically creates and then talks to the Kubernetes API.
• Kops on the other hand is responsible for the entire lifecycle of the cluster, from infrastructure provisioning to upgrading to deleting, and it knows about everything: nodes, masters, load balancers, cloud providers, monitoring, networking, logging etc.
• Kops and Kubeadm w/ Chris Love & Lucas Käldström (youtube.com)

• kubeadm init to bootstrap a Kubernetes control-plane node
• kubeadm join to bootstrap a Kubernetes worker node and join it to the cluster
• kubeadm upgrade to upgrade a Kubernetes cluster to a newer version
• kubeadm config if you initialized your cluster using kubeadm v1.7.x or lower, to configure your cluster for kubeadm upgrade
• kubeadm token to manage tokens for kubeadm join
• kubeadm reset to revert any changes made to this host by kubeadm init or kubeadm join
• kubeadm certs to manage Kubernetes certificates
• kubeadm kubeconfig to manage kubeconfig files
• kubeadm version to print the kubeadm version
• kubeadm alpha to preview a set of features made available for gathering feedback from the community

How to Create AWS EC2 Instance Using Terraform-https://spacelift.io/blog/terraform-ec2-instance

What Are Objects Used for in Kubernetes? 11 Types Explained (kodekloud.com)

1. Kubernetes objects:

   1. Pods: The smallest deployable units in Kubernetes. Pods encapsulate one or more containers and share the same network and storage context.

   2. Namespaces: Used to create virtual clusters within a physical cluster. Namespaces allow you to organize and isolate resources.

   3. ReplicaSets: Ensures a specified number of replicas (identical copies) of a pod are running at all times. Useful for scaling and fault tolerance.

   4. Deployment: Manages the deployment and scaling of applications. It allows you to declaratively define the desired state of your application.

   5. StatefulSets: Used for stateful applications (e.g., databases). Ensures stable network identities and ordered scaling.

   6. DaemonSets: Ensures that a specific pod runs on all nodes in the cluster. Useful for tasks like monitoring or logging.

   7. Services: Provides a stable endpoint for accessing pods. Load balancers, NodePort services, and ClusterIP services fall under this category.

   8. ConfigMaps: Store configuration data separately from the application code. Useful for managing environment variables, secrets, and other configuration settings.

   9. Secrets: Securely store sensitive information (e.g., passwords, API keys) as base64-encoded data.

   10. PersistentVolumes: Abstracts storage resources and provides a way to mount storage volumes into pods.

   11. Jobs: Runs a task to completion (e.g., batch processing, backups). Once the task is done, the job terminates.

   
   

After an interview, taking the time to reflect on how it went is a crucial step in the post-interview process. Here are some points to consider during your reflection:

1. Overall performance: Reflect on how you think you performed during the interview. Consider your level of confidence, how well you answered the questions, and whether you effectively conveyed your skills and qualifications. Assess whether you effectively communicated why you are the right fit for the position.

2. Communication skills: Think about how well you articulated your thoughts and ideas during the interview. Consider whether you were able to express yourself clearly and concisely. Reflect on your ability to actively listen and respond to the interviewer's questions or statements.

3. Preparation: Evaluate how well you prepared for the interview. Did you research the company and the role thoroughly? Were you able to connect your experiences and skills to the specific requirements of the job? Assess whether you had a good understanding of the company culture and values and if you were able to demonstrate that during the interview.

4. Problem-solving: Consider how you handled any challenging questions or situations during the interview. Reflect on whether you provided well-thought-out solutions or examples when asked to discuss specific scenarios or problems. Assess your ability to think on your feet and adapt to unexpected questions or challenges.

5. Body language and demeanor: Think about how you presented yourself during the interview. Reflect on your body language, such as maintaining good eye contact, sitting upright, and displaying attentive gestures. Consider your level of enthusiasm and engagement throughout the conversation.

6. Follow-up: Assess whether you effectively closed the interview by expressing your interest in the position and asking thoughtful questions

Installing kubeadm

https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/install-kubeadm/

Our hands-on labs will be sufficient for you to practice.

Some links used in the upcoming demo may have changed. Please find the latest links to the documentation topics below:

Install MiniKube: https://kubernetes.io/docs/tasks/tools/install-minikube/

VirtualBox: https://www.virtualbox.org/wiki/Downloads

MiniKube Download page for  Windows: https://github.com/kubernetes/minikube/releases

While using Minikube with  Virtualization technologies, specify the --vm-driver option like this:

minikube start --vm-driver=<driver_name>

More about it here: https://kubernetes.io/docs/setup/learning-environment/minikube/#specifying-the-vm-driver

References

Install and set up the kubectl tool: -

https://kubernetes.io/docs/tasks/tools/

Install Minikube: -

https://minikube.sigs.k8s.io/docs/start/

Install VirtualBox: -

https://www.virtualbox.org/wiki/Downloads

https://www.virtualbox.org/wiki/Linux_Downloads

Minikube Tutorial: -

https://kubernetes.io/docs/tutorials/hello-minikube/

If the minikube installation has been done on the macOS, then to access the URL on the local browser, we need to do a few steps to get the service URL to work. Those steps are covered on this documentation page: -

https://minikube.sigs.k8s.io/docs/handbook/accessing/#using-minikube-service-with-tunnel

Kubernetes Update and Project Videos - Your Essential Guide

Uncover additional insights through the videos listed below:

Kubernetes Update Videos

1. Kubernetes v1.27 Update

• Kubernetes Update 1.27: Chill Vibes Edition - Exploring the Latest Enhancements

2. Kubernetes v1.28 Update

• Kubernetes Update 1.28: Planternetes Edition - Exploring the Latest Enhancements

3. Kubernetes v1.29 Update

• Exploring Kubernetes 1.29 Updates - Mandala Universe