Skip to main content

Command Palette

Search for a command to run...

🏗️ Part 3: Demystifying Kubernetes Architecture — How Everything Works Together

Updated
3 min read
🏗️ Part 3: Demystifying Kubernetes Architecture — How Everything Works Together

In Part 2, we explored the core building blocks of Kubernetes — Pods, Deployments, Services, StatefulSets, ConfigMaps, Secrets, and Volumes.

Now, it’s time to take a step back and see the big picture: how these components connect within the Kubernetes architecture to make clusters resilient, scalable, and self-healing.


🌐 Kubernetes Architecture Overview

At a high level, a Kubernetes cluster is divided into two main layers:

  1. Control Plane (Master Node) — the brain of the cluster

  2. Worker Nodes — where applications actually run

Everything you deploy interacts with these layers in one way or another.


🧠 1. Control Plane Components

The Control Plane manages the state of the cluster and ensures your desired state (what you define in YAML) matches the actual state.

a) API Server

  • The entry point for all administrative commands (kubectl apply, kubectl get pods, etc.)

  • Exposes the Kubernetes API and validates requests

  • Acts as the central hub — every other control plane component talks to it

b) etcd

  • A key-value store that keeps the cluster state

  • Stores configurations, secrets, Pod specs, Service definitions

  • If the API server crashes, etcd ensures your cluster’s state is preserved

c) Scheduler

  • Determines which nodes should run new Pods

  • Looks at resource requirements, node availability, and constraints

d) Controller Manager

  • Runs control loops to maintain cluster state automatically

  • Examples:

    • Deployment Controller ensures the desired number of Pods are running

    • Replication Controller replaces failed Pods

    • StatefulSet Controller ensures database Pods maintain order and identity


🖥️ 2. Worker Nodes

Worker nodes run your actual applications (Pods). Each node has several components:

a) Kubelet

  • Agent running on every node

  • Ensures containers in Pods are running as defined in the Deployment/StatefulSet

b) Kube-Proxy

  • Handles networking and routing inside the cluster

  • Ensures Services route traffic correctly to Pods

c) Container Runtime

  • Runs the containers (Docker, containerd, CRI-O, etc.)

  • Converts your Deployment/Pod specs into real running containers


🔗 Connecting Control Plane and Worker Nodes

  1. You define a Deployment YAML → submitted to the API Server

  2. The Scheduler picks a node to run the Pods

  3. Kubelet on that node starts the container(s)

  4. Controller Manager monitors replicas, replacing Pods if they fail

  5. Kube-Proxy ensures traffic to Services reaches the correct Pod

  6. etcd stores the current state so the cluster remembers everything

Everything is self-healing — if a Pod dies, a new one spins up automatically, Services keep routing traffic correctly, and StatefulSets maintain order for databases.


⚡ Observability & Logging

To manage large clusters, you also need monitoring and logging:

  • Prometheus: metrics collection (CPU, memory, custom app metrics)

  • Grafana: dashboards for visualization

  • ELK Stack / Fluentd: logs aggregation and troubleshooting

These tools integrate with the control plane and worker nodes to provide full visibility.


🧩 How Everything Ties Together

User / kubectl → API Server → Scheduler & Controller Manager → Worker Nodes → Kubelet → Pods/Containers
                                        ↓
                                      etcd

Add Services, Ingress, StatefulSets, ConfigMaps/Secrets/Volumes, and monitoring tools — and you have a resilient, scalable, production-ready cluster.


🧭 What’s Next

Understanding architecture lets you:

  • Debug cluster issues faster

  • Optimize resource usage

  • Design scalable and secure applications

In Part 4, we’ll dive into advanced Kubernetes networking, Services, and Ingress controllers, so you’ll understand how traffic flows inside and outside the cluster.


💬 Follow me to complete the Kubernetes series and master the entire stack.

#Kubernetes #DevOps #CloudNative #CKA #Containers #LearningPath #K8sArchitecture

More from this blog

D

DevOpswithAsma

11 posts