Scheduling Optimization in Amazon EKS

Scheduling Optimization in Amazon EKS An architecture diagram generated by Archify. Node Groups · Instance Types · Compute/memory optimized · Spot · GPU · EKS scheduling optimization levers Node Groups · Instance Types Compute/memory optimized · Spot · GPU Availability Zone Distribution · Pod Anti-Affinity · Topology Spread · EKS scheduling optimization levers Availability Zone Distribution Pod Anti-Affinity · Topology Spread Karpenter Auto Scaling · Provisions nodes fitted to the workload · EKS scheduling optimization levers Karpenter Auto Scaling Provisions nodes fitted to the workload Request · Limit Optimization · Tune requests / limits · EKS scheduling optimization levers Request · Limit Optimization Tune requests / limits Cluster Autoscaler · Resizes node groups · Implementing mechanisms · automation tools Cluster Autoscaler Resizes node groups Multi-AZ Deployment · Spread across topology.kubernetes.io/zone · Implementing mechanisms · automation tools Multi-AZ Deployment Spread across topology.kubernetes.io/zone NodePool · karpenter.sh/v1 · EC2NodeClass · Implementing mechanisms · automation tools NodePool karpenter.sh/v1 · EC2NodeClass Vertical Pod Autoscaler · Goldilocks · ResourceQuota · Implementing mechanisms · automation tools Vertical Pod Autoscaler Goldilocks · ResourceQuota tool result uses tool EKS scheduling optimization levers Implementing mechanisms · automation tools Legend Backend Cloud