Ray 규모 · Pod 조정 · EC2 공급

Ray 규모 · Pod 조정 · EC2 공급 An architecture diagram generated by Archify. RayCluster CR · desired worker groups · Architecture component RayCluster CR desired worker groups Ray head Pod · autoscaler sidecar if enabled · Architecture component Ray head Pod autoscaler sidecar if enabled KubeRay operator · reconcile Pods / Services · Architecture component KubeRay operator reconcile Pods / Services Ray worker Pods · CPU / GPU / multi-host groups · Architecture component Ray worker Pods CPU / GPU / multi-host groups Unschedulable Pods · capacity / placement demand · Architecture component Unschedulable Pods capacity / placement demand Karpenter / CA · node provisioning layer · Architecture component Karpenter / CA node provisioning layer EC2 nodes · actual capacity · Architecture component EC2 nodes actual capacity Kubernetes scheduler · Pod placement · Architecture component Kubernetes scheduler Pod placement desired workers watch spec create / reconcile Ray demand no fitting node capacity demand provision nodes capacity place Pods Legend Backend Database Cloud

계층별 책임

  • • Ray autoscaler가 Karpenter에 직접 Pod를 보내지 않음
  • • KubeRay가 Pod를 조정하고 Kubernetes가 node에 배치

조건과 한계

  • • Pending의 원인 확인: image/PVC/권한 문제는 증설만으로 해결되지 않음
  • • group replica와 Pod 수는 numOfHosts에 따라 다를 수 있음