Ray library와 Kubernetes 운영 계층

Ray library와 Kubernetes 운영 계층 An architecture diagram generated by Archify. Application code · Train / Tune / Serve / Core · Architecture component Application code Train / Tune / Serve / Core Ray runtime · tasks / actors / ObjectRefs · Architecture component Ray runtime tasks / actors / ObjectRefs Ray Pods on Kubernetes · head / workers · Architecture component Ray Pods on Kubernetes head / workers KubeRay operator · RayCluster / RayJob / RayService · Architecture component KubeRay operator RayCluster / RayJob / RayService library / Core APIs runs inside reconcile resources Legend Backend Cloud External

Application

  • • 사용자가 library·작업·checkpoint 정책을 선택
  • • 공통 Core 위에서도 framework별 통신·controller가 존재

Infrastructure

  • • KubeRay가 ML library를 자동 분류하는 dispatcher는 아님
  • • Ray scheduling · Pod placement · EC2 공급은 별도 계층