Kubeflow Spark Operator 실행 흐름

Kubeflow Spark Operator 실행 흐름 A workflow diagram generated by Archify. 01 / 사용자 02 / Kubeflow Controller 03 / Kubernetes Admission 04 / Spark Pods on Kubernetes kubectl apply · SparkApplication CR · 사용자 kubectl apply SparkApplication CR Controller 제출 · spark-submit · Kubeflow Controller · 컨트롤 루프 Controller 제출 spark-submit 컨트롤 루프 Pod 상태 관찰 · driver + executor → CR · Kubeflow Controller Pod 상태 관찰 driver + executor → CR Kubernetes admission · Kubeflow Pod mutator · Kubernetes Admission Kubernetes admission Kubeflow Pod mutator Driver Pod 실행 · Kubernetes 배치 · Spark Pods on Kubernetes Driver Pod 실행 Kubernetes 배치 Executor 요청 · driver → Kubernetes API · Spark Pods on Kubernetes Executor 요청 driver → Kubernetes API Spark task 실행 · driver가 작업 할당 · Spark Pods on Kubernetes Spark task 실행 driver가 작업 할당 CR 생성 admission + placement Pod watch reconcile / retry Legend 사용자 제출 Spark Operator Mutating Webhook CR .status 기록 Spark Pod