Core Resilience Patterns

Core Resilience Patterns An architecture diagram generated by Archify. Client Request · Architecture component Client Request Outlier Detection · Unhealthy instance ejection · Istio Resilience Patterns Outlier Detection Unhealthy instance ejection Rate Limiting · Request rate limiting · Istio Resilience Patterns Rate Limiting Request rate limiting Zone Aware Routing · Locality-first routing · Istio Resilience Patterns Zone Aware Routing Locality-first routing Pod 3 · Errors occurring · Unhealthy pod Pod 3 Errors occurring Pod 1 · Zone A · Healthy pods Pod 1 Zone A Pod 2 · Zone B · Healthy pods Pod 2 Zone B eject prefer failover Istio Resilience Patterns Unhealthy pod Healthy pods Legend Backend External

Outlier Detection

  • • Consecutive error detection (consecutiveErrors)
  • • Automatic ejection and recovery (baseEjectionTime)
  • • Works with Circuit Breaker

Rate Limiting

  • • Token Bucket algorithm
  • • Local and global rate limiting
  • • Per-client and per-path limits

Zone Aware Routing

  • • Prioritize same-AZ traffic (localityLbSetting)
  • • Reduce cross-AZ costs
  • • Automatic failover on failure