Global Rate Limiting Architecture

Global Rate Limiting Architecture An architecture diagram generated by Archify. Client 1 · Clients Client 1 Client 2 · Clients Client 2 Client 3 · Clients Client 3 Ingress Gateway · Envoy Proxy · Istio Gateway Ingress Gateway Envoy Proxy Rate Limit Server · envoyproxy/ratelimit · Rate Limit Service Rate Limit Server envoyproxy/ratelimit In-Memory Cache · Rate Limit Service In-Memory Cache Service A · Backend Services Service A Service B · Backend Services Service B Request 1. Check rate limit (gRPC) 2. Allow/deny response Cache lookup/update 3. Forward only allowed requests Clients Istio Gateway Rate Limit Service Backend Services Legend Service / Server Cache Ingress Gateway Clients