Rate Limiting Overview

Rate Limiting Overview An architecture diagram generated by Archify. Client 1 · 100 req/s · Architecture component Client 1 100 req/s Client 2 · 50 req/s · Architecture component Client 2 50 req/s Client 3 · 200 req/s · Architecture component Client 3 200 req/s Token Bucket · 100 req/s limit · Rate Limiter Token Bucket 100 req/s limit Pod 1 · Capacity 50 req/s · Service Pod 1 Capacity 50 req/s Pod 2 · Capacity 50 req/s · Service Pod 2 Capacity 50 req/s 429 Too Many Requests · Excess requests rejected · Architecture component 429 Too Many Requests Excess requests rejected 100 req/s 50 req/s 200 req/s Allowed Allowed 250 req/s blocked Rate Limiter Service Legend Client Service Pod Rate Limiter Rejected response