Log Collector Role

Log Collector Role An architecture diagram generated by Archify. Container stdout · container standard output · Log Sources Container stdout container standard output Log Files · log files on disk · Log Sources Log Files log files on disk Systemd Journal · systemd journal · Log Sources Systemd Journal systemd journal Input / Source · collect logs · Log Collector Input / Source collect logs Processing / Transform · parse · filter · transform · Log Collector Processing / Transform parse · filter · transform Output / Sink · send to destinations · Log Collector Output / Sink send to destinations Loki · log store · Destinations Loki log store OpenSearch · search · analytics · Destinations OpenSearch search · analytics CloudWatch · AWS logs · Destinations CloudWatch AWS logs S3 · long-term archive · Destinations S3 long-term archive Log Sources Log Collector Destinations Legend Backend Database Cloud External

Core Functions

  • • Input: read logs from various sources
  • • Parsing · Filtering · Transform: structure logs, drop unnecessary logs, add/modify/delete fields
  • • Buffering: temporary storage for reliability
  • • Output: send logs to destinations