An ingestion API is a gateway that accepts observability data, validates and formats it, then routes it into the appropriate storage backend. Dedicated pipelines handle metrics, logs, and traces so each data type is processed correctly. section 5.1.4
A practical ingestion architecture:
- Receives data from cloud services, applications, infrastructure components, and monitoring services through observability system API endpoints. section 5.1.4
- Processes metrics, logs, and traces through separate ingestion pipelines suited to aggregation, parsing, indexing, and correlation. section 5.1.4
- Supports periodic polling and scrubbing when security restrictions or network configuration prevent direct transmission. section 5.1.4
Protected data source
A source behind a firewall can be polled periodically and scrubbed before its observability data enters the ingestion pipeline, preserving collection in a secure environment. section 5.1.4
