3.5 KiB
3.5 KiB
Upstream references
Checked on 2026-09-17. Configuration is pinned to the versions in .env.example; upstream latest pages may change after this date.
Release and image verification
- Kafka downloads — stable 4.3.1; newer release candidates were excluded.
- Kafka official container image.
- OpenSearch 3.8.0 release.
- OpenSearch Dashboards 3.8.0 release.
- Data Prepper 2.16.0 release.
- Telegraf 1.40.0 release.
- Prometheus 3.14.0 release.
Collection and wire format
- Telegraf Debian installation and repository signing key.
- Pinned Kafka output.
- Pinned Kafka output serialization implementation — one serialized metric per message.
- Pinned JSON serializer.
- Pinned host input plugins.
- Pinned Starlark processor.
- Agent buffering configuration — disk mode is experimental.
Processing and visualization
- Data Prepper Kafka source — plaintext parsing, TLS default and end-to-end acknowledgments.
- Data Prepper date processor — epoch milliseconds and origination timestamps.
- OpenSearch sink — bulk, retry and DLQ options.
- Data Prepper pinned source — Kafka source, sink configuration and UID 1000 container user inspected.
- OpenSearch Docker installation.
- Index State Management.
- Dashboards saved objects.
Optional Metric Analytics
- OpenSearch Metric Analytics — Prometheus SQL connector API, OTel-specific index schema and UI workflow.
- SQL data-source API — encryption master key and data-source registration.
- Pinned Kafka consumer.
- Pinned JSON v2 parser.
- Pinned Prometheus exporter.