42 lines
3.5 KiB
Markdown
42 lines
3.5 KiB
Markdown
# Upstream references
|
|
|
|
Checked on 2026-09-17. Configuration is pinned to the versions in `.env.example`; upstream `latest` pages may change after this date.
|
|
|
|
## Release and image verification
|
|
|
|
- [Kafka downloads](https://kafka.apache.org/community/downloads/) — stable 4.3.1; newer release candidates were excluded.
|
|
- [Kafka official container image](https://hub.docker.com/r/apache/kafka/tags?name=4.3.1).
|
|
- [OpenSearch 3.8.0 release](https://github.com/opensearch-project/OpenSearch/releases/tag/3.8.0).
|
|
- [OpenSearch Dashboards 3.8.0 release](https://github.com/opensearch-project/OpenSearch-Dashboards/releases/tag/3.8.0).
|
|
- [Data Prepper 2.16.0 release](https://github.com/opensearch-project/data-prepper/releases/tag/2.16.0).
|
|
- [Telegraf 1.40.0 release](https://github.com/influxdata/telegraf/releases/tag/v1.40.0).
|
|
- [Prometheus 3.14.0 release](https://github.com/prometheus/prometheus/releases/tag/v3.14.0).
|
|
|
|
## Collection and wire format
|
|
|
|
- [Telegraf Debian installation and repository signing key](https://docs.influxdata.com/telegraf/v1/install/).
|
|
- [Pinned Kafka output](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/outputs/kafka/README.md).
|
|
- [Pinned Kafka output serialization implementation](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/outputs/kafka/kafka.go) — one serialized metric per message.
|
|
- [Pinned JSON serializer](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/serializers/json/README.md).
|
|
- [Pinned host input plugins](https://github.com/influxdata/telegraf/tree/v1.40.0/plugins/inputs).
|
|
- [Pinned Starlark processor](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/processors/starlark/README.md).
|
|
- [Agent buffering configuration](https://github.com/influxdata/telegraf/blob/v1.40.0/docs/CONFIGURATION.md) — disk mode is experimental.
|
|
|
|
## Processing and visualization
|
|
|
|
- [Data Prepper Kafka source](https://docs.opensearch.org/latest/data-prepper/pipelines/configuration/sources/kafka/) — plaintext parsing, TLS default and end-to-end acknowledgments.
|
|
- [Data Prepper date processor](https://docs.opensearch.org/latest/data-prepper/pipelines/configuration/processors/date/) — epoch milliseconds and origination timestamps.
|
|
- [OpenSearch sink](https://docs.opensearch.org/latest/data-prepper/pipelines/configuration/sinks/opensearch/) — bulk, retry and DLQ options.
|
|
- [Data Prepper pinned source](https://github.com/opensearch-project/data-prepper/tree/2.16.0) — Kafka source, sink configuration and UID 1000 container user inspected.
|
|
- [OpenSearch Docker installation](https://docs.opensearch.org/latest/install-and-configure/install-opensearch/docker/).
|
|
- [Index State Management](https://docs.opensearch.org/latest/im-plugin/ism/index/).
|
|
- [Dashboards saved objects](https://docs.opensearch.org/latest/dashboards/management/saved-objects/).
|
|
|
|
## Optional Metric Analytics
|
|
|
|
- [OpenSearch Metric Analytics](https://docs.opensearch.org/latest/observing-your-data/prometheusmetrics/) — Prometheus SQL connector API, OTel-specific index schema and UI workflow.
|
|
- [SQL data-source API](https://github.com/opensearch-project/sql/blob/main/docs/user/ppl/admin/datasources.md) — encryption master key and data-source registration.
|
|
- [Pinned Kafka consumer](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/inputs/kafka_consumer/README.md).
|
|
- [Pinned JSON v2 parser](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/parsers/json_v2/README.md).
|
|
- [Pinned Prometheus exporter](https://github.com/influxdata/telegraf/blob/v1.40.0/plugins/outputs/prometheus_client/README.md).
|