opensearch-project / data-prepper

Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.

https://opensearch.org/docs/latest/clients/data-prepper/index/

opensearch-project/data-prepper Issues

ERROR org.opensearch.dataprepper.GrpcRequestExceptionHandler in dataprepper version 2.7.0
Updated a day ago2
CVE-2024-34069 (High) detected in Werkzeug-2.2.3-py3-none-any.whl
Updated a day ago
Allow trace group for partial traces
Updated a day ago
Add option to shut down and fail data prepper when any sub-pipelines are invalid
Updated a day ago1
Support Full load and CDC from AWS DocumentDB
Closed a day ago
DocumentDb Mapping (for initial release)
Closed a day ago
Export BSON Decimal as BigDecimal from DocumentDb source
Closed a day ago
[BUG] Index prefix parsing bug in OpenSearch sink
Updated 2 days ago
Include BSON type information in the Event metadata to allow for conversions
Closed 2 days ago1
Create a doc_id field for data exported from the DocumentDb source
Closed 2 days ago1
Support DocumentDb types: Null, Undefined, MinKey, MaxKey
Closed 2 days ago1
DocumentDb simple representations of BSON types
Closed 2 days ago1
Support conditional expression to evaluate based on the data type for a given field
Closed 2 days ago2
[BUG]Incorrect Behavior of Obfuscate Processor with Predefined Pattern "%{CREDIT_CARD_NUMBER}"
Closed 2 days ago5
Enhance Key Value Processor
Closed 3 days ago13
Support S3 bucket ownership validation on the S3 sink
Closed 7 days ago1
[BUG] Failure to process "reserved" chars in regular expressions
Updated 8 days ago2
Support Index `aliases` in Opensearch as a data source.
Updated 8 days ago1
Add Syslog Source
Updated 8 days ago
Support alternative representations of DocumentDb data types.
Updated 13 days ago
CVE-2024-22201 on http2-common 9.4.51 version - autoclosed
Closed 13 days ago1
DocumentDb Mapping Follow-on
Updated 14 days ago
[BUG] HTTP source config does not support API restendpoint
Updated 15 days ago1
[BUG] Custom ISM policy isnt injected
Updated 15 days ago1
Support regex patterns for the exclude_suffix in s3 scan
Updated 15 days ago1
S3 source - allow cross region access
Updated 15 days ago1
[BUG] data-prepper-core contains log4j configuration files
Updated 15 days ago
Support alternate CloudWatch configurations for monitoring Data Prepper
Updated 15 days ago
Stop listing indexes after one time pull from the OpenSearch indices
Updated 19 days ago
Pipeline Configuration Transformation
Closed 21 days ago
Use KafkaCustomConsumerFactory in configuring consumer in KafkaSource
Updated 22 days ago
Data Prepper Event Json Codec
Closed 23 days ago4
[BUG] Ownership can timeout on full buffer for pull based sources
Updated a month ago3
Deprecate pipeline_configurations with extension in pipeline.yaml
Closed a month ago1
[BUG] Failed to submit a listener notification task. Event loop shut down?
Closed a month ago1
[BUG] 2024-04-17T14:11:41,339 [pool-6-thread-1] WARN org.apache.kafka.clients.NetworkClient - [Consumer clientId=consumer-host-1, groupId=host] Connection to node -1 (kafka.data-prepper/172.27.91.183:9092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue.
Closed a month ago2
Adding compression support for DLQ events
Closed a month ago1
[BUG] Failed to decompress snappy file in S3 source
Updated a month ago1
Add GeoIP commercial databases
Updated a month ago1
Support cross account DynamoDB source tables
Updated a month ago
[BUG] All sources supporting acknowledgements must override areAcknowledementsEnabled
Closed a month ago
Provide validations of AWS accountIds
Closed a month ago
A common type for plugin configurations to support if ,else if ,else format
Updated a month ago
Feature(s) Request: More source plugins
Updated a month ago1
[BUG] DynamoDB source shard does not exist results in stuck pipeline
Updated a month ago
Retrieve last item of a list
Updated a month ago2
Support dynamically grouping Events together in the S3 sink
Closed 2 months ago1
Better metrics for OpenSearch duplicate documents
Closed 2 months ago
Better metrics on OpenSearch document errors
Closed 2 months ago
Manual approval required for workflow run 8453845571: Release Data Prepper : 2.7.0
Closed 2 months ago3