From 1e4633445fb5ff35078b451ed8e2113efc919ae8 Mon Sep 17 00:00:00 2001 From: May Lee Date: Thu, 19 Feb 2026 18:05:51 -0500 Subject: [PATCH 1/3] add info --- content/en/observability_pipelines/processors/dedupe.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/content/en/observability_pipelines/processors/dedupe.md b/content/en/observability_pipelines/processors/dedupe.md index e00f02d9fdb..69d38849896 100644 --- a/content/en/observability_pipelines/processors/dedupe.md +++ b/content/en/observability_pipelines/processors/dedupe.md @@ -29,7 +29,10 @@ To set up the Deduplicate processor: #### Cache size -The default cache size is 5,000 messages (recommended). The cached messages are kept in memory to determine if the incoming messages are duplicates. You can increase the cache size to fit your needs. **Note**: Increasing the cache size increases memory usage. +The default cache size is 5,000 messages (recommended). The cached messages are kept in memory to determine if the incoming messages are duplicates. You can increase the cache size to fit your needs. **Notes**: +- Increasing the cache size increases memory usage. +- The cache is backed by a LRU cache with a size based on the configured cache size. +- Since the cache is not shared between Workers, only duplicated events processed by the same Worker are dropped. ### Path notation example From a1d647b7ac41fbb4bc043fd922c5ae00d5701660 Mon Sep 17 00:00:00 2001 From: May Lee Date: Thu, 19 Feb 2026 18:06:48 -0500 Subject: [PATCH 2/3] update --- content/en/observability_pipelines/processors/dedupe.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/content/en/observability_pipelines/processors/dedupe.md b/content/en/observability_pipelines/processors/dedupe.md index 69d38849896..df151191537 100644 --- a/content/en/observability_pipelines/processors/dedupe.md +++ b/content/en/observability_pipelines/processors/dedupe.md @@ -29,7 +29,9 @@ To set up the Deduplicate processor: #### Cache size -The default cache size is 5,000 messages (recommended). The cached messages are kept in memory to determine if the incoming messages are duplicates. You can increase the cache size to fit your needs. **Notes**: +The default cache size is 5,000 messages (recommended). The cached messages are kept in memory to determine if the incoming messages are duplicates. You can increase the cache size to fit your needs. + +**Notes**: - Increasing the cache size increases memory usage. - The cache is backed by a LRU cache with a size based on the configured cache size. - Since the cache is not shared between Workers, only duplicated events processed by the same Worker are dropped. From 43c4d7b95625f7e46c574d75988c1e9d54a38c7f Mon Sep 17 00:00:00 2001 From: May Lee Date: Thu, 19 Feb 2026 18:08:32 -0500 Subject: [PATCH 3/3] small edits --- content/en/observability_pipelines/processors/dedupe.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/en/observability_pipelines/processors/dedupe.md b/content/en/observability_pipelines/processors/dedupe.md index df151191537..c0702a09cc1 100644 --- a/content/en/observability_pipelines/processors/dedupe.md +++ b/content/en/observability_pipelines/processors/dedupe.md @@ -33,7 +33,7 @@ The default cache size is 5,000 messages (recommended). The cached messages are **Notes**: - Increasing the cache size increases memory usage. -- The cache is backed by a LRU cache with a size based on the configured cache size. +- The cache is backed by a LRU cache, where the LRU cache size is the same as the configured cache size. - Since the cache is not shared between Workers, only duplicated events processed by the same Worker are dropped. ### Path notation example