Skip to content

Ignore "Ingest Pipeline" when "Use Logs Stream" is set #15962

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Nov 13, 2025
Merged

Ignore "Ingest Pipeline" when "Use Logs Stream" is set #15962

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
86994c0
Ignore "Ingest Pipeline" when "Use Logs Stream" is set
rdner Nov 13, 2025
d0cc736
Add additional warnings to ignored fields
rdner Nov 13, 2025
fadedd4
Improve formatting
rdner Nov 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions packages/filestream/agent/input/filestream.yml.hbs
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
{{#if use_logs_stream}}
index: logs
{{else}}

data_stream:
dataset: {{data_stream.dataset}}
{{#if pipeline}}
pipeline: {{pipeline}}
{{/if}}

{{/if}}

paths:
Expand All @@ -14,10 +19,6 @@ paths:
gzip_experimental: true
{{/if}}

{{#if pipeline}}
pipeline: {{pipeline}}
{{/if}}

{{#if recursive_glob}}
prospector.scanner.recursive_glob: {{recursive_glob}}
{{/if}}
Expand Down
5 changes: 5 additions & 0 deletions packages/filestream/changelog.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "2.1.2"
changes:
- description: Ignore "Ingest Pipeline" when "Use Logs Stream" is set
type: bugfix
link: https://github.com/elastic/integrations/pull/15962
- version: "2.1.1"
changes:
- description: Improve documentation for the "Use the logs data stream" option.
Expand Down
4 changes: 2 additions & 2 deletions packages/filestream/manifest.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ name: filestream
title: Custom Logs (Filestream)
description: Collect log data using filestream with Elastic Agent.
type: input
version: 2.1.1
version: 2.1.2
conditions:
kibana:
version: "^9.2.0"
Expand Down Expand Up @@ -42,7 +42,7 @@ policy_templates:
type: bool
title: Use the "logs" data stream
description: |
When enabled, data ingested by this integration is written to the "logs" data stream, and the configured dataset name is ignored. You also need to [Turn on wired streams](https://www.elastic.co/docs/solutions/observability/streams/wired-streams#streams-wired-streams-enable) in Streams [Settings](/app/streams) and to enable **Allow agents to write to Streams** for the output policy in the Fleet [Settings](/app/fleet/settings) tab. [Learn more](https://www.elastic.co/docs/solutions/observability/streams/wired-streams).
When enabled, data ingested by this integration is written to the "logs" data stream. The `Ingest Pipeline` and the configured `Dataset name` are ignored. You also need to [Turn on wired streams](https://www.elastic.co/docs/solutions/observability/streams/wired-streams#streams-wired-streams-enable) in Streams [Settings](/app/streams) and to enable **Allow agents to write to Streams** for the output policy in the Fleet [Settings](/app/fleet/settings) tab. [Learn more](https://www.elastic.co/docs/solutions/observability/streams/wired-streams).
required: false
show_user: true
default: false
Expand Down