Determine if data_streams => true
can be possible with ECS compatibility effectively disabled
#1176
Labels
data_streams => true
can be possible with ECS compatibility effectively disabled
#1176
Currently, we prohibit the use of
data_stream => true
, and resolve the defaultdata_stream => auto
tofalse
when ECS is effectively disabled. The primary driver of this is to prevent users from getting themselves into a situation implicitly that would cause them trouble.We need to determine in what conditions a customer should be able enable data streams features when they also want to run the pipeline without ECS.
When running on Logstash 8, ECS is on-by-default, but that can be:
ecs_compatibility => disabled
,pipeline.ecs_compatibility: disabled
for an individual pipeline or for the process as a whole.When ECS is disabled, the behaviour in this plugin is changed in a couple of ways:
manage_templates => true
,template
defaults to a pre-ecs templatedata_stream => auto
resolves tofalse
When data streams is effectively enabled,
manage_templates
defaults tofalse
.Therefore, when a user explicitly asks for
data_stream => true
, and does not also setmanage_templates => true
, the effective value ofecs_compatibility
should have no effect. We need to verify this assertion, and if it holds true, should begin allowing users who explicitly ask for data streams to operate with or without ECS enabled.The text was updated successfully, but these errors were encountered: