Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[pkg/stanza] Compare performance with and without buffer in LogEmitter #35454

Closed
andrzej-stencel opened this issue Sep 27, 2024 · 4 comments
Closed

[pkg/stanza] Compare performance with and without buffer in LogEmitter #35454

andrzej-stencel opened this issue Sep 27, 2024 · 4 comments
Assignees
@andrzej-stencel
Labels
pkg/stanza

Comments

@andrzej-stencel
Copy link
Member

Component(s)

pkg/stanza

Describe the issue you're reporting

TL;DR Let's measure the performance impact of removing the 100-log buffer from Stanza adapter's LogEmitter.

The problem:

The LogEmitter's buffer for Stanza entries (in batch field) is a source of data loss during non-graceful collector shutdowns, as the items in the buffer are not persisted and they are already marked as sent by File consumer.

What to do about it:

In an effort to make Filelog receiver (and other Stanza-based receivers) 100% reliable, we want to remove any possibility of data loss. The simplest solution is to remove this buffering and send each log record through the OTLP pipeline separately, as a separate Log Resource. This may have a performance impact though, so the first step is to measure this potential performance impact. After we have this data, we can make further decisions as to next steps.

Expected output:

A comparison (e.g. in form of a table) of collector performance with the current standard build of the collector vs. a build with this buffer removed, or modified to 1 log only, which is probably mostly equal in performance to not having the buffer at all.

Additional context:

This issue is created as a result of discussion in #31074, specifically see #31074 (comment) and later comments.
@andrzej-stencel andrzej-stencel added the needs triage New item requiring triage label Sep 27, 2024
@github-actions GitHub Actions
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

This was referenced Sep 27, 2024
Open
Open
@github-actions github-actions bot mentioned this issue Oct 1, 2024
Closed
@andrzej-stencel andrzej-stencel removed the needs triage New item requiring triage label Oct 1, 2024
@andrzej-stencel
Copy link
Member Author

Removing needs triage label as this was discussed with the code owner.

@andrzej-stencel andrzej-stencel self-assigned this Oct 8, 2024
@andrzej-stencel
Copy link
Member Author

andrzej-stencel commented Oct 8, 2024 •
edited
Loading

I have performed the following two tests with OpenTelemetry Collector Contrib v0.111.0, using Go 1.22.8, on my laptop with Ubuntu 24.04

Run existing benchmark test BenchmarkEndToEnd for Stanza adapter

Looking at #21929, I went to https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/v0.111.0/pkg/stanza/adapter/benchmark_test.go and ran the BenchmarkEndToEnd benchmark test to confirm the results in the current version.

Here are the commands I ran:

git clone https://github.com/open-telemetry/opentelemetry-collector-contrib.git
git checkout v0.111.0
git clean -xdf
cd pkg/stanza/adapter
go test -run=xxx -bench=EndToEnd

Here's the output from the benchmark run:

benchmark output 
$ go test -run=xxx -bench=EndToEnd
goos: linux
goarch: amd64
pkg: github.com/open-telemetry/opentelemetry-collector-contrib/pkg/stanza/adapter
cpu: 13th Gen Intel(R) Core(TM) i7-13700H
BenchmarkEndToEnd/workerCount=1,maxBatchSize=1,flushInterval=10ms-20                   1        1522076738 ns/op        514978824 B/op   9402198 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=1,flushInterval=100ms-20                  1        1343760442 ns/op        514913024 B/op   9401967 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=10,flushInterval=10ms-20                  2         685520339 ns/op        387804868 B/op   7080868 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=10,flushInterval=100ms-20                 2         718605236 ns/op        387807180 B/op   7080901 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=100,flushInterval=10ms-20                 3         431886441 ns/op        347669549 B/op   6212568 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=100,flushInterval=100ms-20                3         437146594 ns/op        347669733 B/op   6212555 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=1000,flushInterval=10ms-20                3         428288834 ns/op        343359026 B/op   6112946 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=1000,flushInterval=100ms-20               3         428467654 ns/op        343357698 B/op   6112940 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=10000,flushInterval=10ms-20               3         440471587 ns/op        344406085 B/op   6101985 allocs/op
BenchmarkEndToEnd/workerCount=1,maxBatchSize=10000,flushInterval=100ms-20              3         453263992 ns/op        344407616 B/op   6101985 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=1,flushInterval=10ms-20                   1        1212049853 ns/op        514903976 B/op   9401813 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=1,flushInterval=100ms-20                  1        1200459071 ns/op        514904368 B/op   9401768 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=10,flushInterval=10ms-20                  3         500720234 ns/op        387797658 B/op   7080664 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=10,flushInterval=100ms-20                 2         531035826 ns/op        387809156 B/op   7080760 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=100,flushInterval=10ms-20                 4         316691146 ns/op        347666116 B/op   6212478 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=100,flushInterval=100ms-20                4         310360177 ns/op        347662812 B/op   6212447 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=1000,flushInterval=10ms-20                4         298677601 ns/op        343356116 B/op   6112873 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=1000,flushInterval=100ms-20               4         297092217 ns/op        343347826 B/op   6112816 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=10000,flushInterval=10ms-20               4         299894912 ns/op        344400524 B/op   6101854 allocs/op
BenchmarkEndToEnd/workerCount=2,maxBatchSize=10000,flushInterval=100ms-20              4         298329294 ns/op        344402844 B/op   6101859 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=1,flushInterval=10ms-20                   2         713602050 ns/op        514859516 B/op   9401040 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=1,flushInterval=100ms-20                  2         798394095 ns/op        514871572 B/op   9401227 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=10,flushInterval=10ms-20                  3         344667805 ns/op        387792962 B/op   7080532 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=10,flushInterval=100ms-20                 3         337390259 ns/op        387791933 B/op   7080504 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=100,flushInterval=10ms-20                 4         254516284 ns/op        347659786 B/op   6212406 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=100,flushInterval=100ms-20                5         242180536 ns/op        347661236 B/op   6212408 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=1000,flushInterval=10ms-20                5         224539875 ns/op        343357691 B/op   6112875 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=1000,flushInterval=100ms-20               5         257613713 ns/op        343347912 B/op   6112810 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=10000,flushInterval=10ms-20               4         255680361 ns/op        344400102 B/op   6101823 allocs/op
BenchmarkEndToEnd/workerCount=4,maxBatchSize=10000,flushInterval=100ms-20              4         264670651 ns/op        344400660 B/op   6101833 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=1,flushInterval=10ms-20                   2         530249704 ns/op        514869196 B/op   9400963 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=1,flushInterval=100ms-20                  2         520593821 ns/op        514863208 B/op   9400949 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=10,flushInterval=10ms-20                  3         334474460 ns/op        387799026 B/op   7080572 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=10,flushInterval=100ms-20                 4         309871042 ns/op        387797922 B/op   7080575 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=100,flushInterval=10ms-20                 6         234778318 ns/op        347661278 B/op   6212414 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=100,flushInterval=100ms-20                6         216400544 ns/op        347657921 B/op   6212366 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=1000,flushInterval=10ms-20                6         215430490 ns/op        343354492 B/op   6112835 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=1000,flushInterval=100ms-20               6         204462968 ns/op        343345476 B/op   6112766 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=10000,flushInterval=10ms-20               5         210037586 ns/op        344398969 B/op   6101811 allocs/op
BenchmarkEndToEnd/workerCount=8,maxBatchSize=10000,flushInterval=100ms-20              4         250059917 ns/op        344402584 B/op   6101832 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=1,flushInterval=10ms-20                  3         449895372 ns/op        514847637 B/op   9400734 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=1,flushInterval=100ms-20                 3         453784942 ns/op        514854456 B/op   9400826 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=10,flushInterval=10ms-20                 6         226607340 ns/op        387785121 B/op   7080424 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=10,flushInterval=100ms-20                5         213936440 ns/op        387791766 B/op   7080477 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=100,flushInterval=10ms-20                6         205042590 ns/op        347661382 B/op   6212425 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=100,flushInterval=100ms-20               6         204048992 ns/op        347660038 B/op   6212378 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=1000,flushInterval=10ms-20               6         187801134 ns/op        343350864 B/op   6112800 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=1000,flushInterval=100ms-20              6         194317292 ns/op        343344978 B/op   6112766 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=10000,flushInterval=10ms-20              6         212218173 ns/op        344397457 B/op   6101812 allocs/op
BenchmarkEndToEnd/workerCount=16,maxBatchSize=10000,flushInterval=100ms-20             6         213784740 ns/op        344394673 B/op   6101785 allocs/op
PASS
ok      github.com/open-telemetry/opentelemetry-collector-contrib/pkg/stanza/adapter    104.827s

Run the collector binary reading a 1 GiB file

Using original, unmodified collector binary

Build collector binary:

git clone https://github.com/open-telemetry/opentelemetry-collector-contrib.git
git checkout v0.111.0
git clean -xdf
make install-tools && make genotelcontribcol && make otelcontribcol
mv bin/otelcontribcol_linux_amd64 bin/otelcol-contrib-100

Prepare input file:

$ openssl rand -out random-input.log -base64 792917038
$ ls -l ran*            
-rw-rw-r-- 1 andrzej andrzej 1073741825 Oct  8 15:27 random-input.log
$ wc -l random-input.log
16519105 random-input.log

Prepare collector configuration:

$ cat > otelcol.config.yaml <<EOF
heredoc> exporters:
heredoc>   nop:
heredoc> receivers:
heredoc>   filelog:
heredoc>     include:
heredoc>       - random-input.log
heredoc>     start_at: beginning
heredoc> service:
heredoc>   pipelines:
heredoc>     logs:
heredoc>       exporters:
heredoc>         - nop
heredoc>       receivers:
heredoc>         - filelog
heredoc> EOF

Run the collector with the config, at the same time launching monitoring its metrics every second. This is the command that I used on my Ubuntu 24.04 machine:

gnome-terminal -- bash -c "touch output100.log; rm output100.log; i=0; while true; do echo \"=== Step \$i: \$(date -Ins)\" | tee -a output100.log; curl -s localhost:8888/metrics | grep '^otelcol_receiver_acc' | tee -a output100.log; sleep 1; i=\$((i+1)); done" && ./bin/otelcol-contrib-100 --config ./otelcol.config.yaml

It took about 18 seconds to ingest the ~16 mln logs, which makes it ~918k logs per second. Here's the output of the command:

output100.log 
=== Step 0: 2024-10-08T15:54:27,990376082+02:00
=== Step 1: 2024-10-08T15:54:29,010599075+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 683920
=== Step 2: 2024-10-08T15:54:30,036722155+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.63873e+06
=== Step 3: 2024-10-08T15:54:31,064676644+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 2.583987e+06
=== Step 4: 2024-10-08T15:54:32,084510685+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 3.621731e+06
=== Step 5: 2024-10-08T15:54:33,107013732+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 4.600435e+06
=== Step 6: 2024-10-08T15:54:34,122938564+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 5.573427e+06
=== Step 7: 2024-10-08T15:54:35,139229757+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 6.528309e+06
=== Step 8: 2024-10-08T15:54:36,153613415+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 7.554523e+06
=== Step 9: 2024-10-08T15:54:37,174807456+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 8.528158e+06
=== Step 10: 2024-10-08T15:54:38,194613469+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 9.437686e+06
=== Step 11: 2024-10-08T15:54:39,220977296+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.0437337e+07
=== Step 12: 2024-10-08T15:54:40,241874009+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.1397389e+07
=== Step 13: 2024-10-08T15:54:41,261233859+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.2319703e+07
=== Step 14: 2024-10-08T15:54:42,284502399+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.328161e+07
=== Step 15: 2024-10-08T15:54:43,303183291+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.4209365e+07
=== Step 16: 2024-10-08T15:54:44,332351591+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.5201353e+07
=== Step 17: 2024-10-08T15:54:45,362044523+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.616764e+07
=== Step 18: 2024-10-08T15:54:46,375141271+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="0cb0496c-7bfa-427e-8b74-5e6e9870987a",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""} 1.6519105e+07

Using modified collector binary

Build collector binary, modified to hold 1 entry in LogEmitter's buffer:

git clone https://github.com/open-telemetry/opentelemetry-collector-contrib.git
git checkout v0.111.0
git clean -xdf
sed -i 's/defaultMaxBatchSize  uint = 100/defaultMaxBatchSize  uint = 1/' pkg/stanza/operator/helper/emitter.go
sed -i 's/^\(  version: 0.111.0-dev\)$/\1-1/' cmd/otelcontribcol/builder-config.yaml
make install-tools && make genotelcontribcol && make otelcontribcol
mv bin/otelcontribcol_linux_amd64 bin/otelcol-contrib-1

Prepare input file (same as above):

$ openssl rand -out random-input.log -base64 792917038
$ ls -l ran*            
-rw-rw-r-- 1 andrzej andrzej 1073741825 Oct  8 15:27 random-input.log
$ wc -l random-input.log
16519105 random-input.log

Prepare collector configuration (same as above):

$ cat > otelcol.config.yaml <<EOF
heredoc> exporters:
heredoc>   nop:
heredoc> receivers:
heredoc>   filelog:
heredoc>     include:
heredoc>       - random-input.log
heredoc>     start_at: beginning
heredoc> service:
heredoc>   pipelines:
heredoc>     logs:
heredoc>       exporters:
heredoc>         - nop
heredoc>       receivers:
heredoc>         - filelog
heredoc> EOF

Run the collector with the config, at the same time launching monitoring its metrics every second. This is the command that I used on my Ubuntu 24.04 machine:

gnome-terminal -- bash -c "touch output1.log; rm output1.log; i=0; while true; do echo \"=== Step \$i: \$(date -Ins)\" | tee -a output1.log; curl -s localhost:8888/metrics | grep '^otelcol_receiver_acc' | tee -a output1.log; sleep 1; i=\$((i+1)); done" && ./bin/otelcol-contrib-1 --config ./otelcol.config.yaml

It took about 196 seconds (3m36s) to ingest the ~16 mln logs, which makes it ~84k logs per second and about 196/18=~10.9 times slower. Here's the output of the command:

output1.log 
=== Step 0: 2024-10-08T16:01:50,718044642+02:00
=== Step 1: 2024-10-08T16:01:51,730147461+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 93766
=== Step 2: 2024-10-08T16:01:52,760328678+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 165463
=== Step 3: 2024-10-08T16:01:53,790843226+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 241829
=== Step 4: 2024-10-08T16:01:54,824560514+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 334699
=== Step 5: 2024-10-08T16:01:55,838293307+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 431374
=== Step 6: 2024-10-08T16:01:56,866573783+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 508205
=== Step 7: 2024-10-08T16:01:57,888705898+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 598327
=== Step 8: 2024-10-08T16:01:58,908074880+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 685437
=== Step 9: 2024-10-08T16:01:59,924920613+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 771097
=== Step 10: 2024-10-08T16:02:00,943183129+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 865383
=== Step 11: 2024-10-08T16:02:01,969976536+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 941354
=== Step 12: 2024-10-08T16:02:02,998792067+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.03816e+06
=== Step 13: 2024-10-08T16:02:04,026316195+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.12401e+06
=== Step 14: 2024-10-08T16:02:05,041988836+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.195019e+06
=== Step 15: 2024-10-08T16:02:06,064439826+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.279573e+06
=== Step 16: 2024-10-08T16:02:07,079787535+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.360483e+06
=== Step 17: 2024-10-08T16:02:08,107297006+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.436729e+06
=== Step 18: 2024-10-08T16:02:09,133296080+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.525311e+06
=== Step 19: 2024-10-08T16:02:10,154681845+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.63428e+06
=== Step 20: 2024-10-08T16:02:11,180754493+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.729609e+06
=== Step 21: 2024-10-08T16:02:12,206620153+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.817399e+06
=== Step 22: 2024-10-08T16:02:13,232082993+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.89889e+06
=== Step 23: 2024-10-08T16:02:14,256718410+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.983319e+06
=== Step 24: 2024-10-08T16:02:15,277116190+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.075652e+06
=== Step 25: 2024-10-08T16:02:16,304498558+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.156622e+06
=== Step 26: 2024-10-08T16:02:17,331072054+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.226296e+06
=== Step 27: 2024-10-08T16:02:18,353963213+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.292789e+06
=== Step 28: 2024-10-08T16:02:19,376660028+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.375524e+06
=== Step 29: 2024-10-08T16:02:20,403900281+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.454651e+06
=== Step 30: 2024-10-08T16:02:21,433209635+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.524204e+06
=== Step 31: 2024-10-08T16:02:22,461489462+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.597372e+06
=== Step 32: 2024-10-08T16:02:23,483853941+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.684184e+06
=== Step 33: 2024-10-08T16:02:24,512234132+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.773744e+06
=== Step 34: 2024-10-08T16:02:25,538241567+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.854174e+06
=== Step 35: 2024-10-08T16:02:26,562598422+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 2.936054e+06
=== Step 36: 2024-10-08T16:02:27,593460318+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.020141e+06
=== Step 37: 2024-10-08T16:02:28,620435746+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.097697e+06
=== Step 38: 2024-10-08T16:02:29,647592131+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.182339e+06
=== Step 39: 2024-10-08T16:02:30,678556986+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.261878e+06
=== Step 40: 2024-10-08T16:02:31,705075328+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.370665e+06
=== Step 41: 2024-10-08T16:02:32,733514576+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.474041e+06
=== Step 42: 2024-10-08T16:02:33,764588641+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.553068e+06
=== Step 43: 2024-10-08T16:02:34,787665903+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.624444e+06
=== Step 44: 2024-10-08T16:02:35,814443788+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.708767e+06
=== Step 45: 2024-10-08T16:02:36,840468329+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.795527e+06
=== Step 46: 2024-10-08T16:02:37,866212519+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.884803e+06
=== Step 47: 2024-10-08T16:02:38,891972562+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 3.968523e+06
=== Step 48: 2024-10-08T16:02:39,924606013+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.036867e+06
=== Step 49: 2024-10-08T16:02:40,947741851+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.117826e+06
=== Step 50: 2024-10-08T16:02:41,973565976+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.189774e+06
=== Step 51: 2024-10-08T16:02:42,998676527+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.270996e+06
=== Step 52: 2024-10-08T16:02:44,013593717+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.344087e+06
=== Step 53: 2024-10-08T16:02:45,043611454+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.426952e+06
=== Step 54: 2024-10-08T16:02:46,070073797+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.508038e+06
=== Step 55: 2024-10-08T16:02:47,099392401+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.594153e+06
=== Step 56: 2024-10-08T16:02:48,129775303+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.668e+06
=== Step 57: 2024-10-08T16:02:49,164144626+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.761233e+06
=== Step 58: 2024-10-08T16:02:50,187291869+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.826461e+06
=== Step 59: 2024-10-08T16:02:51,218147530+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.907058e+06
=== Step 60: 2024-10-08T16:02:52,251131392+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 4.9855e+06
=== Step 61: 2024-10-08T16:02:53,277015936+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.078222e+06
=== Step 62: 2024-10-08T16:02:54,302976326+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.162033e+06
=== Step 63: 2024-10-08T16:02:55,331467919+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.242885e+06
=== Step 64: 2024-10-08T16:02:56,359792078+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.326773e+06
=== Step 65: 2024-10-08T16:02:57,391115882+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.398987e+06
=== Step 66: 2024-10-08T16:02:58,405855245+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.472476e+06
=== Step 67: 2024-10-08T16:02:59,431002802+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.559725e+06
=== Step 68: 2024-10-08T16:03:00,462681963+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.635417e+06
=== Step 69: 2024-10-08T16:03:01,496500341+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.716475e+06
=== Step 70: 2024-10-08T16:03:02,526921294+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.796237e+06
=== Step 71: 2024-10-08T16:03:03,562969263+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.873334e+06
=== Step 72: 2024-10-08T16:03:04,592987227+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 5.96596e+06
=== Step 73: 2024-10-08T16:03:05,618748610+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.057124e+06
=== Step 74: 2024-10-08T16:03:06,655370616+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.134104e+06
=== Step 75: 2024-10-08T16:03:07,680351608+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.214303e+06
=== Step 76: 2024-10-08T16:03:08,718588871+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.289111e+06
=== Step 77: 2024-10-08T16:03:09,744076746+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.39545e+06
=== Step 78: 2024-10-08T16:03:10,773855441+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.478369e+06
=== Step 79: 2024-10-08T16:03:11,805719657+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.575078e+06
=== Step 80: 2024-10-08T16:03:12,830579479+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.659312e+06
=== Step 81: 2024-10-08T16:03:13,862703490+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.72818e+06
=== Step 82: 2024-10-08T16:03:14,877484534+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.811381e+06
=== Step 83: 2024-10-08T16:03:15,904809737+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.88871e+06
=== Step 84: 2024-10-08T16:03:16,933827428+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 6.967122e+06
=== Step 85: 2024-10-08T16:03:17,964831991+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.044191e+06
=== Step 86: 2024-10-08T16:03:18,991016539+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.11949e+06
=== Step 87: 2024-10-08T16:03:20,021566632+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.206627e+06
=== Step 88: 2024-10-08T16:03:21,044120484+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.340683e+06
=== Step 89: 2024-10-08T16:03:22,063760330+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.450077e+06
=== Step 90: 2024-10-08T16:03:23,097812133+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.543702e+06
=== Step 91: 2024-10-08T16:03:24,124627774+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.632032e+06
=== Step 92: 2024-10-08T16:03:25,142081250+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.715242e+06
=== Step 93: 2024-10-08T16:03:26,170974698+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.794875e+06
=== Step 94: 2024-10-08T16:03:27,197528886+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.872842e+06
=== Step 95: 2024-10-08T16:03:28,212819802+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 7.944642e+06
=== Step 96: 2024-10-08T16:03:29,240354735+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.018376e+06
=== Step 97: 2024-10-08T16:03:30,262209526+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.097279e+06
=== Step 98: 2024-10-08T16:03:31,280814502+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.183807e+06
=== Step 99: 2024-10-08T16:03:32,306171457+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.279523e+06
=== Step 100: 2024-10-08T16:03:33,332811426+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.364008e+06
=== Step 101: 2024-10-08T16:03:34,361773911+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.443387e+06
=== Step 102: 2024-10-08T16:03:35,385153129+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.516595e+06
=== Step 103: 2024-10-08T16:03:36,409598450+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.590341e+06
=== Step 104: 2024-10-08T16:03:37,435437500+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.660761e+06
=== Step 105: 2024-10-08T16:03:38,466476882+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.741395e+06
=== Step 106: 2024-10-08T16:03:39,499985384+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.810158e+06
=== Step 107: 2024-10-08T16:03:40,530891767+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.894378e+06
=== Step 108: 2024-10-08T16:03:41,561100193+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 8.970861e+06
=== Step 109: 2024-10-08T16:03:42,592713168+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.049839e+06
=== Step 110: 2024-10-08T16:03:43,610417593+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.131216e+06
=== Step 111: 2024-10-08T16:03:44,636481956+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.20788e+06
=== Step 112: 2024-10-08T16:03:45,668565085+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.286726e+06
=== Step 113: 2024-10-08T16:03:46,697420363+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.370575e+06
=== Step 114: 2024-10-08T16:03:47,721580391+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.445841e+06
=== Step 115: 2024-10-08T16:03:48,737966979+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.530115e+06
=== Step 116: 2024-10-08T16:03:49,759168239+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.598537e+06
=== Step 117: 2024-10-08T16:03:50,773395878+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.678675e+06
=== Step 118: 2024-10-08T16:03:51,793897688+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.758984e+06
=== Step 119: 2024-10-08T16:03:52,811251678+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.84439e+06
=== Step 120: 2024-10-08T16:03:53,839688797+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.915262e+06
=== Step 121: 2024-10-08T16:03:54,873347055+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 9.992486e+06
=== Step 122: 2024-10-08T16:03:55,897068657+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0068308e+07
=== Step 123: 2024-10-08T16:03:56,918974597+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0138802e+07
=== Step 124: 2024-10-08T16:03:57,942735032+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0218645e+07
=== Step 125: 2024-10-08T16:03:58,971061853+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0311277e+07
=== Step 126: 2024-10-08T16:04:00,001948009+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0389201e+07
=== Step 127: 2024-10-08T16:04:01,034139559+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0475663e+07
=== Step 128: 2024-10-08T16:04:02,065306840+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0543412e+07
=== Step 129: 2024-10-08T16:04:03,104707595+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0631033e+07
=== Step 130: 2024-10-08T16:04:04,129794971+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.071831e+07
=== Step 131: 2024-10-08T16:04:05,168081420+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0792584e+07
=== Step 132: 2024-10-08T16:04:06,195593912+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0867772e+07
=== Step 133: 2024-10-08T16:04:07,228672934+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.0951341e+07
=== Step 134: 2024-10-08T16:04:08,256594618+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1048885e+07
=== Step 135: 2024-10-08T16:04:09,278339836+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.113862e+07
=== Step 136: 2024-10-08T16:04:10,305967938+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1241588e+07
=== Step 137: 2024-10-08T16:04:11,329290596+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1332149e+07
=== Step 138: 2024-10-08T16:04:12,360179608+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1412896e+07
=== Step 139: 2024-10-08T16:04:13,395879366+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1501018e+07
=== Step 140: 2024-10-08T16:04:14,419771608+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.159085e+07
=== Step 141: 2024-10-08T16:04:15,439175281+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1674092e+07
=== Step 142: 2024-10-08T16:04:16,469818570+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1747958e+07
=== Step 143: 2024-10-08T16:04:17,500876738+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.182457e+07
=== Step 144: 2024-10-08T16:04:18,525398666+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1901063e+07
=== Step 145: 2024-10-08T16:04:19,556778772+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.1995065e+07
=== Step 146: 2024-10-08T16:04:20,577390334+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2082228e+07
=== Step 147: 2024-10-08T16:04:21,605798763+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2162307e+07
=== Step 148: 2024-10-08T16:04:22,642417056+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2255549e+07
=== Step 149: 2024-10-08T16:04:23,671394152+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2328058e+07
=== Step 150: 2024-10-08T16:04:24,702415626+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2403495e+07
=== Step 151: 2024-10-08T16:04:25,729296015+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2491471e+07
=== Step 152: 2024-10-08T16:04:26,761774717+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2564101e+07
=== Step 153: 2024-10-08T16:04:27,791194794+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.265095e+07
=== Step 154: 2024-10-08T16:04:28,824330149+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2730943e+07
=== Step 155: 2024-10-08T16:04:29,847602176+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2811453e+07
=== Step 156: 2024-10-08T16:04:30,874397574+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2889852e+07
=== Step 157: 2024-10-08T16:04:31,901487097+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.2975831e+07
=== Step 158: 2024-10-08T16:04:32,925132897+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3069545e+07
=== Step 159: 2024-10-08T16:04:33,960178688+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3155125e+07
=== Step 160: 2024-10-08T16:04:34,987788564+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.323898e+07
=== Step 161: 2024-10-08T16:04:36,021604323+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3318166e+07
=== Step 162: 2024-10-08T16:04:37,044260510+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3396946e+07
=== Step 163: 2024-10-08T16:04:38,074191575+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3476849e+07
=== Step 164: 2024-10-08T16:04:39,103781600+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3557487e+07
=== Step 165: 2024-10-08T16:04:40,132904114+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3622181e+07
=== Step 166: 2024-10-08T16:04:41,165193507+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3699133e+07
=== Step 167: 2024-10-08T16:04:42,196347394+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3769939e+07
=== Step 168: 2024-10-08T16:04:43,226184925+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.385637e+07
=== Step 169: 2024-10-08T16:04:44,250504124+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.3938762e+07
=== Step 170: 2024-10-08T16:04:45,273370715+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4009836e+07
=== Step 171: 2024-10-08T16:04:46,310107991+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.408509e+07
=== Step 172: 2024-10-08T16:04:47,337303064+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.416577e+07
=== Step 173: 2024-10-08T16:04:48,368122289+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4248832e+07
=== Step 174: 2024-10-08T16:04:49,396698482+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4328452e+07
=== Step 175: 2024-10-08T16:04:50,422062695+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4416455e+07
=== Step 176: 2024-10-08T16:04:51,445170126+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4501448e+07
=== Step 177: 2024-10-08T16:04:52,474504202+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4578346e+07
=== Step 178: 2024-10-08T16:04:53,504825315+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4666286e+07
=== Step 179: 2024-10-08T16:04:54,532235441+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4754402e+07
=== Step 180: 2024-10-08T16:04:55,559916571+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4830476e+07
=== Step 181: 2024-10-08T16:04:56,589796509+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4906257e+07
=== Step 182: 2024-10-08T16:04:57,612560036+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.4979915e+07
=== Step 183: 2024-10-08T16:04:58,636064583+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5050908e+07
=== Step 184: 2024-10-08T16:04:59,658868554+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5126572e+07
=== Step 185: 2024-10-08T16:05:00,682704705+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5226866e+07
=== Step 186: 2024-10-08T16:05:01,701713882+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5348673e+07
=== Step 187: 2024-10-08T16:05:02,727876615+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5430043e+07
=== Step 188: 2024-10-08T16:05:03,752306199+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5608041e+07
=== Step 189: 2024-10-08T16:05:04,763856955+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5745777e+07
=== Step 190: 2024-10-08T16:05:05,776967760+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5851862e+07
=== Step 191: 2024-10-08T16:05:06,793001734+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.5957614e+07
=== Step 192: 2024-10-08T16:05:07,807961159+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.6074847e+07
=== Step 193: 2024-10-08T16:05:08,823884623+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.6184077e+07
=== Step 194: 2024-10-08T16:05:09,841215529+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.629844e+07
=== Step 195: 2024-10-08T16:05:10,859383875+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.6427145e+07
=== Step 196: 2024-10-08T16:05:11,879093494+02:00
otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="6bcb6bf3-e1f7-4a67-837f-ecb4fd34cdb9",service_name="otelcontribcol",service_version="0.111.0-dev-1",transport=""} 1.6519105e+07

@andrzej-stencel
Copy link
Member Author

I believe the above results show that simply removing the buffering from LogEmitter would have a catastrophic effect on the Filelog receiver's performance. Before removing the buffer, we should implement buffering on a different stage. See #35456 for details.

This was referenced Oct 9, 2024
Closed
Merged
djaglowski pushed a commit that referenced this issue Nov 7, 2024
@bacherfl @andrzej-stencel
[pkg/stanza] make log emitter and entry conversion in adapter synchro…
c840e69 
…nous (#35669)

<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
#### Description

This PR changes the `LogEmitter` to accept a synchronous consumer
callback function for processing a batch of log entries as an
alternative to sending log entry batches to a channel.
The components that use the `LogEmitter` (adapter and parser) have been
adapted accordingly. Also, in the case of the adapter, the log entries
are converted directly, rather than sending them over a channel to the
converter and receiving the converted results over a different channel.

<!-- Issue number (e.g. #1234) or full URL to issue, if applicable. -->
#### Link to tracking issue
Fixes #35453 

<!--Describe what testing was performed and which tests were added.-->
#### Testing

I did some initial performance tests using the `TestLogLargeFiles` load
test to see how this change affects the performance. Below are the
results:

**Before the change (i.e. with async log entry batch processing)**

```
=== RUN   TestLogLargeFiles/filelog-largefiles-2Gb-lifetime
2024/10/08 09:02:53  | Sent:17,769,795 logs (179,507/sec) | Received:17,755,188 items (179,346/sec)

=== RUN   TestLogLargeFiles/filelog-largefiles-6GB-lifetime
2024/10/08 09:06:29  | Sent:42,857,755 logs (216,465/sec) | Received:42,851,987 items (216,424/sec)

Test                                         |Result|Duration|CPU Avg%|CPU Max%|RAM Avg MiB|RAM Max MiB|Sent Items|Received Items|
---------------------------------------------|------|-------:|-------:|-------:|----------:|----------:|---------:|-------------:|
LogLargeFiles/filelog-largefiles-2Gb-lifetime|PASS  |    100s|    73.1|    78.4|        106|        118|  18249451|      18249451|
LogLargeFiles/filelog-largefiles-6GB-lifetime|PASS  |    200s|    87.5|    98.1|        110|        116|  44358460|      44358460|
```

**After the change (i.e. with sync log entry batch processing)**

```
=== RUN   TestLogLargeFiles/filelog-largefiles-2Gb-lifetime
2024/10/08 10:09:51 Agent RAM (RES): 139 MiB, CPU:71.7% | Sent:17,802,561 logs (179,836/sec) | Received:17,788,273 items (179,680/sec)

=== RUN   TestLogLargeFiles/filelog-largefiles-6GB-lifetime
2024/10/08 10:05:15 Agent RAM (RES): 140 MiB, CPU:95.6% | Sent:42,912,030 logs (216,744/sec) | Received:42,904,306 items (216,689/sec)

Test                                         |Result|Duration|CPU Avg%|CPU Max%|RAM Avg MiB|RAM Max MiB|Sent Items|Received Items|
---------------------------------------------|------|-------:|-------:|-------:|----------:|----------:|---------:|-------------:|
LogLargeFiles/filelog-largefiles-2Gb-lifetime|PASS  |    100s|    74.8|    78.9|        127|        139|  17984687|      17984687|
LogLargeFiles/filelog-largefiles-6GB-lifetime|PASS  |    200s|    89.3|   100.9|        134|        140|  43376210|      43376210|
```

Those results seem to indicate comparable throughput, but with an
increased resource consumption, especially in terms of memory.

I also did a test comparing the performance between the synchronous and
asynchronous log emitter using the same methodology as in #35454.

The results were the following, and indicate an increase in the time it
takes for reading the generated log file (see #35454 for details on how
the file is generated and the test execution):

- Async Log Emitter: ~8s
- Sync Log Emitter: ~12s


<details>
  <summary>output-async.log</summary>
=== Step 3: Thu Oct 10 08:54:23 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
2.209674e+06
=== Step 4: Thu Oct 10 08:54:25 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
5.428103e+06
=== Step 5: Thu Oct 10 08:54:26 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
7.337017e+06
=== Step 6: Thu Oct 10 08:54:27 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
9.258843e+06
=== Step 7: Thu Oct 10 08:54:29 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.3082428e+07
=== Step 8: Thu Oct 10 08:54:31 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.6519068e+07
</details>

<details>
  <summary>output-sync.log</summary>
=== Step 2: Thu Oct 10 08:51:27 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.580891e+06
=== Step 3: Thu Oct 10 08:51:28 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
3.01034e+06
=== Step 4: Thu Oct 10 08:51:29 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
4.434627e+06
=== Step 5: Thu Oct 10 08:51:31 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
7.416612e+06
=== Step 6: Thu Oct 10 08:51:34 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.0496072e+07
=== Step 7: Thu Oct 10 08:51:36 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.3523882e+07
=== Step 8: Thu Oct 10 08:51:37 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.4929707e+07
=== Step 9: Thu Oct 10 08:51:39 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.6519105e+07
</details>

---------

Signed-off-by: Florian Bacher <[email protected]>
Co-authored-by: Andrzej Stencel <[email protected]>
andrzej-stencel added a commit to andrzej-stencel/opentelemetry-collector-contrib that referenced this issue Nov 8, 2024
@andrzej-stencel
do not split batches in Log Emitter
5492cb4 
This changes the Log Emitter to run the `consumerFunc`
on the whole batch, instead of splitting the batch into individual entries
and calling `consumerFunc` on each of them.

This doesn't change much while the Log Emitter has its own `batch` buffer,
but if we remove the `batch` buffer (see open-telemetry#35456),
this should prevent the performance drop described in open-telemetry#35454.
andrzej-stencel added a commit to andrzej-stencel/opentelemetry-collector-contrib that referenced this issue Nov 8, 2024
@andrzej-stencel
do not split batches in Log Emitter
8e3197b 
This changes the Log Emitter to run the `consumerFunc`
on the whole batch, instead of splitting the batch into individual entries
and calling `consumerFunc` on each of them.

This doesn't change much while the Log Emitter has its own `batch` buffer,
but if we remove the `batch` buffer (see open-telemetry#35456),
this should prevent the performance drop described in open-telemetry#35454.
andrzej-stencel added a commit to andrzej-stencel/opentelemetry-collector-contrib that referenced this issue Nov 19, 2024
@andrzej-stencel
do not split batches in Log Emitter
ec44375 
This changes the Log Emitter to run the `consumerFunc`
on the whole batch, instead of splitting the batch into individual entries
and calling `consumerFunc` on each of them.

This doesn't change much while the Log Emitter has its own `batch` buffer,
but if we remove the `batch` buffer (see open-telemetry#35456),
this should prevent the performance drop described in open-telemetry#35454.
This was referenced Dec 4, 2024
Open
Open
sbylica-splunk pushed a commit to sbylica-splunk/opentelemetry-collector-contrib that referenced this issue Dec 17, 2024
@bacherfl @andrzej-stencel @sbylica-splunk
[pkg/stanza] make log emitter and entry conversion in adapter synchro…
9e5fcdd 
…nous (open-telemetry#35669)

<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
#### Description

This PR changes the `LogEmitter` to accept a synchronous consumer
callback function for processing a batch of log entries as an
alternative to sending log entry batches to a channel.
The components that use the `LogEmitter` (adapter and parser) have been
adapted accordingly. Also, in the case of the adapter, the log entries
are converted directly, rather than sending them over a channel to the
converter and receiving the converted results over a different channel.

<!-- Issue number (e.g. open-telemetry#1234) or full URL to issue, if applicable. -->
#### Link to tracking issue
Fixes open-telemetry#35453 

<!--Describe what testing was performed and which tests were added.-->
#### Testing

I did some initial performance tests using the `TestLogLargeFiles` load
test to see how this change affects the performance. Below are the
results:

**Before the change (i.e. with async log entry batch processing)**

```
=== RUN   TestLogLargeFiles/filelog-largefiles-2Gb-lifetime
2024/10/08 09:02:53  | Sent:17,769,795 logs (179,507/sec) | Received:17,755,188 items (179,346/sec)

=== RUN   TestLogLargeFiles/filelog-largefiles-6GB-lifetime
2024/10/08 09:06:29  | Sent:42,857,755 logs (216,465/sec) | Received:42,851,987 items (216,424/sec)

Test                                         |Result|Duration|CPU Avg%|CPU Max%|RAM Avg MiB|RAM Max MiB|Sent Items|Received Items|
---------------------------------------------|------|-------:|-------:|-------:|----------:|----------:|---------:|-------------:|
LogLargeFiles/filelog-largefiles-2Gb-lifetime|PASS  |    100s|    73.1|    78.4|        106|        118|  18249451|      18249451|
LogLargeFiles/filelog-largefiles-6GB-lifetime|PASS  |    200s|    87.5|    98.1|        110|        116|  44358460|      44358460|
```

**After the change (i.e. with sync log entry batch processing)**

```
=== RUN   TestLogLargeFiles/filelog-largefiles-2Gb-lifetime
2024/10/08 10:09:51 Agent RAM (RES): 139 MiB, CPU:71.7% | Sent:17,802,561 logs (179,836/sec) | Received:17,788,273 items (179,680/sec)

=== RUN   TestLogLargeFiles/filelog-largefiles-6GB-lifetime
2024/10/08 10:05:15 Agent RAM (RES): 140 MiB, CPU:95.6% | Sent:42,912,030 logs (216,744/sec) | Received:42,904,306 items (216,689/sec)

Test                                         |Result|Duration|CPU Avg%|CPU Max%|RAM Avg MiB|RAM Max MiB|Sent Items|Received Items|
---------------------------------------------|------|-------:|-------:|-------:|----------:|----------:|---------:|-------------:|
LogLargeFiles/filelog-largefiles-2Gb-lifetime|PASS  |    100s|    74.8|    78.9|        127|        139|  17984687|      17984687|
LogLargeFiles/filelog-largefiles-6GB-lifetime|PASS  |    200s|    89.3|   100.9|        134|        140|  43376210|      43376210|
```

Those results seem to indicate comparable throughput, but with an
increased resource consumption, especially in terms of memory.

I also did a test comparing the performance between the synchronous and
asynchronous log emitter using the same methodology as in open-telemetry#35454.

The results were the following, and indicate an increase in the time it
takes for reading the generated log file (see open-telemetry#35454 for details on how
the file is generated and the test execution):

- Async Log Emitter: ~8s
- Sync Log Emitter: ~12s


<details>
  <summary>output-async.log</summary>
=== Step 3: Thu Oct 10 08:54:23 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
2.209674e+06
=== Step 4: Thu Oct 10 08:54:25 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
5.428103e+06
=== Step 5: Thu Oct 10 08:54:26 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
7.337017e+06
=== Step 6: Thu Oct 10 08:54:27 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
9.258843e+06
=== Step 7: Thu Oct 10 08:54:29 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.3082428e+07
=== Step 8: Thu Oct 10 08:54:31 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="3744d4cb-5080-427c-8c16-a96cb40a57d4",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.6519068e+07
</details>

<details>
  <summary>output-sync.log</summary>
=== Step 2: Thu Oct 10 08:51:27 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.580891e+06
=== Step 3: Thu Oct 10 08:51:28 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
3.01034e+06
=== Step 4: Thu Oct 10 08:51:29 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
4.434627e+06
=== Step 5: Thu Oct 10 08:51:31 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
7.416612e+06
=== Step 6: Thu Oct 10 08:51:34 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.0496072e+07
=== Step 7: Thu Oct 10 08:51:36 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.3523882e+07
=== Step 8: Thu Oct 10 08:51:37 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.4929707e+07
=== Step 9: Thu Oct 10 08:51:39 CEST 2024

otelcol_receiver_accepted_log_records{receiver="filelog",service_instance_id="dcf5371b-19eb-47b3-a820-756c1832b448",service_name="otelcontribcol",service_version="0.111.0-dev",transport=""}
1.6519105e+07
</details>

---------

Signed-off-by: Florian Bacher <[email protected]>
Co-authored-by: Andrzej Stencel <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@andrzej-stencel andrzej-stencel

Labels
pkg/stanza
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@andrzej-stencel