Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BP-44 USE metrics #2835

Merged
merged 2 commits into from
Oct 20, 2021
Merged

BP-44 USE metrics #2835

merged 2 commits into from
Oct 20, 2021

Conversation

Vanlightly
Copy link
Contributor

BP-44: USE metrics. A proposal for improving BookKeeper metrics so that operators can employ the USE method for diagnosing performance issues.

Copy link
Contributor

@eolivelli eolivelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am +1 with this BP.

we should understand how big the pain would be for users.
btw we can do this in a major release, like 4.15.0

site/bps/BP-44-use-metrics.md Outdated Show resolved Hide resolved
@dlg99
Copy link
Contributor

dlg99 commented Oct 19, 2021

Overall looks like a great addition.
Can it benefit from MDC? We already pass MDC in the thread pools, adding tags to MDC and using the tags when reporting metrics should be simple.

@Vanlightly
Copy link
Contributor Author

Overall looks like a great addition. Can it benefit from MDC? We already pass MDC in the thread pools, adding tags to MDC and using the tags when reporting metrics should be simple.

It's a possibility, though it may incur some extra overhead as those tags need to be readded to the map before executing each runnable/callable. I'll submit the work as I have it already implemented and if there is a general consensus that MDC is the best place to store and retrieve these labels we can explore that.

@hsaputra
Copy link
Contributor

Will merge this EOD PST if no more comment or concern. Thanks

Copy link
Contributor

@hsaputra hsaputra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM +1

@eolivelli
Copy link
Contributor

@RaulGracia @fpj would you mind to take a look as well?

@hsaputra hsaputra added this to the 4.15.0 milestone Oct 20, 2021
@hsaputra hsaputra merged commit f6903b8 into apache:master Oct 20, 2021
eolivelli pushed a commit that referenced this pull request Oct 27, 2021
#2839)

* Addition of thread-scoped stats

The Counter and OpStatsLogger have new variants that
add threadPool and thread labels to their metrics.
These new variants can be obtained via new methods
in the StatsLogger interface.
Ghatage pushed a commit to sijie/bookkeeper that referenced this pull request Jul 12, 2024
BP-44: USE metrics. A proposal for improving BookKeeper metrics so that operators can employ the USE method for diagnosing performance issues.


Reviewers: Henry Saputra <[email protected]>, Andrey Yegorov <None>, Enrico Olivelli <[email protected]>

This closes apache#2835 from Vanlightly/BP-44-use-metrics and squashes the following commits:

8d9baab [Jack Vanlightly] Added link to USE method and listed each term of USE
5a0f67d [Jack Vanlightly] BP-44 USE metrics
a9b576d [Yunze Xu] Release semaphore when addEntry accepts the same entries (apache#2832)
148bf22 [Yun Tang] Ensure to release cache during KeyValueStorageRocksDB#closec (apache#2821)
4dc4260 [gaozhangmin] Heap memory leak problem when ledger replication failed (apache#2794)
a522fa3 [Raúl Gracia] Issue 2815: Upgrade to log4j2 to get rid of CVE-2019-17571 (apache#2816)
0465052 [Nicolò Boschi] Upgrade httpclient from 4.5.5 to 4.5.13 (apache#2793)
594a056 [Raúl Gracia] Issue 2795: Bookkeeper upgrade using Bookie ID may fail due to cookie mismatch (apache#2796)
354cf37 [Raúl Gracia] Upgraded dependencies with CVEs (apache#2792)
e413c70 [Raúl Gracia] Issue 2728: Entry Log GC may get blocked when using entryLogPerLedgerEnabled option (apache#2779)
883231e [pradeepbn] Building bookkeeper with gradle on java11
Ghatage pushed a commit to sijie/bookkeeper that referenced this pull request Jul 12, 2024
…Counter (apache#2839)

* Addition of thread-scoped stats

The Counter and OpStatsLogger have new variants that
add threadPool and thread labels to their metrics.
These new variants can be obtained via new methods
in the StatsLogger interface.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants