Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What do those benchmarks measure? #17

Open
983 opened this issue Mar 19, 2016 · 2 comments
Open

What do those benchmarks measure? #17

983 opened this issue Mar 19, 2016 · 2 comments

Comments

@983
Copy link

983 commented Mar 19, 2016

The README says "All benchmarks measure throughput; higher score is better." but there is no explanation of what "throughput" is. I assume that one "throughput" is how often the operation listed at the top of each image can be executed in one second. I tried to find the actual information in the source code and now I'm not sure because it might also be [https://github.com/junkdog/entity-system-benchmarks/blob/8e13b8e3d4c904a444e68ba09b176770e413e397/common/src/main/java/com/github/esfbench/JmhSettings.java](10 seconds) or that file might be something entirely different. Who knows.

Anyway, I think that it would be nice if the essential information was apparent from the README.

@junkdog
Copy link
Owner

junkdog commented Mar 19, 2016

Hi, yeah, the README could definitely do with some improvements; I'll attend to it in the near future. Been holding off a general overhaul.

In the meantime;

I assume that one "throughput" is how often the operation listed at the top of each image can be executed in one second.

Correct. The different types of benchmarks in README#benchmarks-explained describe a single op/execution.

JmhSettings

JmhSettings contains the shared configuration for all benchmarks.

The raw logs can be found here: https://github.com/junkdog/entity-system-benchmarks/tree/master/results

Anyway, I think that it would be nice if the essential information was apparent from the README.

I'll ping you when it's been updated.

@983
Copy link
Author

983 commented Mar 19, 2016

Very nice! Thanks for clarification :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants