Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add shard count to the Elasticsearch index stats scrapper #35858

Open
nathan-maves opened this issue Oct 17, 2024 · 2 comments
Open

Add shard count to the Elasticsearch index stats scrapper #35858

nathan-maves opened this issue Oct 17, 2024 · 2 comments
Labels
enhancement New feature or request needs triage New item requiring triage receiver/elasticsearch Stale

Comments

@nathan-maves
Copy link

nathan-maves commented Oct 17, 2024

Component(s)

receiver/elasticsearch

Is your feature request related to a problem? Please describe.

I was trying to be able to compare 3 dimensions of Elasticsearch index stats document count, shards size and shard count but this receiver only scapes 2 of the 3 from the /_stats endpoint.

Describe the solution you'd like

Add the shard count to the collected metrics for each index. The /users/_stats endpoint contains the total_count for shards.

{
  "_shards": {
    "total": 6,
    "successful": 6,
    "failed": 0
  },
  "_all": {
    "primaries": {
      "docs": {
        "count": 599007114,
        "deleted": 6255158,
        "total_size_in_bytes": 106202644463
      },
      "shard_stats": {
        "total_count": 3
      }
    },
    "total": {
      "docs": {
        "count": 1198014228,
        "deleted": 12506844,
        "total_size_in_bytes": 212356147240
      },
      "shard_stats": {
        "total_count": 6
      }
    }
  },
  "indices": {
    "users": {
      "uuid": "6UqMYhVwS4OwyngTqKG8ow",
      "health": "green",
      "status": "open",
      "primaries": {
        "docs": {
          "count": 599007114,
          "deleted": 6255158,
          "total_size_in_bytes": 106202644463
        },
        "shard_stats": {
          "total_count": 3
        }
      },
      "total": {
        "docs": {
          "count": 1198014228,
          "deleted": 12506844,
          "total_size_in_bytes": 212356147240
        },
        "shard_stats": {
          "total_count": 6
        }
      }
    }
  }
}

Describe alternatives you've considered

No response

Additional context

No response

@nathan-maves nathan-maves added enhancement New feature or request needs triage New item requiring triage labels Oct 17, 2024
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Copy link
Contributor

github-actions bot commented Jan 6, 2025

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs triage New item requiring triage receiver/elasticsearch Stale
Projects
None yet
Development

No branches or pull requests

1 participant