feat(inc-984): Cleanup EAP spans

[xurui-c]

doing #6673

differences:

• changed the UPDATE query
• changed the StorageSetKey
• Added test_span_is_scrubbed

[xurui-c]

I just added the col name attr_str_1 in the end because https://clickhouse.com/docs/en/sql-reference/functions/tuple-map-functions#mapapply

[xurui-c]

this is the extra test i added

[codecov]

❌ 1 Tests Failed:

Tests completed	Failed	Passed	Skipped
1171	1	1170	3

View the top 1 failed tests by shortest run time

tests.manual_jobs.test_scrub_ips_from_eap_spans::test_generate_query

Stack Traces | 0.009s run time

Traceback (most recent call last):
  File ".../tests/manual_jobs/test_scrub_ips_from_eap_spans.py", line 110, in test_generate_query
    assert (
AssertionError: assert ('ALTER TABLE eap_spans_2_local\n'\n '\n'\n "UPDATE `attr_str_1` = mapApply((k, v) -> (k, if(k = 'user.ip', 'scrubbed', "\n 'v)), `attr_str_1`)\n'\n 'WHERE organization_id IN [1,3,5,6]\n'\n "AND _sort_timestamp >= toDateTime('2024-12-01T00:00:00')\n"\n "AND _sort_timestamp < toDateTime('2024-12-10T00:00:00')") == ('ALTER TABLE eap_spans_2_local\n'\n '\n'\n "UPDATE `attr_str_1` = mapApply((k, v) -> (k, if(k = 'user.ip', 'scrubbed', "\n 'v)), `attr_str_1`)\n'\n 'WHERE organization_id IN [1,3,5,6]\n'\n "AND _sort_timestamp > toDateTime('2024-12-01T00:00:00')\n"\n "AND _sort_timestamp <= toDateTime('2024-12-10T00:00:00')")
    ALTER TABLE eap_spans_2_local
    
    UPDATE `attr_str_1` = mapApply((k, v) -> (k, if(k = 'user.ip', 'scrubbed', v)), `attr_str_1`)
    WHERE organization_id IN [1,3,5,6]
  - AND _sort_timestamp > toDateTime('2024-12-01T00:00:00')
  + AND _sort_timestamp >= toDateTime('2024-12-01T00:00:00')
  ?                      +
  - AND _sort_timestamp <= toDateTime('2024-12-10T00:00:00')
  ?                      -
  + AND _sort_timestamp < toDateTime('2024-12-10T00:00:00')

To view more test analytics, go to the Test Analytics Dashboard
📢 Thoughts on this report? Let us know!

[volokluev]

remove the print statement and we're good

[sentry-io]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ KeyError: 'organization_ids' execute_job View Issue

_{Did you find this useful? React with a 👍 or 👎}