Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improve][Zeta] Split the classloader of task group #7580

Merged
merged 3 commits into from
Sep 27, 2024

Conversation

Hisoka-X
Copy link
Member

@Hisoka-X Hisoka-X commented Sep 4, 2024

Purpose of this pull request

This PR split classloader of task group. Before this PR, the source and sink use same classloader. This will increase the risk of jar dependency conflicts.

Does this PR introduce any user-facing change?

no

How was this patch tested?

add new test.

Check list

@Hisoka-X Hisoka-X linked an issue Sep 4, 2024 that may be closed by this pull request
3 tasks
@github-actions github-actions bot added the Zeta label Sep 4, 2024
@Hisoka-X Hisoka-X changed the title [Improve][Zeta] Spilt the classloader of task group [Improve][Zeta] Split the classloader of task group Sep 4, 2024
@hailin0
Copy link
Member

hailin0 commented Sep 4, 2024

good job

@Hisoka-X Hisoka-X force-pushed the taskgroup-classloader branch from 700f2ac to b041fc8 Compare September 5, 2024 02:21
@github-actions github-actions bot added the CI&CD label Sep 5, 2024
@Hisoka-X Hisoka-X added this to the 2.3.8 milestone Sep 5, 2024
@Hisoka-X Hisoka-X marked this pull request as ready for review September 5, 2024 07:53
@Hisoka-X Hisoka-X force-pushed the taskgroup-classloader branch from cfd221b to 0be3497 Compare September 5, 2024 08:02
@Hisoka-X Hisoka-X force-pushed the taskgroup-classloader branch from a739f54 to 6928753 Compare September 5, 2024 10:29
@hailin0
Copy link
Member

hailin0 commented Sep 12, 2024

link #7646

@@ -81,7 +80,7 @@ public HiveSourceConfig(ReadonlyConfig readonlyConfig) {
readonlyConfig
.getOptional(HdfsSourceConfigOptions.READ_PARTITIONS)
.ifPresent(this::validatePartitions);
this.table = HiveTableUtils.getTableInfo(readonlyConfig);
Table table = HiveTableUtils.getTableInfo(readonlyConfig);
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Avoid conflicts in the logical dag phase of Hive

@Hisoka-X Hisoka-X requested a review from hailin0 September 19, 2024 08:30
Copy link
Member

@hailin0 hailin0 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@Carl-Zhou-CN Carl-Zhou-CN left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@Hisoka-X Hisoka-X merged commit 3be0d1c into apache:dev Sep 27, 2024
6 checks passed
fcb-xiaobo pushed a commit to fcb-xiaobo/seatunnel that referenced this pull request Oct 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants