Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Whether the paging function of the http connector can specify the page from which to read #7114

Closed
3 tasks done
gaowudi opened this issue Jul 5, 2024 · 5 comments · Fixed by #7180
Closed
3 tasks done
Assignees

Comments

@gaowudi
Copy link

gaowudi commented Jul 5, 2024

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

The new version of the http connector paging function, can add a start page number reading function.
just like: I want to start reading from page 10 or else, not page 1

Usage Scenario

sometimes the data has been partially synchronized, but new data is constantly generated, and the returned api interface data is added up by page number. I want to read only to the newly added data, can I add reads from the specified number of pages

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@Hisoka-X
Copy link
Member

Hisoka-X commented Jul 9, 2024

make sense to me

@gaowudi
Copy link
Author

gaowudi commented Jul 11, 2024

my idea is to add a parameter "start_size" to the page and use it as the starting parameter of the home page, and I have done experiments, and the desired effect can be achieved after adding parameters

@Hisoka-X
Copy link
Member

my idea is to add a parameter "start_size" to the page and use it as the starting parameter of the home page, and I have done experiments, and the desired effect can be achieved after adding parameters

Could you create a PR to for this feature?

@gaowudi
Copy link
Author

gaowudi commented Jul 11, 2024

ok,I will submit it in two days

Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants