Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No matter what I get the challenge URL - is there still no viable solution to this? #466

Open
otonomee opened this issue Dec 9, 2024 · 7 comments

Comments

@otonomee
Copy link

otonomee commented Dec 9, 2024

Using VPN, have tried switching IPs, the log in/out as readme suggests, have tried no VPN, nothing works.

Anyone experience this barrier to such extent and found a way around it?

@ai-unkownpotential
Copy link

@otonomee When you login to linkedin manually, are you being asked to verify identity?

We had the same issue. Once we did their government id verification, it worked fine.

@otonomee
Copy link
Author

@ai-unkownpotential Interesting, good to know - no, not being asked to verify, neither on my verified or alt unverified account. I've never heard of this profile verification being made a requisite, explicitly on front end - am I understanding you correctly?

I've tried manually logging out and back in, VPN, no VPN, etc. I should clarify, I don't see a URL of any kind - I said "challenge URL" in title because this is how same error been referred to.

@ai-unkownpotential
Copy link

@otonomee Correct, we recently got hit with a government identification requirement for an alt account.

I don't think currently it is enforce but LinkedIn/MS will be enforcing this in the future - its to battle data scraping.

Where are you hosting your py app? We found that certain hosting services are always challenged due to the IP range being blocked traffic.

We're now hosting our app on a VM in MS Azure with no proxy service and it works fine. This is great solution because you can install chrome on the VM, authenticate manually and perform any captchas that may be required. Once that is done, the IP is basically considered OK for traffic so the py app works without issues.

@otonomee
Copy link
Author

otonomee commented Dec 13, 2024

@ai-unkownpotential

We're now hosting our app on a VM in MS Azure

May I ask what this runs you cost wise? That is a quite brilliant solution for getting around the verification.

Where are you hosting your py app?

I'm just running local right now. But for another project my team's using scrapingbee to proxy the requests. That you said you're using no proxy got my attention for sure. Thankfully I was able to reverse engineer this library and got it working for current project, but far from ideal because of how slow I feel I must keep it between requests to not get a perm restriction.

LinkedIn/MS will be enforcing this in the future - its to battle data scraping.

They can sure try. Too bad they can't direct these efforts towards making a better product.

@ai-unkownpotential
Copy link

@otonomee

At the moment it is around $85 a month to host.

Do you use discord at all? Maybe good to collab on some of this pieces.

We're also trying to reverse engineer the library for it better suits our needs.

I'm more than happy to walk you through our current setup and how we got this hosted.

Discord: kdiggyy

@otonomee
Copy link
Author

@ai-unkownpotential Request sent! Would appreciate this and perhaps I could be of assistance with RE the library specific to your use case.

Not going to rush to close this ticket just yet.

@nidty719
Copy link

Hey @ai-unkownpotential, I will reach out to you guys on discord too - would love to discuss this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants