Jump to content

Recommended Posts

hi, i use PHP Simple HTML DOM Parser to get some data from another website. Big problem is while my server IP send a hundred requests in a second to source website :( and get blocked :sweat:

So, how i can use users own IP address while parsing a website?

I know about using a proxy with simple php html dom parser but it's another big problem to me  :

Please give me ideas. Thanks

You don't. If your server needs to grab the page and parse it, your server's IP is the one that will be used. There isn't any way to send a request under the end-users IP. If what you are doing is allowed then you won't get blocked. If it is not allowed then you shouldn't be doing it and getting blocked is what should happen.

Use JavaScript to request the external page from the client browser and then send the content to your server via AJAX to be processed and sent back to the client for output.

Edited by Psycho

It doesn't matter what kind of site it is, or what it does.  Kicken's statement is still valid, if you are allowed to scrape it, then you wouldn't get blocked for doing it.  Read the TOS for the site, they may have an API that will do what you are asking, or they may ban it altogether.

Javascript likely won't help you. By default, javascript is restricted to same origin requests only. Unless your target website(s) specifically allow a cross-origin request, the browser will prevent your code from making such requests.

This thread is more than a year old. Please don't revive it unless you have something important to add.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.