Jason06 Posted August 20, 2022 Share Posted August 20, 2022 Hey There! Would it be possible to scrape data without an API and display scraped data on my website? There are so many websites that do the same thing; they fetch data without an API and display it. It seems like cURL scrapes data without an API, but I'm not familiar with it. Can anyone assist me? Thanks! Quote Link to comment https://forums.phpfreaks.com/topic/315212-how-to-scrape-data-without-api/ Share on other sites More sharing options...
Barand Posted August 20, 2022 Share Posted August 20, 2022 https://www.php.net/curl Quote Link to comment https://forums.phpfreaks.com/topic/315212-how-to-scrape-data-without-api/#findComment-1599627 Share on other sites More sharing options...
Jason06 Posted August 20, 2022 Author Share Posted August 20, 2022 (edited) The following website is using cURL and scraping data and showing on their website without an API: (removed) Can you recommend any tutorials or websites where I can learn more about cURL from beginner to advance levels. Edited August 23, 2022 by requinix removing link Quote Link to comment https://forums.phpfreaks.com/topic/315212-how-to-scrape-data-without-api/#findComment-1599630 Share on other sites More sharing options...
Solution Barand Posted August 20, 2022 Solution Share Posted August 20, 2022 I did. You could also try entering "curl" in the search box at the top of this page. Quote Link to comment https://forums.phpfreaks.com/topic/315212-how-to-scrape-data-without-api/#findComment-1599631 Share on other sites More sharing options...
gizmola Posted August 23, 2022 Share Posted August 23, 2022 Web pages are just a combination of html, css, static resources like images, video and sound, and javascript. Curl is not some magic scraper tool -- it is just a client library like many client libraries that can simulate the same conversation with a webserver (HTTP protocol) as a browser does. There are numerous PHP client libraries that can also do what curl does. Guzzle, Httpful and Httplug are a few of the most used ones. Depending on what you want to do with code from the pages you are trying to scrape, you might be better off using one of those rather than the wrapper around Curl. Your results depend greatly on what pages you are trying to scrape and the relative complexity of those pages, as well as what you want to try and do with the scraped results. Quote Link to comment https://forums.phpfreaks.com/topic/315212-how-to-scrape-data-without-api/#findComment-1599698 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.