Jump to content

dolke022

New Members
  • Posts

    7
  • Joined

  • Last visited

dolke022's Achievements

Newbie

Newbie (1/5)

0

Reputation

  1. Guys from what you have to say on this topic, I'm quite sure that I'm not suited enough to deal with this type of task. Does someone of you care helping me make this script? Of course I would be willing to discuss about honorarium. Also, we doesn't need to fulfill all the requests that I had. Lets start with 1 or 2 URLs and then we can add more methods to the script. Anyone interested? Cheers Dean
  2. I appreciate everyone's help and arguments don't get me wrong and I'm glad this discussion made so far and so wide. Still I'm not sure that you guys are viewing this from the right perspective. I will try to clarify even further... Dan is right when he say that I need this competitive intel so I can set my own prices accordingly. On the other hand, I'm not doing searches against them, and I'm not pulling any kind of catalogs but sometimes I do use some valuable intel and use it for my website. They all do the same because my website is the first in the filed atm. I noticed that you are mostly from the US. Well, I'm from Serbia and due to lack of certain rules and regulations, especially when it comes to internet sales this is legit. I'm browsing these websites on a daily basis so I could manually search all these products, find their prices and update my own accordingly. So basically I'm trying to find automatic way of doing so, not needing to browse to each od these sites, checking if they even have this product and then checking the price and then finally set my own accordingly. I want to automate process, not necessarily make it faster. If this is a spammer task maybe some timeouts between each req to the server might be a good solution. Its legit even in the states, at least if you doing this manually and believe me I wont be needing a lawyer here, at least not yet Actually I don't care how this will be implemented. DB or not. Desktop application or web, php some other language. In short words I need results to be similar to: http://prntscr.com/4edui6 Also I know 25 results per page cant happen because my keywords are original spare part codes and results can be: 0 or 1 product Layout in the out of the stock scenario is the same for all these websites. I have checked multiple times.
  3. Guys, thank you for detailed explanation. I found this whole thing much clear now. Psycho asked what if there are a lot of matches that are on separate pages? This cant happen. Also there are no separate pages. Search result is the only page from which data (price) is extracted so it can only be multiple matches on that single result page. Also, it doesn't matter if it out of stock or not. Script will try to find the price (Im guessing each shop has this price in some specific tag or format I dont know...) so if the product is out of stock and price next to it is no more, script will return noting, a blank field in the CSV file... Or Im getting this all wrong... Btw you said that I need to build a DB and then run through it manually. This is not an option. Also, asking my competitors for a full list of their product with prices is mission impossible.
  4. Well, making local copies of these websites doesn't make much sense because I'm comparing prices right... Lets say that I'm making these comparisons twice a week. That means that I would need to download local copies of 10 websites twice a week prior of running a script because prices that I want to extrude might be changed in the meantime... Can you explain to me why would request took so long? I'm really new with php and my knowledge is quite limited. Also, why need for a multiple scripts?
  5. Thank you for replaying but I believe that you didn't actually caught what I'm trying to make. Sites that I want to search are not owned by me. They are random websites from my country as well as from other countries. What they all have in common is the field of business (spare parts for home appliances). I don't want to index them nor do I need all information that they contain. All I want to check if these websites have item/product that has this keyword somewhere in its name or description and display its price in a CSV format. Reason for using CSV files is because I want to automate this process in order to check the same thing for multiple keywords on multiple website. I don't need results to be stored in a DB, nowhere near that complex. Please note: I'm not trying to make a website. Just single web page that will execute this script. It actually doesn't need to be a webpage at all. If I can make it work as a standalone desktop application that solution works for me to...
  6. Hi ginerjm, No, they are not identical although some of them are using same engines like Prestashop, Magento and so on... What I heard from some people that I talked to, search function is using search html box or some similar element so I guess script that I'm trying to make will go through the whole webpage (homepage) and try to find these search function-specific elements in order to locate it. This is also in ? and that is one of the reasons I need help from this community
  7. Hi guys, What I'm trying to accomplish sounds like fairly easy task but due to my poor knowledge of php this turned to be quite a challenge. What I'm trying to do is to make a php script that will search the keywords on the multiple websites. Websites that I will search are all web shops, selling spare part for home appliances and keywords used are usually original spare part codes. When searching, script is searching these websites using their own search functions and not Google or other search engines. Input for this script should be a CSV file containing list of keywords and URLs of the web shops that needs to be search for all these keywords. Here is the example: http://prntscr.com/4ebhxh Script should perform like this: It picks up the 1st keyword, browse to the URL1, uses its search, searches for the product, if it finds it, copy its price and write it back to original input CSV. If it doesn't find match (search results appear empty) it should write "no match found" and continue to URL2, URL3 and so on... When all URLs from the list are checked for the 1st keyword, scripts picks up 2nd keyword and continues on through all these keywords are not checked. This would be a resulting CSV file after the 1st keyword is checked: http://prntscr.com/4ebj52 After all data from the input CSV file are processed, script should prompt a msg and create a download link for that CSV file to be downloaded. If there are multiple matches, in other words if for one keyword some of the website searches find 2 or more products, something like "More then one match" should be written in the file. Example: http://prntscr.com/4ebkcx Please note that non of the website is using SSL and non of them requires login in order to display the prizes. This fact should make this script easier to build. Its not important for this script to run fast (its better I think to run it with some timeouts because of the server glitches and bottlenecks). What is more important is to make it automatic so one can start it over the night, over the weekends. Number of the URLs would be around 10, and list of keywords from few tens, to a few hundred. If I can provide some additional clarification and info I'm available. Of course I would be willing to pay someone to help me accomplish this task. Cheers Dean
×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.