Jump to content

Data aggregation, scripting & MySQL


marvinzzz

Recommended Posts

Hello PHP pros!

 

Pardon my ignorance, I'm an utter newb!

So I'm building an aggregator website and I was wanted to ask some questions about the process, logic and workflow behind maintaining the data.

 

I have around 20 different products from different suppliers that are in PDF or XLS format. Each supplier describes their product information in a different way so this means that I obviously can't just extract product data using ONE mechanism.. I need 20. Further, product data changes once every while, so I don't want to manually have to maintain the database. I need a system that can be run to extract data from PDF/XLS sources to reduce overhead.

 

So I have the following questions please:

  • What is the 'best' way to go about my problem: extracting data from raw sources, converting it into a standard form, inserting into MySQL, scripting the automation process, etc? Can you explain broadly the basic steps required to do what I need?
  • Should I look to convert the PDF/XLS files into HTML/CSV/Text files/some other format? What is the 'best' format to convert my source documents into assuming that my website is in PHP/MySQL and why?

 

Any ideas/suggestions? Thanks!

Link to comment
https://forums.phpfreaks.com/topic/194870-data-aggregation-scripting-mysql/
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.