MDanz Posted September 14, 2009 Share Posted September 14, 2009 i hope this isn't difficult i just about finished my site, now i want to populate it. I have an insert form with 4 fields(url, name, info, keywords). i want a webcrawler to go around the web collecting and inserting into these 4 fields and submitting. how would i go about this is it difficult? whats the easiest language to do this in? Quote Link to comment https://forums.phpfreaks.com/topic/174237-solved-building-a-webcrawler/ Share on other sites More sharing options...
paralyzah Posted September 17, 2009 Share Posted September 17, 2009 You cannot have a field containing keywords. Any database field should only hold one piece of information. Keywords are many pieces of information. Your database should have two tables and look something like this: Sites: Key, URL, Name, Info Keywords: ForeignKey, Keyword Quote Link to comment https://forums.phpfreaks.com/topic/174237-solved-building-a-webcrawler/#findComment-919952 Share on other sites More sharing options...
keeps21 Posted September 17, 2009 Share Posted September 17, 2009 You cannot have a field containing keywords. Any database field should only hold one piece of information. Keywords are many pieces of information. Your database should have two tables and look something like this: Sites: Key, URL, Name, Info Keywords: ForeignKey, Keyword That would be the better option. But you could store all the keywords in one field. Then when pulling the keywords out of the database "explode" that field to get the individual keywords. Quote Link to comment https://forums.phpfreaks.com/topic/174237-solved-building-a-webcrawler/#findComment-920016 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.