4 replies to this topic

[Manixat]

I'm not sure where to post this but ... I want to know how sitemaps work, and I know the basics but I don't understand how is every page supposed to be in the sitemap, meaning that I might have like 500 million IDs in my database, how is that all going to go in the sitemap ?

[requinix]

Exactly the way you might think you have to: do a query to get the IDs and whatever information is necessary to know their URLs, then dump it to a file. (Because caching it in a file will be much better than doing it on demand.)

[Manixat]

so you mean to tell me that the sitemap file has to contain every single possible page and everytime a new ID ( row ) is inserted into a table, which will generate a new instance of a page, I have to add it to the sitemap ?

[requinix]

It doesn't have to, but yeah pretty much.

[Christian F.]

If this is for a forum, or something similar, I'd just add a URL to the forum's front page. Plus any other non-thread/post pages, that might be of interest. I wouldn't bother with the actual threads themselves, since they (as you noted) increase in number and change so often.