[UPHPU] site map builder.

[Orson Jones]

I am trying to build a site map for development use. This is to say I want to point a program at my website and have it crawl the entire thing and build a database of what pages link to what. Being able to get a listing of every page on the site would be a requirement. Being able to see what pages link to a specific page would be very useful. It also would be nice to have it auto trim session id tags from the urls too. (Website doesn't track using cookies on this particular setup.)

In looking for webcrawling software I seem pointed at wget, but I don't want to keep every page. I already have that. I mainly want to know how my links are, look for forgotten links, etc.

Any ideas out there?

Thanks,
Orson