[UPHPU] site map builder.
Scott Hill
llihttocs at gmail.com
Wed Nov 8 15:52:37 MST 2006
On 11/8/06, Orson Jones <orson.uphpu at bookstore.usu.edu> wrote:
>
> I am trying to build a site map for development use. This is to say I want
> to point a program at my website and have it crawl the entire thing and
> build a database of what pages link to what. Being able to get a listing of
> every page on the site would be a requirement. Being able to see what pages
> link to a specific page would be very useful. It also would be nice to have
> it auto trim session id tags from the urls too. (Website doesn't track using
> cookies on this particular setup.)
>
> In looking for webcrawling software I seem pointed at wget, but I don't
> want to keep every page. I already have that. I mainly want to know how my
> links are, look for forgotten links, etc.
>
> Any ideas out there?
Firefox developer tool bar on the information drop-down menu has a "View
Link Information" that will tell you a lot about the current page. The
tools menu has a "Validate Links" option that uses the W3C link checker.
--
Scott Hill
"May you solve interesting problems" - Author Unknown
"A fanatic is one who can't change his mind and won't change the subject." -
Sir Winston Churchill
More information about the UPHPU
mailing list