[Q] Web spider to test a website

I'm sure such a tool must exist, but I am having difficulty finding one.

Basically what I am looking for is an application, which I can run under
MacOSX, which will try to follow every link on a site and report back
which ones failed.

Anyone know where I can find such a tool?

In article <1gttlh0.1ux403r1pw61ymN%egusenet@verizon.net>,
egusenet@verizon.net says...
> I'm sure such a tool must exist, but I am having difficulty finding one.
>
> Basically what I am looking for is an application, which I can run under
> MacOSX, which will try to follow every link on a site and report back
> which ones failed.
>
> Anyone know where I can find such a tool?
>
>
not sure about Mac or even if I interpreted the question correctly
(apologies if not) but *my* broken link link is at:
http://home.snafu.de/tilman/xenulink.html

hope it helps (someone)

Dave

DoobieDo <dave@bytext.co.uk> wrote:

> In article <1gttlh0.1ux403r1pw61ymN%egusenet@verizon.net>,
> egusenet@verizon.net says...
> > I'm sure such a tool must exist, but I am having difficulty finding one.
> >
> > Basically what I am looking for is an application, which I can run under
> > MacOSX, which will try to follow every link on a site and report back
> > which ones failed.
> >
> > Anyone know where I can find such a tool?
> >
> >
> not sure about Mac or even if I interpreted the question correctly
> (apologies if not) but *my* broken link link is at:
> http://home.snafu.de/tilman/xenulink.html

Won't run under MacOSX

In article <1gttuid.1gxgnt71b31yrqN%egusenet@verizon.net>,
egusenet@verizon.net says...
> DoobieDo <dave@bytext.co.uk> wrote:
>
> > In article <1gttlh0.1ux403r1pw61ymN%egusenet@verizon.net>,
> > egusenet@verizon.net says...
> > > I'm sure such a tool must exist, but I am having difficulty finding one.
> > >
> > > Basically what I am looking for is an application, which I can run under
> > > MacOSX, which will try to follow every link on a site and report back
> > > which ones failed.
> > >
> > > Anyone know where I can find such a tool?
> > >
> > >
> > not sure about Mac or even if I interpreted the question correctly
> > (apologies if not) but *my* broken link link is at:
> > http://home.snafu.de/tilman/xenulink.html
>
> Won't run under MacOSX
>
how sad (

Eric wrote:

> Apparently, wget has this functionality, but I am having trouble getting
> it to work.

The wget spider ain't great. I'm pretty sure that it won't recursively
check links.

You could try downloading and installing a local copy of the W3C link
checker:
http://search.cpan.org/dist/W3C-LinkChecker/

It is *very* good and not too tricky to set up. Will run as a CGI script,
or from the command line.

--
Toby A Inkster BSc (Hons) ARCS
Contact Me ~ http://tobyinkster.co.uk/contact

Toby Inkster <usenet200503@tobyinkster.co.uk> wrote:

> Eric wrote:
>
> > Apparently, wget has this functionality, but I am having trouble getting
> > it to work.
>
> The wget spider ain't great. I'm pretty sure that it won't recursively
> check links.
>
> You could try downloading and installing a local copy of the W3C link
> checker:
> http://search.cpan.org/dist/W3C-LinkChecker/
>
> It is *very* good and not too tricky to set up. Will run as a CGI script,
> or from the command line.

This appears to be what I was looking for.

Thank you!