On Sun, 30 Nov 2008 23:38:10 +0100, Tono wrote:

>Hi
>
>How can I check with Xenu the links like?
>
><option value="../../../../../amateurs/index.htm">Index</option>

not at all. IIRC, the "option" thing isn't really well defined...
sometimes its an url, sometimes its javascript...

Tilman

----- Original Message -----

From: Tilman Hausherr

To: xenu-usergroup@...

Sent: Monday, December 01, 2008 8:14 PM

Subject: Re: [xenu-usergroup] OPTION instruction

On Sun, 30 Nov 2008 23:38:10 +0100, Tono wrote:

>Hi
>
>How can I check with Xenu the links like?
>
><option value="../../../../../amateurs/index.htm">Index</option>

not at all. IIRC, the "option" thing isn't really well defined...
sometimes its an url, sometimes its javascript...

Tilman

I also looked on these pages:
http://de.selfhtml.org/javascript/objekte/options.htm
http://de.selfhtml.org/html/formulare/auswahl.htm

it is used to chose different values in a form. It doesn't have to be an
URL.

Tilman

On Mon, 1 Dec 2008 20:54:45 +0100, Tono wrote:

>It would be useful an instruction to process such intructions, in some cases.
>
>  ----- Original Message -----
>  From: Tilman Hausherr
>  To: xenu-usergroup@yahoogroups.com
>  Sent: Monday, December 01, 2008 8:14 PM
>  Subject: Re: [xenu-usergroup] OPTION instruction
>
>
>  On Sun, 30 Nov 2008 23:38:10 +0100, Tono wrote:
>
>  >Hi
>  >
>  >How can I check with Xenu the links like?
>  >
>  ><option value="../../../../../amateurs/index.htm">Index</option>
>
>  not at all. IIRC, the "option" thing isn't really well defined...
>  sometimes its an url, sometimes its javascript...
>
>  Tilman
>
>
>
>

There's a guy (Kevin Niehage) who has written a tool to convert the Xenu
"Page Map" output to an input for the Graphviz software:
http://en.wikipedia.org/wiki/Xenu%27s_Link_Sleuth#Graphical_output

I could easily make an export in Xenu itself, if anyone is interested.
I've already made a test (based on the source code of Kevin) but it
isn't a menu item yet.

So if you need it, please say so.

Tilman

Hello,

I've been using xenu to scan a large website that forks in to several
pages (that I'd also like to scan) protected with htaccess.

The problem is that it's difficult for me to tell which page it's
hitting, and consequently what password to enter. Is there anyway to
get it to display the URL of the page along with the htaccess
authentication window?

- Craig

You'd need to set AuthName in the .htaccess file.

Tilman

On Tue, 2 Dec 2008 23:41:13 -0700, Craig Talbert wrote:

>Hello,
>
>I've been using xenu to scan a large website that forks in to several
>pages (that I'd also like to scan) protected with htaccess.
>
>The problem is that it's difficult for me to tell which page it's
>hitting, and consequently what password to enter. Is there anyway to
>get it to display the URL of the page along with the htaccess
>authentication window?
>
>- Craig
>
>------------------------------------
>
>Yahoo! Groups Links
>
>
>

I probably should have said: I don't have write access to all of these
sites, although I need to audit them anyway.

- Craig

On Wed, Dec 3, 2008 at 12:31 AM, Tilman Hausherr <tilman@...> wrote:
> You'd need to set AuthName in the .htaccess file.
>
> Tilman
>
> On Tue, 2 Dec 2008 23:41:13 -0700, Craig Talbert wrote:
>
>>Hello,
>>
>>I've been using xenu to scan a large website that forks in to several
>>pages (that I'd also like to scan) protected with htaccess.
>>
>>The problem is that it's difficult for me to tell which page it's
>>hitting, and consequently what password to enter. Is there anyway to
>>get it to display the URL of the page along with the htaccess
>>authentication window?
>>
>>- Craig
>>
>>------------------------------------
>>
>>Yahoo! Groups Links
>>
>>
>>
>

There's nothing I can do with Xenu, because the dialogbox is popped open
by a MSIE component that Xenu uses. Xenu itself does not even "know" the
passwords, because this is all encapsulated in MSIE.

What you could try is to access the protected URLs with MSIE, and check
"remember for next time" (don't know the exact language), and then run
Xenu.

Tilman

On Wed, 3 Dec 2008 00:38:11 -0700, Craig Talbert wrote:

>I probably should have said: I don't have write access to all of these
>sites, although I need to audit them anyway.
>
>- Craig
>
>On Wed, Dec 3, 2008 at 12:31 AM, Tilman Hausherr <tilman@...> wrote:
>> You'd need to set AuthName in the .htaccess file.
>>
>> Tilman
>>
>> On Tue, 2 Dec 2008 23:41:13 -0700, Craig Talbert wrote:
>>
>>>Hello,
>>>
>>>I've been using xenu to scan a large website that forks in to several
>>>pages (that I'd also like to scan) protected with htaccess.
>>>
>>>The problem is that it's difficult for me to tell which page it's
>>>hitting, and consequently what password to enter. Is there anyway to
>>>get it to display the URL of the page along with the htaccess
>>>authentication window?
>>>
>>>- Craig
>>>
>>>------------------------------------
>>>
>>>Yahoo! Groups Links
>>>
>>>
>>>
>>
>
>------------------------------------
>
>Yahoo! Groups Links
>
>
>

On Wed, 3 Dec 2008 11:16:11 +0100, Ignacio Seron wrote:

>Hi Tilman,
>
>Graphviz it is a interesting application,  I didn't knew the existence.
>
>I think implement the conversion to Graphviz doesn't hurt( if it is not  too
>much work) . But I noticed if you have big URLs (more than 200 characters)
>the graph will be impossible to read. So maybe the conversion should use
>also parameters that  make the necessary spaces.

I've now uploaded a new beta at
http://home.snafu.de/tilman/tmp/xenubeta.zip

The GraphViz export is in the menu.

>In other point, I think it could be good to add and Extra column for the
>page map, this means to add a *OriginPageTitle*
>The title of the origin page could save extra time.
>
>The actual map delivers:
>*OriginPage    LinkToPage    LinkToPageStatus    LinkToPageTitle
>OriginPageDate*
>
>Only if it doesn't consume too much time.

ok, done too. Tell me if it works as intended.

Tilman

>
>Your tool is really helpful
>
>Mir freundliche Grüße.
>Ignacio.
>
>
>
>
>
>2008/12/2 Tilman Hausherr <tilman@...>
>
>>   There's a guy (Kevin Niehage) who has written a tool to convert the Xenu
>> "Page Map" output to an input for the Graphviz software:
>> http://en.wikipedia.org/wiki/Xenu%27s_Link_Sleuth#Graphical_output
>>
>> I could easily make an export in Xenu itself, if anyone is interested.
>> I've already made a test (based on the source code of Kevin) but it
>> isn't a menu item yet.
>>
>> So if you need it, please say so.
>>
>> Tilman
>>
>>
>>

When running Xenu I get the report after Xenu is done checking the
site that reports the broken links. I want to check all the links on
my site excluding external. I run the link checker and uncheck "check
external links". I see a two options under the file menu-

1. Export to tab separated file
2. Export page map to separated file

Are any of these the option I use to export the list of total links to
a file or excel that Xenu checked on the site?

Yes, the first one.

Tilman

On Wed, 10 Dec 2008 16:24:20 -0000, hassanm_321 wrote:

>When running Xenu I get the report after Xenu is done checking the
>site that reports the broken links. I want to check all the links on
>my site excluding external. I run the link checker and uncheck "check
>external links". I see a two options under the file menu-
>
>1. Export to tab separated file
>2. Export page map to separated file
>
>Are any of these the option I use to export the list of total links to
>a file or excel that Xenu checked on the site?
>
>
>------------------------------------
>
>Yahoo! Groups Links
>
>
>

I've quietly released version 1.3, and haven't made the announcement in
the other mailing list yet (will do this in a few days):
http://home.snafu.de/tilman/XENU.ZIP

The major improvements are the international charset, the google maps,
the "ID=" anchor and the GraphViz export.

Tilman

----- Original Message -----

From: Tilman Hausherr

To: xenu-usergroup@...

Sent: Saturday, December 20, 2008 6:40 PM

Subject: [xenu-usergroup] Version 1.3 released

I've quietly released version 1.3, and haven't made the announcement in
the other mailing list yet (will do this in a few days):
http://home.snafu.de/tilman/XENU.ZIP

The major improvements are the international charset, the google maps,
the "ID=" anchor and the GraphViz export.

Tilman

On Sat, 20 Dec 2008 20:00:57 +0100, Tono wrote:

>Does this new version work with wildcard?

No, the wildcard version is still separate, is at
http://home.snafu.de/tilman/tmp/xenuwild.zip

If you need the new features, tell me and I'll upload a current version
there.

Tilman

>
>
>  ----- Original Message -----
>  From: Tilman Hausherr
>  To: xenu-usergroup@yahoogroups.com
>  Sent: Saturday, December 20, 2008 6:40 PM
>  Subject: [xenu-usergroup] Version 1.3 released
>
>
>  I've quietly released version 1.3, and haven't made the announcement in
>  the other mailing list yet (will do this in a few days):
>  http://home.snafu.de/tilman/XENU.ZIP
>
>  The major improvements are the international charset, the google maps,
>  the "ID=" anchor and the GraphViz export.
>
>  Tilman
>
>
>

On Sat, 20 Dec 2008 14:11:06 -0500, Debbie Pomerance wrote:

>What is the wildcard version?
>
>
>Debbie

Its a version that allows "*" in URLs to include or exclude. This is for
people who have unflexible CMS :-)

Tilman

Dear Tilman,

Does version 1.3 include wild character option?

Israel

On Mon, 22 Dec 2008 21:11:35 +0200, Israel Hanukoglu wrote:

>
>Does version 1.3 include wild character option?

No, the wildcard version is still separate, is at
http://home.snafu.de/tilman/tmp/xenuwild.zip

If you need the new features, tell me and I'll upload a current version
there.

Tilman

--- In xenu-usergroup@yahoogroups.com, Tilman Hausherr <tilman@...> wrote:
>
> I've quietly released version 1.3, and haven't made the announcement in
> the other mailing list yet (will do this in a few days):
> http://home.snafu.de/tilman/XENU.ZIP
>
> The major improvements are the international charset, the google maps,
> the "ID=" anchor and the GraphViz export.
>
> Tilman
Do love the possibility to create a sitemap. Have done it now for quite a while
in your beta

Howevern in the final release, when one use File -->Report it first try´s to
start making a
sistemap and it goes one for quite a time. If I press Abort in the dialog box I
now get the
report but no sitemap. I do that OK by manually  File --> Create Google sitemap
file

Is this a bug? I am using  Firefox/3.0.5.

  With Internet Explorer 8 beta I do get a report ( after closong create a
sitemap) but when I
mouse click i.e. Broken links, broken links, ordered by links, nothing happens

On Wed, 07 Jan 2009 18:50:52 -0000, Lars Ekdahl wrote:

>--- In xenu-usergroup@yahoogroups.com, Tilman Hausherr <tilman@...> wrote:
>>
>> I've quietly released version 1.3, and haven't made the announcement in
>> the other mailing list yet (will do this in a few days):
>> http://home.snafu.de/tilman/XENU.ZIP
>>
>> The major improvements are the international charset, the google maps,
>> the "ID=" anchor and the GraphViz export.
>>
>> Tilman
>Do love the possibility to create a sitemap. Have done it now for quite a while
in your beta
>
>Howevern in the final release, when one use File -->Report it first try´s to
start making a
>sistemap and it goes one for quite a time. If I press Abort in the dialog box I
now get the
>report but no sitemap. I do that OK by manually  File --> Create Google sitemap
file

The sitemap in the report (can take a long time) and the google sitemap
are different things.

>
>Is this a bug? I am using  Firefox/3.0.5.
>
> With Internet Explorer 8 beta I do get a report ( after closong create a
sitemap) but when I
>mouse click i.e. Broken links, broken links, ordered by links, nothing happens

Can't comment without having a look. Send me the report to tilman at
snafu dot de, and a .XEN file as well.

Tilman

>
>
>------------------------------------
>
>Yahoo! Groups Links
>
>
>

Hello,

in my link report I get for
http://www.liv.ac.uk/
error code: 400 (no object data), linked from page(s): ...
Can anybody tell what this means? The page looks normal to me.

Best regards
Thomas

–––
Dr. Thomas Fischer
Metadata and Databases
Göttingen State and University Library
37070 Göttingen
Germany
Tel.: +49 551 393883
and   +43 662 621498

On Wed, 28 Jan 2009 17:19:48 +0100, Thomas Fischer wrote:

>Hello,
>
>in my link report I get for
>http://www.liv.ac.uk/
>error code: 400 (no object data), linked from page(s): ...
>Can anybody tell what this means? The page looks normal to me.

Talk to the sysadmin of that site. The site works fine when I change the
Xenu user agent to the one of a browser. In other words - the site
doesn't want to be scanned by Xenu.

Tilman

>
>Best regards
>Thomas
>
>–––
>Dr. Thomas Fischer
>Metadata and Databases
>Göttingen State and University Library
>37070 Göttingen
>Germany
>Tel.: +49 551 393883
>and   +43 662 621498
>
>
>------------------------------------
>
>Yahoo! Groups Links
>
>
>

Tilman Hausherr wrote:
> On Wed, 28 Jan 2009 17:19:48 +0100, Thomas Fischer wrote:
>
>> Hello,
>>
>> in my link report I get for
>> http://www.liv.ac.uk/
>> error code: 400 (no object data), linked from page(s): ...
>> Can anybody tell what this means? The page looks normal to me.
>
> Talk to the sysadmin of that site. The site works fine when I change
> the Xenu user agent to the one of a browser. In other words - the site
> doesn't want to be scanned by Xenu.
>
> Tilman

I flagged this one up last August - I have
http://www.liv.ac.uk/Chemistry/links/index.html on my site and Xenu always
gets an error back.


Ron Jones
Process Safety & Development Specialist
Don't repeat history, unreported chemical lab/plant near misses at
http://www.crhf.org.uk Only two things are certain: The universe and
human stupidity; and I'm not certain about the universe. ~ Albert
Einstein

Thank you, Tilman.

So this amount pretty much to the same as

error code: 403 (forbidden request)
e.g. from http://arxiv.org/

Could you create a way to exclude these from the error report, since they
are only distracting and cannot be corrected anyway?

Cheers
Thomas

––––

>Hello,
>
>in my link report I get for
>http://www.liv.ac.uk/ <http://www.liv.ac.uk/>
>error code: 400 (no object data), linked from page(s): ...
>Can anybody tell what this means? The page looks normal to me.

Talk to the sysadmin of that site. The site works fine when I change the
Xenu user agent to the one of a browser. In other words - the site
doesn't want to be scanned by Xenu.

Tilman

On Thu, 29 Jan 2009 09:04:24 +0100, Thomas Fischer wrote:

>Thank you, Tilman.
>
>So this amount pretty much to the same as
>
>error code: 403 (forbidden request)
>e.g. from http://arxiv.org/
>
>Could you create a way to exclude these from the error report, since they
>are only distracting and cannot be corrected anyway?

No - sometimes such errors are real errors. You'll never get a 100%
result. There's always something.

Alternatively, you could add such an URL to the exclusion list. I have
done this for google groups.

Tilman

>
>Cheers
>Thomas
>
>––––
>
>>Hello,
>>
>>in my link report I get for
>>http://www.liv.ac.uk/ <http://www.liv.ac.uk/>
>>error code: 400 (no object data), linked from page(s): ...
>>Can anybody tell what this means? The page looks normal to me.
>
>Talk to the sysadmin of that site. The site works fine when I change the
>Xenu user agent to the one of a browser. In other words - the site
>doesn't want to be scanned by Xenu.
>
>Tilman
>
>
>------------------------------------
>
>Yahoo! Groups Links
>
>
>

http://home.snafu.de/tilman/tmp/xenubeta.zip
Install this version if you're in China, or use Windows 98, or check
sites with over a million URLs (or think that Xenu uses too much memory
space). Or install it anyway to make me a favour, to see if it runs
fine.

The China problem is a weird one - apparently, conversion to upper case
doesn't work properly there, which resulted in a closing </SCRIPT>
element not being found. Only two chinese users complained, and only the
second one had the time to make tests with me to find out what was going
on. And then stopped responding after I made the change :-(

Tilman

Hello,
A fan made a new help file, now as a .CHM file. It is uploaded here:
http://home.snafu.de/tilman/tmp/xenu.chm
It is more up-to-date than the old .HLP files. If I don't hear any
protests, I'll include it in the next release.
Tilman

How would I determine where Xenu puts its reports... specifically how
does it name those files? Better still, is there any way to configure
that naming/saving process?