Hello:

I was wondering if someone can help me.  I am trying to test our site
but to enter our site, the developer says this can be done through
javascript which Xenu could not handle or he said through a user agent
string.  If the tool will let me manipulate the user agent string,
there is a back door entry that the developer has created that can let
me in if I can manipulate the user agent so that way I can go in
through the back door.

Sorry for the vagueness. I am new to this.

Thanks

Haseeb

On Mon, 01 Aug 2005 23:53:07 -0000, habibknight wrote:

>Hello:
>
>I was wondering if someone can help me.  I am trying to test our site
>but to enter our site, the developer says this can be done through
>javascript which Xenu could not handle or he said through a user agent
>string.  If the tool will let me manipulate the user agent string,
>there is a back door entry that the developer has created that can let
>me in if I can manipulate the user agent so that way I can go in
>through the back door.
>
>Sorry for the vagueness. I am new to this.

Hi,

I don't offer a variable user agent, because of the abuse potential.

If the developer has a "back door", then why can't he change the server
so that it handles Xenu like any other browser?

One (possible) alternative is to login through IE, then continue with
Xenu. However you need to activate cookies. This - including the risks -
is explained in the FAQ.

Tilman

Hi,

I am an extremely new user to xenu link checker and am trying to check a secured
site (https://www-lite2/..........). Xenu shows the status of the site as "SSL
certificate common name incorrect" . Does anyone know what this error means? Has
anyone faced a similar problem or can someone suggest what can be done to
resolve it. Really appreciate any help on this one.

Thanks,
Kanchan

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

[Non-text portions of this message have been removed]

Hi  Haseeb,
I think we need some more details...
What is the site URL?
Clive

habibknight wrote:
> Hello:
>
> I was wondering if someone can help me.  I am trying to test our site
> but to enter our site, the developer says this can be done through
> javascript which Xenu could not handle or he said through a user agent
> string.  If the tool will let me manipulate the user agent string,
> there is a back door entry that the developer has created that can let
> me in if I can manipulate the user agent so that way I can go in
> through the back door.
>
> Sorry for the vagueness. I am new to this.
>
> Thanks
>
> Haseeb
>
>
>
>
>
>
> ------------------------------------------------------------------------
> YAHOO! GROUPS LINKS
>
>     *  Visit your group "xenu-usergroup
>       <http://groups.yahoo.com/group/xenu-usergroup>" on the web.
>
>     *  To unsubscribe from this group, send an email to:
>        xenu-usergroup-unsubscribe@yahoogroups.com
>       <mailto:xenu-usergroup-unsubscribe@yahoogroups.com?subject=Unsubscribe>
>
>     *  Your use of Yahoo! Groups is subject to the Yahoo! Terms of
>       Service <http://docs.yahoo.com/info/terms/>.
>
>
> ------------------------------------------------------------------------
>


[Non-text portions of this message have been removed]

On Wed, 3 Aug 2005 11:19:25 -0700 (PDT), Kanchan Mehrotra wrote:

>Hi,
>
>I am an extremely new user to xenu link checker and am trying to check a
secured site (https://www-lite2/..........). Xenu shows the status of the site
as "SSL certificate common name incorrect" . Does anyone know what this error
means? Has anyone faced a similar problem or can someone suggest what can be
done to resolve it. Really appreciate any help on this one.

http://msdn.microsoft.com/library/en-us/wininet/wininet/wininet_errors.asp


ERROR_INTERNET_SEC_CERT_CN_INVALID
12038
SSL certificate common name (host name field) is incorrect—for example,
if you entered www.server.com and the common name on the certificate
says www.different.com.

yeah i did find that ... but wasn't sure if this is a genuine error in the SSL
certificate common name or this error was shown coz xenu couldnot access this
secure site.

Tilman Hausherr <tilman@...> wrote:On Wed, 3 Aug 2005 11:19:25 -0700 (PDT),
Kanchan Mehrotra wrote:

>Hi,
>
>I am an extremely new user to xenu link checker and am trying to check a
secured site (https://www-lite2/..........). Xenu shows the status of the site
as "SSL certificate common name incorrect" . Does anyone know what this error
means? Has anyone faced a similar problem or can someone suggest what can be
done to resolve it. Really appreciate any help on this one.

http://msdn.microsoft.com/library/en-us/wininet/wininet/wininet_errors.asp


ERROR_INTERNET_SEC_CERT_CN_INVALID
12038
SSL certificate common name (host name field) is incorrect—for example,
if you entered www.server.com and the common name on the certificate
says www.different.com.







Yahoo! Groups Links









---------------------------------
  Start your day with Yahoo! - make it your home page

[Non-text portions of this message have been removed]

Hi Tillman:

Thanks.  We did what you said and basically set the cookie through
IE.  I'm trying to understand something.  Does Xenu use the cookies
from IE?  So if I visit a website in IE that requires a login the
first time and sets a persistent cookie with my encrypted login info
thereby not requiring me to login on future visits.

  Now If I hit this site with Xenu with the cookie option enabled,
does Xenu pickup my IE cookie and therefore will let me spider the
site?

Thanks
Haseeb



--- In xenu-usergroup@yahoogroups.com, Tilman Hausherr <tilman@s...>
wrote:
> On Mon, 01 Aug 2005 23:53:07 -0000, habibknight wrote:
>
> >Hello:
> >
> >I was wondering if someone can help me.  I am trying to test our
site
> >but to enter our site, the developer says this can be done through
> >javascript which Xenu could not handle or he said through a user
agent
> >string.  If the tool will let me manipulate the user agent string,
> >there is a back door entry that the developer has created that can
let
> >me in if I can manipulate the user agent so that way I can go in
> >through the back door.
> >
> >Sorry for the vagueness. I am new to this.
>
> Hi,
>
> I don't offer a variable user agent, because of the abuse
potential.
>
> If the developer has a "back door", then why can't he change the
server
> so that it handles Xenu like any other browser?
>
> One (possible) alternative is to login through IE, then continue
with
> Xenu. However you need to activate cookies. This - including the
risks -
> is explained in the FAQ.
>
> Tilman

On Thu, 4 Aug 2005 13:37:44 -0700 (PDT), Kanchan Mehrotra wrote:

>yeah i did find that ... but wasn't sure if this is a genuine error in the SSL
certificate common name or this error was shown coz xenu couldnot access this
secure site.

It is a genuine error. You can try to access the site with IE and you'll
get a similar error.

Sadly I can't tell you how to handle this, except maybe buying the
certificate for the correct host. You should contact the vendor of the
certificate.

Tilman

>
>Tilman Hausherr <tilman@...> wrote:On Wed, 3 Aug 2005 11:19:25 -0700
(PDT), Kanchan Mehrotra wrote:
>
>>Hi,
>>
>>I am an extremely new user to xenu link checker and am trying to check a
secured site (https://www-lite2/..........). Xenu shows the status of the site
as "SSL certificate common name incorrect" . Does anyone know what this error
means? Has anyone faced a similar problem or can someone suggest what can be
done to resolve it. Really appreciate any help on this one.
>
>http://msdn.microsoft.com/library/en-us/wininet/wininet/wininet_errors.asp
>
>
>ERROR_INTERNET_SEC_CERT_CN_INVALID
>12038
>SSL certificate common name (host name field) is incorrect—for example,
>if you entered www.server.com and the common name on the certificate
>says www.different.com.
>
>
>
>
>
>
>
>Yahoo! Groups Links
>
>
>
>
>
>
>
>
>
>---------------------------------
> Start your day with Yahoo! - make it your home page
>
>[Non-text portions of this message have been removed]
>
>
>
>
>
>
>
>Yahoo! Groups Links
>
>
>
>
>
>
>

When I attempt to search for Orphaned Files after a successful check of the
site, I am told that there are no orphaned files, which is not correct.
I am confused by the second dialogue box that I have to enter the site details
in. I think I have entered them correctly, and have tried various options, but
it does not seem to connect to the site and scan for orphans, which is what I
assume should happen.
If anyone can give a specific example of how it should be done I would be very
grateful.
TIA
Brian Tozer

[Non-text portions of this message have been removed]

hi brian,

Please check the online Xenu manual under

"Finding Orphaned Files"
http://members.chello.nl/f.visser3/xenu/10-orphaned-files.html

frank


--- In xenu-usergroup@yahoogroups.com, "Brian Tozer" <briantoz@i...>
wrote:
> When I attempt to search for Orphaned Files after a successful
check of the site, I am told that there are no orphaned files, which
is not correct.
> I am confused by the second dialogue box that I have to enter the
site details in. I think I have entered them correctly, and have
tried various options, but it does not seem to connect to the site
and scan for orphans, which is what I assume should happen.
> If anyone can give a specific example of how it should be done I
would be very grateful.
> TIA
> Brian Tozer
>
> [Non-text portions of this message have been removed]

The difficult part is i donot get the same error when
I access the site with IE. I am able to access the
site properly.

Really appreciate your help.

Thanks a lot for your time!

Kanchan

--- Tilman Hausherr <tilman@...> wrote:

> On Thu, 4 Aug 2005 13:37:44 -0700 (PDT), Kanchan
> Mehrotra wrote:
>
> >yeah i did find that ... but wasn't sure if this is
> a genuine error in the SSL certificate common name
> or this error was shown coz xenu couldnot access
> this secure site.
>
> It is a genuine error. You can try to access the
> site with IE and you'll
> get a similar error.
>
> Sadly I can't tell you how to handle this, except
> maybe buying the
> certificate for the correct host. You should contact
> the vendor of the
> certificate.
>
> Tilman
>
> >
> >Tilman Hausherr <tilman@...> wrote:On Wed, 3
> Aug 2005 11:19:25 -0700 (PDT), Kanchan Mehrotra
> wrote:
> >
> >>Hi,
> >>
> >>I am an extremely new user to xenu link checker
> and am trying to check a secured site
> (https://www-lite2/..........). Xenu shows the
> status of the site as "SSL certificate common name
> incorrect" . Does anyone know what this error means?
> Has anyone faced a similar problem or can someone
> suggest what can be done to resolve it. Really
> appreciate any help on this one.
> >
>
>http://msdn.microsoft.com/library/en-us/wininet/wininet/wininet_errors.asp
> >
> >
> >ERROR_INTERNET_SEC_CERT_CN_INVALID
> >12038
> >SSL certificate common name (host name field) is
> incorrect—for example,
> >if you entered www.server.com and the common name
> on the certificate
> >says www.different.com.
> >
> >
> >
> >
> >
> >
> >
> >Yahoo! Groups Links
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >---------------------------------
> > Start your day with Yahoo! - make it your home
> page
> >
> >[Non-text portions of this message have been
> removed]
> >
> >
> >
> >
> >
> >
> >
> >Yahoo! Groups Links
> >
> >
> >
> >
> >
> >
> >
>
>
>
>
> ------------------------ Yahoo! Groups Sponsor
> --------------------~-->
> <font face=arial size=-1><a
>
href="http://us.ard.yahoo.com/SIG=12h00q2g9/M=362329.6886308.7839368.1510227/D=g\
roups/S=1705005512:TM/Y=YAHOO/EXP=1124582432/A=2894321/R=0/SIG=11dvsfulr/*http:/\
/youthnoise.com/page.php?page_id=1992
> ">Fair play? Video games influencing politics. Click
> and talk back!</a>.</font>
>
--------------------------------------------------------------------~->
>
>
>
> Yahoo! Groups Links
>
>
>     xenu-usergroup-unsubscribe@yahoogroups.com
>
>
>
>
>


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

Questions:-
1. The initial scan of the site produces a section in the results labelled
"orphaned files" or similar. Should orphans appear in that list at this stage?
2. After the initial scan, and the appearance of the 2nd dialogue box, should
Xenu perform a second scan of the site to find the orphans, or are they deduced
from the initial scan?
3. The instructions speak of entering a ftp addrress but the example shows a
http address. Is the normal http address of the site suitable, e.g.
http://www.foo.com?
4. Is an entry in the Directory field needed?
5. Is it the directory of the folder on the server which contains the site
files?
6. What should be the behaviour of Xenu after the second dialogue box is filled
in?
Thanks
Brian
   ----- Original Message -----
   From: frank visser
   To: xenu-usergroup@yahoogroups.com
   Sent: Wednesday, August 24, 2005 1:10 AM
   Subject: [xenu-usergroup] Re: Orphaned Files


   hi brian,

   Please check the online Xenu manual under

   "Finding Orphaned Files"
   http://members.chello.nl/f.visser3/xenu/10-orphaned-files.html

   frank


   --- In xenu-usergroup@yahoogroups.com, "Brian Tozer" <briantoz@i...>
   wrote:
   > When I attempt to search for Orphaned Files after a successful
   check of the site, I am told that there are no orphaned files, which
   is not correct.
   > I am confused by the second dialogue box that I have to enter the
   site details in. I think I have entered them correctly, and have
   tried various options, but it does not seem to connect to the site
   and scan for orphans, which is what I assume should happen.
   > If anyone can give a specific example of how it should be done I
   would be very grateful.
   > TIA
   > Brian Tozer
   >
   > [Non-text portions of this message have been removed]




------------------------------------------------------------------------------
   YAHOO! GROUPS LINKS

     a..  Visit your group "xenu-usergroup" on the web.

     b..  To unsubscribe from this group, send an email to:
      xenu-usergroup-unsubscribe@yahoogroups.com

     c..  Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service.


------------------------------------------------------------------------------



[Non-text portions of this message have been removed]

Hi brian,

See my answers below,

Questions:-
1. The initial scan of the site produces a section in the results
labelled "orphaned files" or similar. Should orphans appear in that
list at this stage?
> yes.

2. After the initial scan, and the appearance of the 2nd dialogue
box, should Xenu perform a second scan of the site to find the
orphans, or are they deduced from the initial scan?
> an orphaned file is a file that is not linked to. So it cannot be
found on the link report itself. By comparing the files linked to
with the files found on the server, the number of orphans (the
difference) is calculated.

3. The instructions speak of entering a ftp addrress but the example
shows a http address. Is the normal http address of the site
suitable, e.g. http://www.foo.com?
> the manual says "FTP access", not "address", so you can use an
http:// address here, as the example given in the box itself, and
xenu will contact the site (with FTP I assume) to spot all present
files.

4. Is an entry in the Directory field needed?
> this requires some experimentation. Normally, the web URL
redirects to the proper system path on the server, but with FTP you
need to actually specify the subfolder where the files reside. So
yes.

5. Is it the directory of the folder on the server which contains
the site files?
> correct.

6. What should be the behaviour of Xenu after the second dialogue
box is filled in?
> as the manual shows, after Xenu has finished the orphan scan, it
will ask you for a web report, and at the bottom of that report, the
orphans will be listed.

Hope that answers your questions,

frank


--- In xenu-usergroup@yahoogroups.com, "Brian Tozer" <briantoz@i...>
wrote:
> Questions:-
> 1. The initial scan of the site produces a section in the results
labelled "orphaned files" or similar. Should orphans appear in that
list at this stage?
> 2. After the initial scan, and the appearance of the 2nd dialogue
box, should Xenu perform a second scan of the site to find the
orphans, or are they deduced from the initial scan?
> 3. The instructions speak of entering a ftp addrress but the
example shows a http address. Is the normal http address of the site
suitable, e.g. http://www.foo.com?
> 4. Is an entry in the Directory field needed?
> 5. Is it the directory of the folder on the server which contains
the site files?
> 6. What should be the behaviour of Xenu after the second dialogue
box is filled in?
> Thanks
> Brian
>   ----- Original Message -----
>   From: frank visser
>   To: xenu-usergroup@yahoogroups.com
>   Sent: Wednesday, August 24, 2005 1:10 AM
>   Subject: [xenu-usergroup] Re: Orphaned Files
>
>
>   hi brian,
>
>   Please check the online Xenu manual under
>
>   "Finding Orphaned Files"
>   http://members.chello.nl/f.visser3/xenu/10-orphaned-files.html
>
>   frank
>
>
>   --- In xenu-usergroup@yahoogroups.com, "Brian Tozer"
<briantoz@i...>
>   wrote:
>   > When I attempt to search for Orphaned Files after a successful
>   check of the site, I am told that there are no orphaned files,
which
>   is not correct.
>   > I am confused by the second dialogue box that I have to enter
the
>   site details in. I think I have entered them correctly, and have
>   tried various options, but it does not seem to connect to the
site
>   and scan for orphans, which is what I assume should happen.
>   > If anyone can give a specific example of how it should be done
I
>   would be very grateful.
>   > TIA
>   > Brian Tozer
>   >
>   > [Non-text portions of this message have been removed]
>
>
>
>
> -------------------------------------------------------------------
-----------
>   YAHOO! GROUPS LINKS
>
>     a..  Visit your group "xenu-usergroup" on the web.
>
>     b..  To unsubscribe from this group, send an email to:
>      xenu-usergroup-unsubscribe@yahoogroups.com
>
>     c..  Your use of Yahoo! Groups is subject to the Yahoo! Terms
of Service.
>
>
> -------------------------------------------------------------------
-----------
>
>
>
> [Non-text portions of this message have been removed]

On Tue, 23 Aug 2005 17:53:29 -0000, frank visser wrote:

>3. The instructions speak of entering a ftp addrress but the example
>shows a http address. Is the normal http address of the site
>suitable, e.g. http://www.foo.com?
>> the manual says "FTP access", not "address", so you can use an
>http:// address here, as the example given in the box itself, and
>xenu will contact the site (with FTP I assume) to spot all present
>files.

The host name is really just something like ftp.foo.com. No "http:" or
"ftp".

>4. Is an entry in the Directory field needed?
>> this requires some experimentation. Normally, the web URL
>redirects to the proper system path on the server, but with FTP you
>need to actually specify the subfolder where the files reside. So
>yes.

Yes.

On Sun, 21 Aug 2005 06:58:37 -0700 (PDT), Kanchan Mehrotra wrote:

>The difficult part is i donot get the same error when
>I access the site with IE. I am able to access the
>site properly.

My suspicion - if you're REALLY trying the exact same addresses (does
the error come at the root URL, or later?) - is that you have two
different versions of WININET.DLL on your system.

Try accessing the site first with IE, then with Xenu.

Tilman

>
>Really appreciate your help.
>
>Thanks a lot for your time!
>
>Kanchan
>
>--- Tilman Hausherr <tilman@...> wrote:
>
>> On Thu, 4 Aug 2005 13:37:44 -0700 (PDT), Kanchan
>> Mehrotra wrote:
>>
>> >yeah i did find that ... but wasn't sure if this is
>> a genuine error in the SSL certificate common name
>> or this error was shown coz xenu couldnot access
>> this secure site.
>>
>> It is a genuine error. You can try to access the
>> site with IE and you'll
>> get a similar error.
>>
>> Sadly I can't tell you how to handle this, except
>> maybe buying the
>> certificate for the correct host. You should contact
>> the vendor of the
>> certificate.
>>
>> Tilman
>>
>> >
>> >Tilman Hausherr <tilman@...> wrote:On Wed, 3
>> Aug 2005 11:19:25 -0700 (PDT), Kanchan Mehrotra
>> wrote:
>> >
>> >>Hi,
>> >>
>> >>I am an extremely new user to xenu link checker
>> and am trying to check a secured site
>> (https://www-lite2/..........). Xenu shows the
>> status of the site as "SSL certificate common name
>> incorrect" . Does anyone know what this error means?
>> Has anyone faced a similar problem or can someone
>> suggest what can be done to resolve it. Really
>> appreciate any help on this one.
>> >
>>
>>http://msdn.microsoft.com/library/en-us/wininet/wininet/wininet_errors.asp
>> >
>> >
>> >ERROR_INTERNET_SEC_CERT_CN_INVALID
>> >12038
>> >SSL certificate common name (host name field) is
>> incorrect—for example,
>> >if you entered www.server.com and the common name
>> on the certificate
>> >says www.different.com.
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >Yahoo! Groups Links
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >---------------------------------
>> > Start your day with Yahoo! - make it your home
>> page
>> >
>> >[Non-text portions of this message have been
>> removed]
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >Yahoo! Groups Links
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>>
>>
>>
>> ------------------------ Yahoo! Groups Sponsor
>> --------------------~-->
>> <font face=arial size=-1><a
>>
>href="http://us.ard.yahoo.com/SIG=12h00q2g9/M=362329.6886308.7839368.1510227/D=\
groups/S=1705005512:TM/Y=YAHOO/EXP=1124582432/A=2894321/R=0/SIG=11dvsfulr/*http:\
//youthnoise.com/page.php?page_id=1992
>> ">Fair play? Video games influencing politics. Click
>> and talk back!</a>.</font>
>>
>--------------------------------------------------------------------~->
>>
>>
>>
>> Yahoo! Groups Links
>>
>>
>>     xenu-usergroup-unsubscribe@yahoogroups.com
>>
>>
>>
>>
>>
>
>
>__________________________________________________
>Do You Yahoo!?
>Tired of spam?  Yahoo! Mail has the best spam protection around
>http://mail.yahoo.com
>
>
>
>
>
>
>Yahoo! Groups Links
>
>
>
>
>
>
>

Many thanks for the beta version for me to test on my problem.
I was now able to perform the Orphaned Files test OK, but only got a lot of
entries/results of the following form:-

Error 12003 while moving to remote ftp directory 'Business/indexes/': 550
Business/indexes/: No such file or directory

Does this give a clue to my problem of not being able get Orphaned Files
reported?

Thanks for your support.
Brian Tozer

[Non-text portions of this message have been removed]

On Wed, 24 Aug 2005 09:09:14 +1200, Brian Tozer wrote:

>Many thanks for the beta version for me to test on my problem.
>I was now able to perform the Orphaned Files test OK, but only got a lot of
entries/results of the following form:-
>
>Error 12003 while moving to remote ftp directory 'Business/indexes/': 550
Business/indexes/: No such file or directory
>
>Does this give a clue to my problem of not being able get Orphaned Files
reported?

Yes, there is no such directory, obviously. What did you enter in the
directory field? What you have to do is to enter in that field the
initial directory change that you do when entering ftp by hand. For
example, I enter "public_html/" in my system.

On Wed, 10 Aug 2005 22:16:33 -0000, habibknight wrote:

>Hi Tillman:
>
>Thanks.  We did what you said and basically set the cookie through
>IE.  I'm trying to understand something.  Does Xenu use the cookies
>from IE?  So if I visit a website in IE that requires a login the
>first time and sets a persistent cookie with my encrypted login info
>thereby not requiring me to login on future visits.
>
> Now If I hit this site with Xenu with the cookie option enabled,
>does Xenu pickup my IE cookie and therefore will let me spider the
>site?

Only if you enable the cookie option. See
http://home.snafu.de/tilman/xenulink.html#cookies

Sorry for the delay. It took 10 days for this posting to pass moderation
(which exists to stop the spammers), and it was outside of my normal
mail window. Frank, you should bring up a co-moderator (not me).

Tilman

>
>Thanks
>Haseeb
>
>
>
>--- In xenu-usergroup@yahoogroups.com, Tilman Hausherr <tilman@s...>
>wrote:
>> On Mon, 01 Aug 2005 23:53:07 -0000, habibknight wrote:
>>
>> >Hello:
>> >
>> >I was wondering if someone can help me.  I am trying to test our
>site
>> >but to enter our site, the developer says this can be done through
>> >javascript which Xenu could not handle or he said through a user
>agent
>> >string.  If the tool will let me manipulate the user agent string,
>> >there is a back door entry that the developer has created that can
>let
>> >me in if I can manipulate the user agent so that way I can go in
>> >through the back door.
>> >
>> >Sorry for the vagueness. I am new to this.
>>
>> Hi,
>>
>> I don't offer a variable user agent, because of the abuse
>potential.
>>
>> If the developer has a "back door", then why can't he change the
>server
>> so that it handles Xenu like any other browser?
>>
>> One (possible) alternative is to login through IE, then continue
>with
>> Xenu. However you need to activate cookies. This - including the
>risks -
>> is explained in the FAQ.
>>
>> Tilman
>
>
>
>
>
>
>
>
>
>Yahoo! Groups Links
>
>
>
>
>
>

Hello all

I'd like to check some links for a set of html pages I have on a CD-ROM.

The pages have file names like this:

zona.html-rgrado=6&rconsul=3&clec=9&zond=01

and thus Xenu won't recognise them as html.


So, I made the CD accessible from apache, adding this line to ".htaccess":

DefaultType text/html

After this I can browse the CD normally (with any browser), but Xenu
still thinks the page is text only and thus doesn't even try to follow
the links.

Is there any way to force Xenu to treat such page as html?

Thanks in advance

   Juan Pablo

On Thu, 25 Aug 2005 19:27:29 -0500, Juan Pablo Romero wrote:

>Hello all
>
>I'd like to check some links for a set of html pages I have on a CD-ROM.
>
>The pages have file names like this:
>
>zona.html-rgrado=6&rconsul=3&clec=9&zond=01
>
>and thus Xenu won't recognise them as html.
>
>
>So, I made the CD accessible from apache, adding this line to ".htaccess":
>
>DefaultType text/html
>
>After this I can browse the CD normally (with any browser), but Xenu
>still thinks the page is text only and thus doesn't even try to follow
>the links.
>
>Is there any way to force Xenu to treat such page as html?

It won't work for a local scan.
*.zona.html-rgrado=6&rconsul=3&clec=9&zond=01 is obviously not HTML
(click on it in the Windows Explorer!). About Apache - please tell us
what Xenu says in the column "mime type". It should be text/html.

Hi,

I added
Javascript=[Jj]ava[Ss]cript: *[_a-zA-Z0-9]+ *\(
*['"]((/|ftp://|https?://)[^'"]+)['"]

to my [options] section of the .ini file, as suggested on:

http://members.chello.nl/f.visser3/xenu/6-handling-javascript.html

However, LinkSleuth (1.2h beta) does not recognise the Javascript links I
hoped it would.

Examples of unrecognised links:

<a href="javascript:;" onClick="w =
window.open('a03_se1p.jpg','TpWebWizImage','width=800,height=600,menubar=no,
resizable=yes,scrollbars=yes,status=no,toolbar=no'); w.resizeTo(849,685);
w.focus()" style="cursor:hand">

<a href="javascript:;"
onclick="openPictureWindow('IMG/jpg/1261tz12_w-2.jpg','800','600','','10','1
0','','en' )" title="View full size">

Does anyone see something I could do to make these JS links "compatible"
with LinkSleuth?

thanks,
Paolo

hi all,

September has been a VERY quiet month for the Xenu usergroup!

I have been very busy with an online game for Nokia, which runs now
in 20 countries with 600.000 registered players:

http://www.nokia.com/20lives

as test manager I had to find a way to check the links in this Flash-
only application, which Xenu currently cannot do.

I found a good alternative in Fiddler:
http://www.fiddlertool.com

it lists all HTTP requests while you are playing the game and finds
the 404 messages whenever there's a broken link.

Tilman, not sure if this is a realistic question, but what does it
take to upgrade Xenu so it can handle Flash links?

Frank

On Mon, 3 Oct 2005 13:55:56 +0200, Paolo wrote:

>Hi,
>
>I added
>Javascript=[Jj]ava[Ss]cript: *[_a-zA-Z0-9]+ *\(
>*['"]((/|ftp://|https?://)[^'"]+)['"]
>
>to my [options] section of the .ini file, as suggested on:
>
>http://members.chello.nl/f.visser3/xenu/6-handling-javascript.html
>
>However, LinkSleuth (1.2h beta) does not recognise the Javascript links I
>hoped it would.
>
>Examples of unrecognised links:
>
><a href="javascript:;" onClick="w =
>window.open('a03_se1p.jpg','TpWebWizImage','width=800,height=600,menubar=no,
>resizable=yes,scrollbars=yes,status=no,toolbar=no'); w.resizeTo(849,685);
>w.focus()" style="cursor:hand">
>
><a href="javascript:;"
>onclick="openPictureWindow('IMG/jpg/1261tz12_w-2.jpg','800','600','','10','1
>0','','en' )" title="View full size">
>
>Does anyone see something I could do to make these JS links "compatible"
>with LinkSleuth?

No, because you use "onclick", instead of "href". Maybe a solution would
be to put the call in both. Btw, this type of pages never works without
JS. Quite annoying :-(

On Mon, 03 Oct 2005 12:32:28 -0000, frank visser wrote:

>hi all,
>
>September has been a VERY quiet month for the Xenu usergroup!
>
>I have been very busy with an online game for Nokia, which runs now
>in 20 countries with 600.000 registered players:
>
>http://www.nokia.com/20lives

I tried that one. One had to type something from a "teleprompter". After
I mistyped something, the game was stuck and I closed it - so I never
found out what this game was about.

I just retried... it worked this time, but it's boring, and rather a
sort of brainwashing that one has to watch and interact with Nokia
materials all the time :-( I think I will buy a non-Nokia cellphone next
time.

>as test manager I had to find a way to check the links in this Flash-
>only application, which Xenu currently cannot do.
>
>I found a good alternative in Fiddler:
>http://www.fiddlertool.com
>
>it lists all HTTP requests while you are playing the game and finds
>the 404 messages whenever there's a broken link.
>
>Tilman, not sure if this is a realistic question, but what does it
>take to upgrade Xenu so it can handle Flash links?

Flash is a program, not a formatting language. So the approach of
"Fiddler" to simply test all links manually while the player plays makes
sense.

Tilman

There exists a perl CPAN module that you can use to get strings from an
SWF file, I have used that to spider Flash links in my search engine at
www.bandsman.co.uk. There is
no need to track http requests or anything complicated like that.

Look for SWF::Parser.

-Nigel

On 03 Oct 2005 14:44:26 +0100, Nigel Horne wrote:

>There exists a perl CPAN module that you can use to get strings from an
>SWF file, I have used that to spider Flash links in my search engine at
>www.bandsman.co.uk. There is
>no need to track http requests or anything complicated like that.

This won't help you if the http requests are created dynamically.

Hello,

I have been using Xenu Linksleuth for many months running under
Windows ME and a 56K dial-up.  Linksleuth *always* ran just fine,
and occasionally helped me out with a broken/bad link or two.

However, I just installed Windows XP Home on my desktop and I'm now
running DSL Wireless.  What's happening now is that Linksleuth, when
it hits around 88%, seems to slow down (it even seemed to stall
once) and then the next thing I know the program gives me the
complete message, and the last 50/80/100/whatever links are all in
red and marked "timeout."  And the majority of these links are
internal links, though there are a number of external links that
also timeout.

I've added a "Timeout=120" to the INI file, and also reduced the
number of threads from "30" to "20."

It's almost as if the speed of the wireless is causing Linksleuth to
finish before it's actually ready, if that makes any sense.

Anyhow, I'm not a hardcore techie, but if anyone has any
suggestions, please let me know.

Cheers,
- marty

On Tue, 04 Oct 2005 05:41:28 -0000, martyh95121 wrote:

>Hello,
>
>I have been using Xenu Linksleuth for many months running under
>Windows ME and a 56K dial-up.  Linksleuth *always* ran just fine,
>and occasionally helped me out with a broken/bad link or two.
>
>However, I just installed Windows XP Home on my desktop and I'm now
>running DSL Wireless.  What's happening now is that Linksleuth, when
>it hits around 88%, seems to slow down (it even seemed to stall
>once) and then the next thing I know the program gives me the
>complete message, and the last 50/80/100/whatever links are all in
>red and marked "timeout."  And the majority of these links are
>internal links, though there are a number of external links that
>also timeout.
>
>I've added a "Timeout=120" to the INI file, and also reduced the
>number of threads from "30" to "20."
>
>It's almost as if the speed of the wireless is causing Linksleuth to
>finish before it's actually ready, if that makes any sense.
>
>Anyhow, I'm not a hardcore techie, but if anyone has any
>suggestions, please let me know.

Simple press CTRL-R to retry all, that's the easiest, instead of trying
to find out the cause.

--- Tilman Hausherr wrote:

> No, because you use "onclick", instead of "href".
> Maybe a solution would
> be to put the call in both. Btw, this type of pages
> never works without JS. Quite annoying :-(

OK, thanks. I'll look into how I can change the link.
Paolo

hi all,

i encountered a weird phenomenon on a site i was linkchecking:
peugeot.com

for example, on this page:
http://www.peugeot.com/sport/sport_auto/rallye/fr/saison/default.htm

there's an image coded like this:
<img src="saison/images/drap_nouv-ze.gif" hspace="2" border="0"
alt="Nouvele Zélande">

note the double occurrence of the "saison" folder!

in the IE browser the link shows up as:
http://www.peugeot.com/sport/sport_auto/rallye/fr/saison/images/drap_
nouv-ze.gif
200 ok

in xenu it is displayed as:
http://www.peugeot.com/sport/sport_auto/rallye/fr/saison/saison/image
s/drap_nouv-ze.gif
404 not found

following the html, Xenu seems to be correct, and still, the image
is not broken on the web page.

i looked into the code and noticed a BASE HREF code at the top of
the page:

<script language=javascript>document.write ('<BASE HREF="http://' +
serveur + racineSite + 'sport/sport_auto/rallye/' + document.lang
+ '/">');</script>

in a js file these variables were set:
var serveur = "www.peugeot.com"
var racineSite = "/"

so that leads to the correct and working URL:
http://www.peugeot.com/sport/sport_auto/rallye/fr/saison/saison/image
s/drap_nouv-ze.gif

so the HTML code is "overruled" by the BASE HREF tag.

does anyone have any idea why this page is coded like this?

frank