Skip to search.

Breaking News Visit Yahoo! News for the latest.

×Close this window

xenu-usergroup · Xenu Linkchecker Usergroup

The Yahoo! Groups Product Blog

Check it out!

Group Information

  • Members: 493
  • Category: Internet
  • Founded: Jul 20, 2004
  • Language: English
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Real people. Real stories. See how Yahoo! Groups impacts members worldwide.

Messages

Advanced
Messages Help
Messages 196 - 225 of 1639   Oldest  |  < Older  |  Newer >  |  Newest
Messages: Show Message Summaries Sort by Date ^  
#196 From: Tilman Hausherr <tilman@...>
Date: Thu Jan 20, 2005 7:49 pm
Subject: Re: FTP links
geo4497
Send Email Send Email
 
On Thu, 20 Jan 2005 22:39:22 +0300, Eugeny.Sattler@... wrote:

>
>Tilman ,
>why Xenu refuses to check FTP links I enter manually while checks them OK if
>they are taken from HTML doc?

They are just checked that they exist, not crawled.

>I am forced to create intermediate HTML docs for that (or find that link
>somewhere in the net).
>I hope you understand how inconvinient it is.
>
>can it be fixed?

No, because I don't do "ftp link crawling". If you have a HTML file, it
should be on a WWW server. Ftp is really just as file repository.

#197 From: Eugeny.Sattler@...
Date: Fri Jan 21, 2005 7:50 am
Subject: FTP links
accmailer
Send Email Send Email
 
Tilman ,
ES>why Xenu refuses to check FTP links I enter manually while checks them OK
if
ES>they are taken from HTML doc?

T> They are just checked that they exist, not crawled.

ES>I am forced to create intermediate HTML docs for that (or find that link
ES>somewhere in the net).
ES>I hope you understand how inconvinient it is.
ES>can it be fixed?

T> No, because I don't do "ftp link crawling". If you have a HTML file, it
T> should be on a WWW server. Ftp is really just as file repository.

I probably described my need incompletely.
Periodically, I need to check an ftp link to a FILE (like
ftp://host.com/pub/file.ext),
not the whole directory like ftp://host.com/pub/ ).
So I don't need any crawling, i.e. jumping from one file to another.
Sure, I understand that if it is a file repository, there are no links fo
follow further,
as it is with WWW.  But I need to check just a single file.

If XENU sees ftp:// in the beginning of the link I enter manually it stops.
There is logic in that - you can't check a directory.
But why not make XENU see if there is file extension (up to 3 letters long)
and the end of ftp link, this way assuming the the link is "checkable".

#198 From: Tilman Hausherr <tilman@...>
Date: Fri Jan 21, 2005 8:43 am
Subject: Re: FTP links
geo4497
Send Email Send Email
 
On Fri, 21 Jan 2005 10:50:09 +0300, Eugeny.Sattler@... wrote:

>
> Tilman ,
> ES>why Xenu refuses to check FTP links I enter manually while checks
> them OK if
> ES>they are taken from HTML doc?
>
> T> They are just checked that they exist, not crawled.
>
> ES>I am forced to create intermediate HTML docs for that (or find that
> link ES>somewhere in the net).
> ES>I hope you understand how inconvinient it is.
> ES>can it be fixed?
>
> T> No, because I don't do "ftp link crawling". If you have a HTML file,
> it T> should be on a WWW server. Ftp is really just as file repository.
>
> I probably described my need incompletely.
> Periodically, I need to check an ftp link to a FILE (like
> ftp://host.com/pub/file.ext),
> not the whole directory like ftp://host.com/pub/ ).
> So I don't need any crawling, i.e. jumping from one file to another.
> Sure, I understand that if it is a file repository, there are no links
> fo follow further,
> as it is with WWW.  But I need to check just a single file.
>
> If XENU sees ftp:// in the beginning of the link I enter manually it
> stops. There is logic in that - you can't check a directory.
> But why not make XENU see if there is file extension (up to 3 letters
> long)  and the end of ftp link, this way assuming the the link is
> "checkable".

Sure I could improve Xenu so that you can enter an ftp URL into the
dialogbox. But why use Xenu for checking whether a single URL exists? Why
not just enter it into your browser? As soon as the "download" box appears,
you know that something exists.

Tilman

#199 From: Eugeny.Sattler@...
Date: Fri Jan 21, 2005 9:49 am
Subject: FTP links
accmailer
Send Email Send Email
 
> Sure I could improve Xenu so that you can enter an ftp URL into the
> dialogbox. But why use Xenu for checking whether a single URL exists? Why
> not just enter it into your browser? As soon as the "download" box
appears,
> you know that something exists.

Frankly speaking I need more than just knowing the file exists.
I need to learn file size and last-modified date --  in order to find out on

which FTP the latest program version is located, for example.

Eugeny

#200 From: "frank visser" <f.visser3@...>
Date: Fri Jan 21, 2005 1:21 pm
Subject: Re: Xenu javascript codeline case sensitive?
reusvisser
Send Email Send Email
 
thanks a lot tilmann!

(please note i still use the cookie-accepting version ;-) - you once
remarked you considered adding this as an option in xenu:

"[ ] accept cookies."

saves you the trouble of creating separate versions.)

frank

--- In xenu-usergroup@yahoogroups.com, Tilman Hausherr <tilman@s...>
wrote:
> On Thu, 20 Jan 2005 14:06:09 -0000, frank visser wrote:
>
> >i don't care about elegance as long as it works, but i could not
get
> >the [Jj] etc. solution to work at all - that was my problem.
> >
> >am i mistaken? will try again.
>
> I'll correct it this weekend.

#201 From: Tilman Hausherr <tilman@...>
Date: Fri Jan 21, 2005 8:45 pm
Subject: Re: Re: Xenu javascript codeline case sensitive?
geo4497
Send Email Send Email
 
On Fri, 21 Jan 2005 13:21:46 -0000, frank visser wrote:

>thanks a lot tilmann!
>
>(please note i still use the cookie-accepting version ;-) - you once
>remarked you considered adding this as an option in xenu:
>
>"[ ] accept cookies."
>
>saves you the trouble of creating separate versions.)

You will be able (in the next version this weekend) to enable cookies
with

[Options]
AllowCookies=1

This is unofficial, I will only make a description on the website, but
won't put it in the options dialog box.

The javascript thing is now also done. Please test it to see whether it
works the way you want. I didn't test it so that you have some work,
too. (Note that you will STILL have to use an appropriate Regexp!)

http://home.snafu.de/tilman/tmp/xenubeta.zip

Tilman

#202 From: Tilman Hausherr <tilman@...>
Date: Fri Jan 21, 2005 8:45 pm
Subject: Re: FTP links
geo4497
Send Email Send Email
 
On Fri, 21 Jan 2005 10:50:09 +0300, Eugeny.Sattler@... wrote:

>I probably described my need incompletely.
>Periodically, I need to check an ftp link to a FILE (like
>ftp://host.com/pub/file.ext),
>not the whole directory like ftp://host.com/pub/ ).
>So I don't need any crawling, i.e. jumping from one file to another.
>Sure, I understand that if it is a file repository, there are no links fo
>follow further,
>as it is with WWW.  But I need to check just a single file.
>
>If XENU sees ftp:// in the beginning of the link I enter manually it stops.
>There is logic in that - you can't check a directory.
>But why not make XENU see if there is file extension (up to 3 letters long)
>and the end of ftp link, this way assuming the the link is "checkable".

done.

You can now enter a ftp URL. Try it with
ftp://ftp3.nero.com/software/NeroBurningROM/nero6606.exe

it will quickly tell you the size and date. This is really "just for
you".

http://home.snafu.de/tilman/tmp/xenubeta.zip

#203 From: Richard Ribeiro <rdribeiro@...>
Date: Fri Jan 21, 2005 11:40 am
Subject: Orphan files and passive FTP II (The Return!)
rdribeiro
Send Email Send Email
 
Dear All,

     Firstly: thank you Frank for your answer, and
thank you Tilman for the link for the "special
edition" of Xenu.
     Secondly: I tried the beta version of Xenu to get
orphan files and I had the same problem (even using
passive mode in FTP). All my files appear as orphan
files even with the URL correct. The strange thing is
if I use a local copy of the website, everything works
fine.
     I know that now I can do my task without problems,
as long as I use local mirror, but I'm intrigued...
why this happen? Problably it is some mistake I doing,
but I would like to know which one.

     Thank you guys for all the help I'm receiving
here.

     Richard


__________________________________________________
Converse com seus amigos em tempo real com o Yahoo! Messenger
http://br.download.yahoo.com/messenger/

#204 From: Tilman Hausherr <tilman@...>
Date: Sun Jan 23, 2005 3:09 pm
Subject: Re: Orphan files and passive FTP II (The Return!)
geo4497
Send Email Send Email
 
On Fri, 21 Jan 2005 08:40:30 -0300 (ART), Richard Ribeiro wrote:

>Dear All,
>
>    Firstly: thank you Frank for your answer, and
>thank you Tilman for the link for the "special
>edition" of Xenu.
>    Secondly: I tried the beta version of Xenu to get
>orphan files and I had the same problem (even using
>passive mode in FTP). All my files appear as orphan
>files even with the URL correct. The strange thing is
>if I use a local copy of the website, everything works
>fine.
>    I know that now I can do my task without problems,
>as long as I use local mirror, but I'm intrigued...
>why this happen? Problably it is some mistake I doing,
>but I would like to know which one.

I would suspect an input error - i.e. did you enter the correct
parameter for your ftp directory? "/" alone is usually wrong.

Another possibility would be that you're checking several websites at
the same time - this could be confusing.

Tilman

>
>    Thank you guys for all the help I'm receiving
>here.
>
>    Richard
>
>
>__________________________________________________
>Converse com seus amigos em tempo real com o Yahoo! Messenger
>http://br.download.yahoo.com/messenger/
>
>
>
>
>
>
>Yahoo! Groups Links
>
>
>
>
>
>

#205 From: "frank visser" <f.visser3@...>
Date: Mon Jan 24, 2005 2:56 pm
Subject: Re: Xenu javascript codeline case sensitive?
reusvisser
Send Email Send Email
 
hi tilman,

the regex patch works fine.

with:

Javascript=[Jj]ava[Ss]cript: *[_a-zA-Z0-9]+ *\( *['"]
((/|ftp://|https?://)[^'"]+)['"]

it covers my needs.

frank

--- In xenu-usergroup@yahoogroups.com, Tilman Hausherr <tilman@s...>
wrote:
> On Fri, 21 Jan 2005 13:21:46 -0000, frank visser wrote:
>
> >thanks a lot tilmann!
> >
> >(please note i still use the cookie-accepting version ;-) - you
once
> >remarked you considered adding this as an option in xenu:
> >
> >"[ ] accept cookies."
> >
> >saves you the trouble of creating separate versions.)
>
> You will be able (in the next version this weekend) to enable
cookies
> with
>
> [Options]
> AllowCookies=1
>
> This is unofficial, I will only make a description on the website,
but
> won't put it in the options dialog box.
>
> The javascript thing is now also done. Please test it to see
whether it
> works the way you want. I didn't test it so that you have some work,
> too. (Note that you will STILL have to use an appropriate Regexp!)
>
> http://home.snafu.de/tilman/tmp/xenubeta.zip
>
> Tilman

#206 From: "frank visser" <f.visser3@...>
Date: Wed Jan 26, 2005 10:11 pm
Subject: server error?
reusvisser
Send Email Send Email
 
hi tilman,

on a page like this:
http://support.intel.com/support/motherboards/server/se7210tp1-
e/sb/CS-008322.htm

these types of links give a "server error"in xenu:

http://processorfinder.intel.com/scripts/details.asp?
sSpec=SL6WR&ProcFam=483&Pkgtype=ALL&SysBusSpd=ALL&CorSpd=ALL

but opening them in a browser gives a correct page.

and reading the HTTP headers (for example in Firefox with LiveHTTP
headers) doesn't bring up any server error.

what could cause the server error message in xenu?

frank

#207 From: "frank visser" <f.visser3@...>
Date: Wed Jan 26, 2005 10:20 pm
Subject: double // gives page not found?
reusvisser
Send Email Send Email
 
hi tilman,

this type of link:

http://downloadfinder.intel.com//scripts-df/Detail_Desc.asp?
ProductID=495&DwnldID=3486

on this page:
http://support.intel.com/support/si/dial/etplus/software.htm

gives a "page not found" message in Xenu, but it works in a browser.

is that because of the double // in the URL?

what causes the page not found message in xenu?

frank

#208 From: Tilman Hausherr <tilman@...>
Date: Wed Jan 26, 2005 10:22 pm
Subject: Re: server error?
geo4497
Send Email Send Email
 
On Wed, 26 Jan 2005 22:11:44 -0000, frank visser wrote:

>
>
>hi tilman,
>
>on a page like this:
>http://support.intel.com/support/motherboards/server/se7210tp1-
>e/sb/CS-008322.htm
>
>these types of links give a "server error"in xenu:
>
>http://processorfinder.intel.com/scripts/details.asp?
>sSpec=SL6WR&ProcFam=483&Pkgtype=ALL&SysBusSpd=ALL&CorSpd=ALL
>
>but opening them in a browser gives a correct page.
>
>and reading the HTTP headers (for example in Firefox with LiveHTTP
>headers) doesn't bring up any server error.
>
>what could cause the server error message in xenu?

As usual - a poorly configured server. Ask the server admin why he can't
work properly with the Xenu user-agent.

Tilman

#209 From: Tilman Hausherr <tilman@...>
Date: Wed Jan 26, 2005 10:24 pm
Subject: Re: double // gives page not found?
geo4497
Send Email Send Email
 
On Wed, 26 Jan 2005 22:20:06 -0000, frank visser wrote:

>
>
>hi tilman,
>
>this type of link:
>
>http://downloadfinder.intel.com//scripts-df/Detail_Desc.asp?
>ProductID=495&DwnldID=3486
>
>on this page:
>http://support.intel.com/support/si/dial/etplus/software.htm
>
>gives a "page not found" message in Xenu, but it works in a browser.
>
>is that because of the double // in the URL?

Yes.

>what causes the page not found message in xenu?

I do. Because a // page would link to a /// page, which would link to a
//// page, which would link to a ///// page, which would link to a
////// page, which would link to a /////// page, which would link to a
//////// page, which would link to a ///////// page, which would link to
a ////////// page, which would link to a /////////// page, which would
link to a //////////// page, which would link to a ////////////// page,
... you understand?

Tilman

#210 From: "Frank Visser" <f.visser3@...>
Date: Wed Jan 26, 2005 10:32 pm
Subject: RE: server error?
reusvisser
Send Email Send Email
 
Tilman,



Is it "poorly configured" or security?



I don't want to "wake sleeping dogs" - as we say in the Netherlands.



frank



========================================

Frank Visser, Waterpoortweg 279, 1051 pv, Amsterdam

Author of: Ken Wilber: Thought as Passion SUNY 2003

Read all about Ken Wilber : http:// <http://www.integralworld.net>
www.integralworld.net

========================================

   _____

From: Tilman Hausherr [mailto:tilman@...]
Sent: woensdag 26 januari 2005 23:22
To: xenu-usergroup@yahoogroups.com
Subject: Re: [xenu-usergroup] server error?



On Wed, 26 Jan 2005 22:11:44 -0000, frank visser wrote:

>
>
>hi tilman,
>
>on a page like this:
>http://support.intel.com/support/motherboards/server/se7210tp1-
>e/sb/CS-008322.htm
>
>these types of links give a "server error"in xenu:
>
>http://processorfinder.intel.com/scripts/details.asp?
>sSpec=SL6WR&ProcFam=483&Pkgtype=ALL&SysBusSpd=ALL&CorSpd=ALL
>
>but opening them in a browser gives a correct page.
>
>and reading the HTTP headers (for example in Firefox with LiveHTTP
>headers) doesn't bring up any server error.
>
>what could cause the server error message in xenu?

As usual - a poorly configured server. Ask the server admin why he can't
work properly with the Xenu user-agent.

Tilman





   _____

Yahoo! Groups Links

* To visit your group on the web, go to:
http://groups.yahoo.com/group/xenu-usergroup/

* To unsubscribe from this group, send an email to:
xenu-usergroup-unsubscribe@yahoogroups.com
<mailto:xenu-usergroup-unsubscribe@yahoogroups.com?subject=Unsubscribe>

* Your use of Yahoo! Groups is subject to the Yahoo!
<http://docs.yahoo.com/info/terms/>  Terms of Service.



[Non-text portions of this message have been removed]

#211 From: Tilman Hausherr <tilman@...>
Date: Wed Jan 26, 2005 10:47 pm
Subject: Re: server error?
geo4497
Send Email Send Email
 
On Wed, 26 Jan 2005 23:32:11 +0100, Frank Visser wrote:

>
>Tilman,
>
>
>
>Is it "poorly configured" or security?
>
>
>
>I don't want to "wake sleeping dogs" - as we say in the Netherlands.

What I mean is that his scripts simply don't do their job. Xenu uses
Internet Explorer's WININET.DLL to contact, but with a different user
agent.

Tilman

#212 From: "frank visser" <f.visser3@...>
Date: Fri Feb 4, 2005 7:00 pm
Subject: Large reports fail to open
reusvisser
Send Email Send Email
 
hi all,

does anyone have experience with large xen reports (over 20.000
links)?

when they are done and i try to open a web browser report ("R"),
xenu crashes.

is this something about memory limitations?

i have 512 MB ram and a virtual memory paging file of 1024 Mb.

any help is welcome,

frank

#213 From: "Frank Visser" <f.visser3@...>
Date: Fri Feb 4, 2005 7:51 pm
Subject: RE: Large reports fail to open
reusvisser
Send Email Send Email
 
Looking closer at my configuration, i have a pagefile of 1024 Mb on a D:
partitioning of my hard disk.



The available space on D: is 2791 Mb.



Anyone?





frank



========================================

Frank Visser, Waterpoortweg 279, 1051 pv, Amsterdam

Author of: Ken Wilber: Thought as Passion SUNY 2003

Read all about Ken Wilber : http:// <http://www.integralworld.net>
www.integralworld.net

========================================

   _____

From: frank visser [mailto:f.visser3@...]
Sent: vrijdag 4 februari 2005 20:00
To: xenu-usergroup@yahoogroups.com
Subject: [xenu-usergroup] Large reports fail to open




hi all,

does anyone have experience with large xen reports (over 20.000
links)?

when they are done and i try to open a web browser report ("R"),
xenu crashes.

is this something about memory limitations?

i have 512 MB ram and a virtual memory paging file of 1024 Mb.

any help is welcome,

frank






   _____

Yahoo! Groups Links

* To visit your group on the web, go to:
http://groups.yahoo.com/group/xenu-usergroup/

* To unsubscribe from this group, send an email to:
xenu-usergroup-unsubscribe@yahoogroups.com
<mailto:xenu-usergroup-unsubscribe@yahoogroups.com?subject=Unsubscribe>

* Your use of Yahoo! Groups is subject to the Yahoo!
<http://docs.yahoo.com/info/terms/>  Terms of Service.



[Non-text portions of this message have been removed]

#214 From: "Neal Applebaum" <napplebaum@...>
Date: Wed Feb 9, 2005 5:38 pm
Subject: Question on usage of "//"
think_outsid...
Send Email Send Email
 
We recently published a number of web pages where the URL had two slashes
instead of one; e.g.:

http://xxx.com/folder1//images/image.jpg

None of the browsers (IE, Mozilla, Safari) seemed to care how many slashes
there were, and neither did Xenu. However someone performing code review
noticed this. While I agree this is not usual, why didn't Xenu pick up the
syntax error? Is it because it (like the browsers) just ignores the extra
slashes?

Thanks

______________________
Neal Applebaum
Manager of Technical Quality
WebFeat
81 Peter Street, Suite 200
Toronto, Ontario
M5V 2G4

e: napplebaum@...
t:  416.408.1212 ext. 15
f:  416.408.0551
w: www.webfeat.com
__________________________________________________________________
This email may contain confidential and/or privileged information for the
sole use of the intended recipient. Any review or distribution by others is
strictly prohibited. If you have received this email in error, please
contact the sender and delete all copies. Opinions, conclusions or other
information expressed or contained in this email are not given or endorsed
by the sender unless otherwise affirmed independently by the sender.
__________________________________________________________________





[Non-text portions of this message have been removed]

#215 From: Tilman Hausherr <tilman@...>
Date: Wed Feb 9, 2005 5:52 pm
Subject: Re: Question on usage of "//"
geo4497
Send Email Send Email
 
On Wed, 9 Feb 2005 12:38:35 -0500, Neal Applebaum wrote:

>
>We recently published a number of web pages where the URL had two slashes
>instead of one; e.g.:
>
>http://xxx.com/folder1//images/image.jpg
>
>None of the browsers (IE, Mozilla, Safari) seemed to care how many slashes
>there were, and neither did Xenu.

Not true. Xenu does report "//" as error. Do you have the current
version?

Tilman

#216 From: "Neal Applebaum" <napplebaum@...>
Date: Wed Feb 9, 2005 6:03 pm
Subject: RE: Question on usage of "//"
think_outsid...
Send Email Send Email
 
I have version: "Xenu Link Sleuth 1.2f".

Thanks

  -----Original Message-----
From: Tilman Hausherr [mailto:tilman@...]
Sent: February 9, 2005 12:52 PM
To: xenu-usergroup@yahoogroups.com
Subject: Re: [xenu-usergroup] Question on usage of "//"


   On Wed, 9 Feb 2005 12:38:35 -0500, Neal Applebaum wrote:

   >
   >We recently published a number of web pages where the URL had two slashes
   >instead of one; e.g.:
   >
   >http://xxx.com/folder1//images/image.jpg
   >
   >None of the browsers (IE, Mozilla, Safari) seemed to care how many
slashes
   >there were, and neither did Xenu.

   Not true. Xenu does report "//" as error. Do you have the current
   version?

   Tilman



         Yahoo! Groups Sponsor
               ADVERTISEMENT





----------------------------------------------------------------------------
--
   Yahoo! Groups Links

     a.. To visit your group on the web, go to:
     http://groups.yahoo.com/group/xenu-usergroup/

     b.. To unsubscribe from this group, send an email to:
     xenu-usergroup-unsubscribe@yahoogroups.com

     c.. Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service.



[Non-text portions of this message have been removed]

#217 From: "Neal Applebaum" <napplebaum@...>
Date: Wed Feb 9, 2005 6:11 pm
Subject: RE: Question on usage of "//"
think_outsid...
Send Email Send Email
 
You're right - in a simple case like I gave, Xenu did identify it - I
checked with a simple path. I can't really explain the nature of the site
that failed - it's a complicated series of redirects etc. -, but thanks
anyway. I was interested in the nature of how/why browsers ignore it.

Thanks
   -----Original Message-----
   From: Tilman Hausherr [mailto:tilman@...]
   Sent: February 9, 2005 12:52 PM
   To: xenu-usergroup@yahoogroups.com
   Subject: Re: [xenu-usergroup] Question on usage of "//"


   On Wed, 9 Feb 2005 12:38:35 -0500, Neal Applebaum wrote:

   >
   >We recently published a number of web pages where the URL had two slashes
   >instead of one; e.g.:
   >
   >http://xxx.com/folder1//images/image.jpg
   >
   >None of the browsers (IE, Mozilla, Safari) seemed to care how many
slashes
   >there were, and neither did Xenu.

   Not true. Xenu does report "//" as error. Do you have the current
   version?

   Tilman



         Yahoo! Groups Sponsor
               ADVERTISEMENT





----------------------------------------------------------------------------
--
   Yahoo! Groups Links

     a.. To visit your group on the web, go to:
     http://groups.yahoo.com/group/xenu-usergroup/

     b.. To unsubscribe from this group, send an email to:
     xenu-usergroup-unsubscribe@yahoogroups.com

     c.. Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service.



[Non-text portions of this message have been removed]

#218 From: Eugeny.Sattler@...
Date: Fri Feb 11, 2005 5:22 am
Subject: Xenu issues both HEAD and GET commands
accmailer
Send Email Send Email
 
Hi Tilman ,
I have set up a local http server and decided to try checking my local links
via this server
Looking through server logs I noticed that for each link Xenu issues both
HEAD and GET commands.
I wonder why. All the information that is needed (file size, last modified
date, MIME type, server version) is available in HTTP headers so issuing
HEAD command should be enough.

#219 From: Tilman Hausherr <tilman@...>
Date: Fri Feb 11, 2005 6:24 am
Subject: Re: Xenu issues both HEAD and GET commands
geo4497
Send Email Send Email
 
On Fri, 11 Feb 2005 08:22:09 +0300, Eugeny.Sattler@... wrote:

>
>Hi Tilman ,
>I have set up a local http server and decided to try checking my local links
>via this server
>Looking through server logs I noticed that for each link Xenu issues both
>HEAD and GET commands.
>I wonder why. All the information that is needed (file size, last modified
>date, MIME type, server version) is available in HTTP headers so issuing
>HEAD command should be enough.

Xenu does both if the server returns an error for the HEAD command. At
the retry, Xenu would send a GET.

Tilman

#220 From: Tilman Hausherr <tilman@...>
Date: Sat Feb 12, 2005 7:23 pm
Subject: exclude filelist.xml, editdata.mso and oledata.mso
geo4497
Send Email Send Email
 
For those who dreamed of excluding filelist.xml, editdata.mso and
oledata.mso, you can now do it in the XENU.INI file:

[Options]
ExcludeMSO=1

download:
http://home.snafu.de/tilman/tmp/xenubeta.zip

#221 From: "Farrell, Jenny" <JFarrell@...>
Date: Mon Feb 7, 2005 8:55 am
Subject: RE: Large reports fail to open
JFarrell@...
Send Email Send Email
 
Frank,

I have a problem with large reports but they will open eventually.
However, the reason it seems to show so many links is because it doesn't
completely check. It seems to find a small number of links then timeout
and say they all failed. I have to run it around 100 times over and over
to get it to breakdown that list - first it climbs up bit by bit until
it hits the correct number of pages then I have to force it to keep
trying until it goes back through them al and eventually we get to an
acceptable number of broken links.

Hope this helps,

Jenny

-----Original Message-----
From: Frank Visser [mailto:f.visser3@...]
Sent: 04 February 2005 19:51
To: xenu-usergroup@yahoogroups.com
Subject: RE: [xenu-usergroup] Large reports fail to open


Looking closer at my configuration, i have a pagefile of 1024 Mb on a D:
partitioning of my hard disk.



The available space on D: is 2791 Mb.



Anyone?





frank



========================================

Frank Visser, Waterpoortweg 279, 1051 pv, Amsterdam

Author of: Ken Wilber: Thought as Passion SUNY 2003

Read all about Ken Wilber : http:// <http://www.integralworld.net>
www.integralworld.net

========================================

   _____

From: frank visser [mailto:f.visser3@...]
Sent: vrijdag 4 februari 2005 20:00
To: xenu-usergroup@yahoogroups.com
Subject: [xenu-usergroup] Large reports fail to open




hi all,

does anyone have experience with large xen reports (over 20.000
links)?

when they are done and i try to open a web browser report ("R"),
xenu crashes.

is this something about memory limitations?

i have 512 MB ram and a virtual memory paging file of 1024 Mb.

any help is welcome,

frank






   _____

Yahoo! Groups Links

* To visit your group on the web, go to:
http://groups.yahoo.com/group/xenu-usergroup/

* To unsubscribe from this group, send an email to:
xenu-usergroup-unsubscribe@yahoogroups.com
<mailto:xenu-usergroup-unsubscribe@yahoogroups.com?subject=Unsubscribe>

* Your use of Yahoo! Groups is subject to the Yahoo!
<http://docs.yahoo.com/info/terms/>  Terms of Service.



[Non-text portions of this message have been removed]




Yahoo! Groups Links









Visit our website at http://www.aqa.org.uk.

DISCLAIMER:
This e-mail is intended solely for the addressee, is strictly confidential, and
may also be legally privileged.  If you are not the addressee you may not read,
print, re-transmit, store or act in reliance on it or any attachments.  Please
also destroy this message and notify us immediately by reply.

#222 From: David.Menges@...
Date: Mon Feb 7, 2005 7:54 pm
Subject: Lots of "no connections"?
davidmenges
Send Email Send Email
 
Hello.  I'm getting lots of "no connection"s where I used to never get
them.  It works for a while, but after about 10% of the final list is
generated, "no connection"s start happening, and soon afterwards ALL
errors are "no connection"s.

I tried these things:
   - Increase timeout config:  added "timeout=120" to xenu.ini;
restarted Xenu.
   - Turned off HTTP 1.1.
   - Unchecked orphan report, and then all but "broken links by links".
   - Increased threads from 1 to 8, 30, 70, 100.
   - A search string of "http://www.uchsc.edu/" and internal site of
"*.uchsc.edu", then "http://www.uchsc.edu" and no internal sites.

My environment is a Windows XP Pro SP 1 desktop running XENU 1.2f,
querying a Red Hat Enterprise Linux version __, running "Server:
Apache/1.3.31 (Unix) PHP/5.0.0 FrontPage/5.0.2.2510 mod_ssl/2.8.19
OpenSSL/0.9.7d".  Everything is fully patched, though not nec. at the
latest versions.

The web server (www.uchsc.edu) is not busy.  If I "telnet
www.uchsc.edu 80" with HTTP 1.1 it complains that I did not send a
fully-qualified host name (though my browser wasn't having a problem).

The only things left that I can think of:
   - a loop in the HTML?
   - an Apache config mistake (unlikely)?
   - I can try it on a Windows/IIS server here.

I can provide anything you'd like - my XENU.ini, XENU config, etc.

#223 From: Tilman Hausherr <tilman@...>
Date: Sun Feb 20, 2005 10:34 pm
Subject: Re: Large reports fail to open
geo4497
Send Email Send Email
 
On Mon, 7 Feb 2005 08:55:02 -0000, Farrell, Jenny wrote:

>Frank,
>
>I have a problem with large reports but they will open eventually.
>However, the reason it seems to show so many links is because it doesn't
>completely check. It seems to find a small number of links then timeout
>and say they all failed. I have to run it around 100 times over and over
>to get it to breakdown that list - first it climbs up bit by bit until
>it hits the correct number of pages then I have to force it to keep
>trying until it goes back through them al and eventually we get to an
>acceptable number of broken links.

I'd recommend to set less threads. Since I have DSL, I work best with
only 5-10.

#224 From: "Frank Visser" <f.visser3@...>
Date: Sun Feb 20, 2005 11:39 pm
Subject: RE: Large reports fail to open
reusvisser
Send Email Send Email
 
Hi tilman,



Did you respond to the orginal issue mentioned in this thread: reports above
9.000 links fail to open in a browser for me?



(was on holiday for 2 weeks, so perhaps I have missed that mail).



My pagefile settings and all that were mentioned in the original posting.



Would be great to know what exactly is the bottle neck here.



Tnx,



frank



========================================

Frank Visser, Waterpoortweg 279, 1051 pv, Amsterdam

Author of: Ken Wilber: Thought as Passion SUNY 2003

Read all about Ken Wilber : http:// <http://www.integralworld.net>
www.integralworld.net

========================================

   _____

From: Tilman Hausherr [mailto:tilman@...]
Sent: zondag 20 februari 2005 23:35
To: xenu-usergroup@yahoogroups.com
Subject: Re: [xenu-usergroup] Large reports fail to open



On Mon, 7 Feb 2005 08:55:02 -0000, Farrell, Jenny wrote:

>Frank,
>
>I have a problem with large reports but they will open eventually.
>However, the reason it seems to show so many links is because it doesn't
>completely check. It seems to find a small number of links then timeout
>and say they all failed. I have to run it around 100 times over and over
>to get it to breakdown that list - first it climbs up bit by bit until
>it hits the correct number of pages then I have to force it to keep
>trying until it goes back through them al and eventually we get to an
>acceptable number of broken links.

I'd recommend to set less threads. Since I have DSL, I work best with
only 5-10.





Yahoo! Groups Sponsor



<http://us.ard.yahoo.com/SIG=129dsstmd/M=324658.6070095.7083352.3001176/D=gr
oups/S=1705005512:HM/EXP=1109025299/A=2343726/R=0/SIG=12inaei6l/*http:/clk.a
tdmt.com/VON/go/yhxxxvon01900091von/direct/01/&time=1108938899943570>
<http://us.ard.yahoo.com/SIG=129dsstmd/M=324658.6070095.7083352.3001176/D=gr
oups/S=1705005512:HM/EXP=1109025299/A=2343726/R=1/SIG=12inaei6l/*http:/clk.a
tdmt.com/VON/go/yhxxxvon01900091von/direct/01/&time=1108938899943570>

Get unlimited calls to
<http://us.ard.yahoo.com/SIG=129dsstmd/M=324658.6070095.7083352.3001176/D=gr
oups/S=1705005512:HM/EXP=1109025299/A=2343726/R=1/SIG=12inaei6l/*http:/clk.a
tdmt.com/VON/go/yhxxxvon01900091von/direct/01/&time=1108938899943570>

U.S./Canada
<http://us.ard.yahoo.com/SIG=129dsstmd/M=324658.6070095.7083352.3001176/D=gr
oups/S=1705005512:HM/EXP=1109025299/A=2343726/R=1/SIG=12inaei6l/*http:/clk.a
tdmt.com/VON/go/yhxxxvon01900091von/direct/01/&time=1108938899943570>


<http://view.atdmt.com/VON/view/yhxxxvon01900091von/direct/01/&time=11089388
99943570>



<http://us.adserver.yahoo.com/l?M=324658.6070095.7083352.3001176/D=groups/S=
:HM/A=2343726/rand=954772946>



   _____

Yahoo! Groups Links

* To visit your group on the web, go to:
http://groups.yahoo.com/group/xenu-usergroup/

* To unsubscribe from this group, send an email to:
xenu-usergroup-unsubscribe@yahoogroups.com
<mailto:xenu-usergroup-unsubscribe@yahoogroups.com?subject=Unsubscribe>

* Your use of Yahoo! Groups is subject to the Yahoo!
<http://docs.yahoo.com/info/terms/>  Terms of Service.



[Non-text portions of this message have been removed]

#225 From: Tilman Hausherr <tilman@...>
Date: Mon Feb 21, 2005 12:10 am
Subject: Re: Large reports fail to open
geo4497
Send Email Send Email
 
On Mon, 21 Feb 2005 00:39:45 +0100, Frank Visser wrote:

>
>Hi tilman,
>
>
>
>Did you respond to the orginal issue mentioned in this thread: reports above
>9.000 links fail to open in a browser for me?

No. This is a problem with your browser or your computer. Use a
different browser or a different computer, or correct some links to that
the report get smaller...

Messages 196 - 225 of 1639   Oldest  |  < Older  |  Newer >  |  Newest
Add to My Yahoo!      XML What's This?

Copyright © 2010 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines NEW - Help