pavuk : Message: Pavuk is downloading too many site

pavuk · Pavuk Webgrabber Mailing List

Want to share photos of your group with the world? Add a group photo to Flickr.

Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Pavuk is downloading too many site

Message #864 of 988 |

Hi,

i have a question. I want Pavuk to download 10 pages from one site.
The URL is http://www.domain.com -lmax 1 -pattern
http://www.domain.com/article*

When I visit the site http://www.domain.com I can find about 10 Links
like http://www.domain.com/article*, but when I start Pavuk it is
downloading about 5000 sites. I have no clue what's going on ... :-(

Thank you very much

Lila

Mon May 14, 2007 12:46 pm

"lilakunz" <lilakunz@...>

Offline

Message #864 of 988 |

Expand Messages	Author	Sort by Date
Hi, i have a question. I want Pavuk to download 10 pages from one site. The URL is http://www.domain.com -lmax 1 -pattern http://www.domain.com/article* When...	lilakunz	May 14, 2007 12:51 pm
You might want to try the additional -adomain commandline argument (= accept only these domains), e.g. -adomain www.domain.com in order to restrict pavuk to...	Gerrit E.G. Hobbelt i_a42	May 14, 2007 11:45 pm
Hi, thank you really much, but unfortunately that didn't help :-(, because the sites have the same domain. I can give you an example: I have the site...	lilakunz	May 15, 2007 1:38 pm