Search the web
Sign In
New User? Sign Up
pavuk · Pavuk Webgrabber Mailing List
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Show off your group to the world. Share a photo of your group with us.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Pavuk only mirrors top-level directory   Message List  
Reply | Forward Message #731 of 988 |
Hi,

I'm trying to use pavuk to mirror the cygwin distribution, but it
fails to mirror the sub-directories, i.e.:

pavuk -mode sync \
-ftp_proxy XXX.XXX.XXX.XXX:XX \
-ftp_httpgw \
-preserve_time \
-dsfx src.tar.bz2,-src.tar.gz,gif \
-dprefix xfree \
-remove_old \
-dont_leave_dir \
-dont_leave_site \
-base_level 4 \
-default_prefix ftp://sunsite.dk/mirrors/cygwin \
-progress \
-cdir /reuters/mirrors/test \
ftp://sunsite.dk/mirrors/cygwin

gives as output:

URL[ 2]: 2(0) of 9 ftp://sunsite.dk/mirrors/
Disallowed by rules
URL[ 2]: 3(1) of 9 ftp://sunsite.dk/mirrors/cygwin/release/
Disallowed by rules
URL[ 1]: 1(0) of 1 ftp://sunsite.dk/mirrors/cygwin
S: 2697 B [R: 29.8 kB/s] [ET: 0:00:00]
download: OK
URL[ 2]: 4(2) of 9 ftp://sunsite.dk/mirrors/cygwin/setup.bz2
download: MESSAGE: reget unneeded - file is up to date
URL[ 3]: 5(2) of 9 ftp://sunsite.dk/mirrors/cygwin/setup.exe
download: MESSAGE: reget unneeded - file is up to date
URL[ 3]: 8(2) of 9 ftp://sunsite.dk/mirrors/cygwin/tmp/
Disallowed by rules
URL[ 3]: 9(3) of 9 ftp://sunsite.dk/mirrors/cygwin/xfree/
Disallowed by rules
URL[ 1]: 6(2) of 9 ftp://sunsite.dk/mirrors/cygwin/setup.exe.old
download: MESSAGE: reget unneeded - file is up to date
URL[ 2]: 7(2) of 9 ftp://sunsite.dk/mirrors/cygwin/setup.ini
download: MESSAGE: reget unneeded - file is up to date

As you can see, somehow it believes that the 'release' directory is
"disallowed by rules". I don't understand why it thinks that.

How do I change my command line so that pavuk also retrieves
everything below the release/ directory (but nothing from under the
'xfree/' directory)?

Kind regards,

Maarten





Sun Nov 16, 2003 7:36 am

boekhold
Offline Offline
Send Email Send Email

Forward
Message #731 of 988 |
Expand Messages Author Sort by Date

Hi, I'm trying to use pavuk to mirror the cygwin distribution, but it fails to mirror the sub-directories, i.e.: pavuk -mode sync \ -ftp_proxy...
boekhold
Offline Send Email
Nov 19, 2003
8:19 am
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help