Hello everybody!
I need to mirror sites that need suscription.
This validation is done standardly by the web server.
In this server there is a robots.txt.
I,m trying but I only have succes with public pages.
I need to do it by command line.
Could you tell me how to do a script that worked?
Thanks in advanced! and waiting desperately for an answer
Alicia
Yahoo! Groups TipsDid you know...Want to share photos of your group with the world? Add a group photo to Flickr. |
Having problems with message search?
Fill out this form to ensure your group is one of the first to be migrated to the new message search system.
|
Offline 
Send Email