Search the web
Sign In
New User? Sign Up
dtsearch · dtSearch Users Group
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want to share photos of your group with the world? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
How to exclude "what to index" site map in dtsearch   Message List  
Reply | Forward Message #1875 of 1910 |
Re: [dtsearch] How to exclude "what to index" site map in dtsearch


>I have a site map within my dynamic cms that I do not want included
>in the resulting index. I've tried numerous attempts with filename
>filters and exclude filters, but it almost seems like the web path
>used as the index starting page is always included in the resulting index.
>Is there a way to exclude the "what to index" web path from the
>resulting index without having to traverse through the resulting
>dataset to remove it?

To exclude the page, you can add a NoIndex metadata to the page, like this:

<META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW">

For more information on using robots meta tags, see:
http://www.robotstxt.org/meta.html

David Thede
dtSearch Corp.





Wed Apr 1, 2009 12:45 pm

davidthede
Offline Offline
Send Email Send Email

Forward
Message #1875 of 1910 |
Expand Messages Author Sort by Date

I have a site map within my dynamic cms that I do not want included in the resulting index. I've tried numerous attempts with filename filters and exclude...
Mike Romanzow
mromanzow
Offline Send Email
Mar 31, 2009
3:41 pm

... To exclude the page, you can add a NoIndex metadata to the page, like this: <META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW"> For more information on using...
David Thede
davidthede
Offline Send Email
Apr 1, 2009
1:08 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help