Search the web
Sign In
New User? Sign Up
dtsearch · dtSearch Users Group
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Real people. Real stories. See how Yahoo! Groups impacts members worldwide.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
question about dtsearch spider   Message List  
Reply | Forward Message #1756 of 1910 |
Re: [dtsearch] Re: question about dtsearch spider

Hi Jim,

That was very insightful. Thanks.  I believe I will count on the speed of the spider to index dynamic Web content to add some monitoring capabilities to it.

Dimitar

----- Original Message ----
From: Jim Dow <jimmydow@...>
To: dtsearch@yahoogroups.com
Sent: Tuesday, November 28, 2006 12:25:44 PM
Subject: [dtsearch] Re: question about dtsearch spider

Hi Dimitar,

The dtSearch spider is not necessarily a monitoring tool.

For static web content, It has the ability to index only the content
that is new, deleted (remove from index) or modified.

For dynamic web sites, I have not proved it out yet, but I believe it
cannot identify modified content:

- I'm not sure how it would compare dates since the dynamic content
will have a create date the same day as the spider does the crawl.

- This is a capability (dynamic web content - updating only of new or
changed) I have not asked dtSearch Support about yet.

Even though I am re-indexing all dynamic content (because I don't
know the answer yet)...it is fast!!!!

Jim

--- In dtsearch@yahoogroup s.com, Dimitar Georgievski
<dgeorgievski@ ...> wrote:
>
> hi,
>
> Can I use the spider to monitor and track changes on a Web site?
>
> Thanks,
>
> Dimitar
>
>
>
>
>
____________ _________ _________ _________ _________ _________ _
____________ __
> Want to start your own business?
> Learn how on Yahoo! Small Business.
> http://smallbusines s.yahoo.com/ r-index
>




Want to start your own business? Learn how on Yahoo! Small Business.

Wed Nov 29, 2006 10:03 pm

dgeorgievski
Online Now Online Now
Send Email Send Email

Forward
Message #1756 of 1910 |
Expand Messages Author Sort by Date

hi, Can I use the spider to monitor and track changes on a Web site? Thanks, Dimitar ...
Dimitar Georgievski
dgeorgievski
Online Now Send Email
Nov 28, 2006
3:23 am

Hi Dimitar, The dtSearch spider is not necessarily a monitoring tool. For static web content, It has the ability to index only the content that is new, deleted...
Jim Dow
jpdow01
Offline Send Email
Nov 28, 2006
6:52 pm

Hi Jim, That was very insightful. Thanks. I believe I will count on the speed of the spider to index dynamic Web content to add some monitoring capabilities...
Dimitar Georgievski
dgeorgievski
Online Now Send Email
Dec 2, 2006
7:28 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help