That was very insightful. Thanks. I believe I will count on the speed of the spider to index dynamic Web content to add some monitoring capabilities to it.
Dimitar
From: Jim Dow <jimmydow@...>
To: dtsearch@yahoogroups.com
Sent: Tuesday, November 28, 2006 12:25:44 PM
Subject: [dtsearch] Re: question about dtsearch spider
Hi Dimitar,
The dtSearch spider is not necessarily a monitoring tool.
For static web content, It has the ability to index only the content
that is new, deleted (remove from index) or modified.
For dynamic web sites, I have not proved it out yet, but I believe it
cannot identify modified content:
- I'm not sure how it would compare dates since the dynamic content
will have a create date the same day as the spider does the crawl.
- This is a capability (dynamic web content - updating only of new or
changed) I have not asked dtSearch Support about yet.
Even though I am re-indexing all dynamic content (because I don't
know the answer yet)...it is fast!!!!
Jim
--- In dtsearch@yahoogroup s.com, Dimitar Georgievski
<dgeorgievski@ ...> wrote:
>
> hi,
>
> Can I use the spider to monitor and track changes on a Web site?
>
> Thanks,
>
> Dimitar
>
>
>
>
>
____________ _________ _________ _________ _________ _________ _
____________ __
> Want to start your own business?
> Learn how on Yahoo! Small Business.
> http://smallbusines s.yahoo.com/ r-index
>
Want to start your own business? Learn how on Yahoo! Small Business.