Search the web
Sign In
New User? Sign Up
archive-crawler
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Hear how Yahoo! Groups has changed the lives of others. Take me there.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Crawl stops after some time   Message List  
Reply | Forward Message #5909 of 6142 |
Re: [archive-crawler] Crawl stops after some time

Hi Gordon,

An instance pretty much stopped ( like 0 active toe threads of 50 ). But it continued after sometime.

Regards
Abin Varghese

--- On Tue, 30/6/09, Gordon Mohr <gojomo@...> wrote:

From: Gordon Mohr <gojomo@...>
Subject: Re: [archive-crawler] Crawl stops after some time
To: archive-crawler@yahoogroups.com
Date: Tuesday, 30 June, 2009, 2:03 PM

Hi, Abin.

This suggests one necessary component (the JE disk-based datastore) has
closed while the rest of the crawl tried to continue.

It might be a side-effect of earlier problem which is the real cause --
an IO or memory problem, for example. Are there any other earlier
'Alerts' in the web console, or other exceptions in the heritrix_out. log?

- Gordon @ IA

mail2abin wrote:
> Hi,
>
> I am a new user Heritrix. Installed it, used some of its wonderful features in ( filters,scoping, frontier etc ). But it is giving me an exception as shown below after a while.
>
> Need to know the reason and fix.
> I am running this on
>
> Windows Machine XP , 256 MB RAM ,java version "1.6.0_12".
> Heritrix 1.14.3
> I hope someone would have answer.
>
> ============ ========= ========= ========= ========= ========= ======
> Problem com.sleepycat. util.RuntimeExce ptionWrapper: (JE 3.3.75) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN occured when trying to process 'http://www.cs. stonybrook. edu/undergrad/ honors/im3a. jpg' at step ABOUT_TO_BEGIN_ PROCESSOR in HTTP
> (in thread 'ToeThread #19: http://www.cs. stonybrook. edu/undergrad/ honors/im3a. jpg'; in processor 'HTTP')
> ============ ========= ========= ========= ========= ========= =========
>
> Thanks and Regards
> Abin Varghese
> Stony Brook University
>
>
>
> ------------ --------- --------- ------
>
> Yahoo! Groups Links
>
>
>



Cricket on your mind? Visit the ultimate cricket website. Enter now!

Wed Jul 1, 2009 2:05 am

mail2abin
Offline Offline
Send Email Send Email

Forward
Message #5909 of 6142 |
Expand Messages Author Sort by Date

Hi, I am a new user Heritrix. Installed it, used some of its wonderful features in ( filters,scoping, frontier etc ). But it is giving me an exception as shown...
mail2abin
Offline Send Email
Jun 30, 2009
8:59 pm

Hi, Abin. This suggests one necessary component (the JE disk-based datastore) has closed while the rest of the crawl tried to continue. It might be a...
Gordon Mohr
gojomo
Online Now Send Email
Jun 30, 2009
9:04 pm

Hi Gordon, An instance pretty much stopped ( like 0 active toe threads of 50 ). But it continued after sometime. Regards Abin Varghese ... From: Gordon Mohr...
Ebin
mail2abin
Offline Send Email
Jul 1, 2009
2:07 am
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help