Search the web
Sign In
New User? Sign Up
search_dev · Independent Search Engine Developers
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want your group to be featured on the Yahoo! Groups website? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Messages 845 - 859 of 859   Newest  |  < Newer  |  Older >  |  Oldest
Messages: Show Message Summaries   (Group by Topic) Sort by Date v  
#859 From: "Linda" <Linda@...>
Date: Tue Dec 1, 2009 7:35 pm
Subject: Lead Business Analyst - eCommerce - Endeca or Mercado Chicago low $100's
lindaabenton
Offline Offline
Send Email Send Email
 
Lead Business Analyst - Ecommerce – Endeca or Mercado
B2B Chicago Distributor
US Citizen, PR or Green Card only
No relo assistance



JOB PURPOSE:
•  Subject matter expert in creating, delivering and managing the Search Roadmap
Endeca based functional improvements for the Global platforms
•  Company is looking to morph from catalog base to a savvy eCommerce firm
•  Excellent understanding of  Product Data and how it ties into Search – core
function of the role
•  To liaise with the global and regional eCommerce teams to solidify and
deliver functional and UI related Search enhancements


15% of the role is reporting with eCommerce team
40% is requirements gathering, road mapping
15% is measurement pc
30% is managing matrix resources – internal ee's, IT & development team from UK

Initially role will be that of a doer – fast paced environment.  Opportunity
affords a vertical leap into mgmt as this eCommerce role grows

No coding and development pc to this role - must be able to hand off
requirements to development – will influence what goes into search platform –
expert understanding of search data – must be able to decrease" no search"
results.  Feedback from stake holders will assess how to blend this into search.


RESPONSIBILITIES:
• Create/build, manage and deliver Search functionality through all Company
websites that currently utilize either Endeca or other Search engines and to
create a roadmap detailing the evolution of the applicable functionality.  This
includes four different businesses involved under parent company.
• Collect and report key search metrics to global stakeholders on a weekly and
monthly basis.
• Collect search requirements from regional and global eCommerce teams, regional
marketing functions within the four businesses in an effort to identify and
prioritize improvements to for entry into the Company agile development list of
prioritized global requirements.
• Help author and then implement the overall Search strategy for all Company
transactional websites, as well as, Community website, intranet, and eSupplier
web properties.
• Monitor and serve as technical expert on all Endeca related search
improvements and to take a leadership role in the quality review and measurement
of those improvements.
• Work with GIS, Endeca and Google to keep the organization up to date with the
latest version based functional enhancements and to make recommendations for
updates based on external vendor roadmaps.
• Work with Infrastructure and Architectural teams to define hardware and
software requirements necessary to support Search related improvements
• Work with UI designers and eCommerce UCD team to benchmark and make
recommendations for UI related Search and Product Data improvements
• Work with Product Data Group to make sure usable product data is returned from
the Search engine following a Customer query
• Serve as the functional subject matter expert and be able to create, explain
the overall Endeca, Google, and ClearSpace, engine related Search vision and how
this vision fits within/compliments the overall vision around Product Data.
• Help to drive the requirements engineering phase of any Search related
projects and participate in work/effort estimation on a per project basis.  The
Business Analyst – eCommerce will also take on a lead role in any QA related
improvement around Search.
• Ensure Regional eCommerce teams are fully trained and exploiting Web Studio,
Endeca Merchandising, Google search and ClearSpace search functionality.

REQUIREMENTS:
• Degree Qualified – BSE (preferred) with 5-7 years eCommerce experience;
Content management Systems, extranets and micro-stores are pluses
• Implementation of Endeca or Mercado an absolute must!  Strong technical
understanding of Endeca (wildcarding, A graphs, D graphs, parametric search,
etc) and other Search applications.  Familiarity with Google and ClearSpace
search a plus
• Excellent understanding of  Product Data and how it ties into Search   Note: 
core function of the role
• Strong written, verbal communication and presentation skills for development
groups and business partners to understand at all levels of the organization
• Strong ability to prioritize simultaneous enhancement requests from various
stakeholders based on quantitative metrics around ROI and CBA
• Excellent ability to translate metrics and analytical data into design and
functional recommendations; work closely with development teams to translate
into technical specifications.  Strong analytical skills.
• Experience of online marketing including; email marketing, SEO, PPC and
affiliate programs
• Required travel of up to 15% to UK and/or APAC.

Qualified candidates please e-mail resume and cover letter to:  
Linda@...
www.BentonSearch.com

#858 From: "The one who went on about her work problem." <whitkat2002@...>
Date: Fri Nov 27, 2009 8:41 pm
Subject: Re: Quality of new relevance ranking mechanisms in GSA (6)
whitkat2002
Offline Offline
Send Email Send Email
 
I am keen to hear about the self-learning scorer.  Do you need to "seed" this. .
.in other words, how does it get the "best results" up where people can click on
them?

Kathy

--- In search_dev@yahoogroups.com, Arthur Gaasenbeek <agaasenb@...> wrote:
>
>
>
>
> Hi,
>
>
>
> Traditional enterprise search applications like Autonomy or Fast offer
> the ability to tune the relevance.
>
>
>
> Does anyone has experience(good or bad)
> with the Search results Biasing - relevance ranking mechanism of Google
> Search Appliance ?
>
>
>
> The GSA does have some relevance ranking mechanism, Google calls this
> functionality Search Results Biasing.
> Using a simple interface, you can add bias or weight to search results,
> based on the following criteria: Data Source (SharePoint versus File Share),
> Date Bias (Newer is more relevant than Older or vice versa),  Metadata Bias
(Data with a specified Metadata
> parameter is more relevant than other data)
>
>
>
> Next to that Google introduced a new feature for GSA 6 which automatically
improves results over
> time, the "Self-Learning Scorer" –  analyzes employee clicks and behavior
> to automatically fine-tune and improve its built-in relevance. For instance,
if
> most users click on the fourth result for a given query, the GSA recognizes
> that and automatically boosts its placement – without any intervention from an
> administrator. So, After the content is crawled the
> GSA will automatically tune the relevancy taking user behavior into account.
>
>
>
> So, does anyone has experience with this Search Result Biasing and Self
> Learning Scorer ? Can it compete with the relevance ranking mechanisms of
> search applications like Autonomy, fast etc. ?
>
>
>
> Thanks
>
>  Arthur
>
>
>
> _________________________________________________________________
> Hotmail: Trusted email with Microsoft's powerful SPAM protection.
> http://clk.atdmt.com/GBL/go/177141664/direct/01/
> http://clk.atdmt.com/GBL/go/177141664/direct/01/
>

#857 From: Arthur Gaasenbeek <agaasenb@...>
Date: Thu Nov 26, 2009 7:31 pm
Subject: Quality of new relevance ranking mechanisms in GSA (6)
agaasenb
Offline Offline
Send Email Send Email
 

Hi,

 

Traditional enterprise search applications like Autonomy or Fast offer the ability to tune the relevance.

 

Does anyone has experience(good or bad)  with the Search results Biasing - relevance ranking mechanism of Google Search Appliance ?

 

The GSA does have some relevance ranking mechanism, Google calls this functionality Search Results Biasing.  Using a simple interface, you can add bias or weight to search results, based on the following criteria: Data Source (SharePoint versus File Share), Date Bias (Newer is more relevant than Older or vice versa),  Metadata Bias (Data with a specified Metadata parameter is more relevant than other data)

 

Next to that Google introduced a new feature for GSA 6 which automatically improves results over time, the “Self-Learning Scorer” –  analyzes employee clicks and behavior to automatically fine-tune and improve its built-in relevance. For instance, if most users click on the fourth result for a given query, the GSA recognizes that and automatically boosts its placement – without any intervention from an administrator. So, After the content is crawled the GSA will automatically tune the relevancy taking user behavior into account. 

 

So, does anyone has experience with this Search Result Biasing and Self Learning Scorer ? Can it compete with the relevance ranking mechanisms of search applications like Autonomy, fast etc. ?

 

Thanks

 

Arthur



Hotmail: Trusted email with Microsoft's powerful SPAM protection. Sign up now.

#856 From: Mark Bennett <mbennett.ideaeng@...>
Date: Wed Nov 25, 2009 4:32 am
Subject: Re: Error in verity search result
ttennebkram
Offline Offline
Send Email Send Email
 
Hello,

So I have not seen this error before.  So just some guesses and things I'd check....

A quick question, is the old K2 version, or the new IDOL based version?

Normally I'd think "no query plan could be created" sounds like a parsing issue.  But then you say if you run it enough times it works, so that sort of blows that theory.

If it's intermittent like that then I'd start to think maybe resources.  Memory, file handles.  Or perhaps query length, URL length, etc.

Looking at your error, are you using the projectids field as part of your query?  Or perhaps as part of a faceted query?

Is it possible that you're passing an language / locale parameter, but that sometimes it's null?  Or sometimes included in the URL more than once?

Does it happen with a small data set?

Have you tested the queries you send to the engine with the testqp utility?

Have you tried running the queries with rcvdk and rck2?

Also, have you looked to see if there's a newer version of the software?

Or talked with Open Text or Autonomy support?  Since you're using it as part of a third party package, I don't know if the business relationship facilitates you contacting Autonomy directly.

Another option, "the elephant in the room", is to switch to a different search engine.  There are many good ones out there.

--
Mark Bennett / New Idea Engineering, Inc. / mbennett@...
Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513


On Tue, Nov 24, 2009 at 7:38 AM, rakesh kumar <joinrakee2004@...> wrote:
 

Hi All,

This group has been very helpful on most of my verity related questions and I am very thankful for that. But what can I do, With limited documentation available with the product and being a new user of verity, I can't stop asking more questions

We use verity search engine coming with Reddot liveserver(Currently called OpenText Delivery Server). We have 2 variants of indexes, English and French.By sending 'en' or 'fr' as parameters we can search in index of a particular language.
We have 2 boxes which are a carbon copies of each other. But we are getting error messages on one of the machine. The same search query some times gives us the intended result but many times it gives the following error:

"For the combination of ProjectIDs and localeStrings, no query plan could be created"

When i do a refresh for like for 10 times or do the same search in other window , I get the search result again. Just to inform , I disabled search caching. I can find a similar question in other forums but with no answers.So,I was hoping if you guys can help me out on this.Please do reply if possible.

Thanks in Advance,
Regards,
Rakesh.




The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.


#855 From: rakesh kumar <joinrakee2004@...>
Date: Tue Nov 24, 2009 3:38 pm
Subject: Error in verity search result
joinrakee2004
Offline Offline
Send Email Send Email
 
Hi All,

This group has been very helpful on most of my verity related questions and I am very thankful for that. But what can I do, With limited documentation available with the product and being a new user of verity, I can't stop asking more questions

We use verity search engine coming with Reddot liveserver(Currently called OpenText Delivery Server). We have 2 variants of indexes, English and French.By sending 'en' or 'fr' as parameters we can search in index of a particular language.
We have 2 boxes which are a carbon copies of each other. But we are getting error messages on one of the machine. The same search query some times gives us the intended result but many times it gives the following error:

"For the combination of ProjectIDs and localeStrings, no query plan could be created"

When i do a refresh for like for 10 times or do the same search in other window , I get the search result again. Just to inform , I disabled search caching. I can find a similar question in other forums but with no answers.So,I was hoping if you guys can help me out on this.Please do reply if possible.

Thanks in Advance,
Regards,
Rakesh.




The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.

#854 From: rakesh kumar <joinrakee2004@...>
Date: Tue Nov 24, 2009 3:22 pm
Subject: Re: Re: Optimizing Verity Indexes
joinrakee2004
Offline Offline
Send Email Send Email
 
Thank you very much for the reply.

Regards,
Rakesh.


From: knewit_fooo <fokke@...>
To: search_dev@yahoogroups.com
Sent: Fri, 20 November, 2009 11:47:04 PM
Subject: [search_dev] Re: Optimizing Verity Indexes

 

Rakesh,

Maxmerge merges partition (files in the parts directory of your collection). Try to run

mkvdk -collection <path> -optimize tuneup-squeeze- ngramindex

Tuneup is a combination of maxmerge and spanword (creates a spanning word list, which is a list of all words from all partition files).
Squeeze removes all deleted files (normaly deleted files are only flagged as deleted).
ngramindex speeds up wildcard searches. You can only use this flag if you also build a spanning word list.

You also might want to run the optimize with the maxclean flag, which removes unused partition files but you can only do that on an offline collection.

Regards,

Fokke Oosterhoff
KnowledgePlaza
f.oosterhoff@ knowledgeplaza. nl

--- In search_dev@yahoogro ups.com, rakesh kumar <joinrakee2004@ ...> wrote:
>
> Hi,
>
> We use LiveServer verity k2 server search engine for indexing xml files. Currently we have about 200K files that have been indexed.
>
> But with the UI search, We feel the results are coming slow. How can i modify indexes to make searches faster.
>
> I have tried mkvdk collection -path -optimize maxmerge, merging partitions.
>
> Is there some more commands that can help me optimizing indexes amd make searches faster.
>
> One more doubt i have is :: mkvdk collection -path -optimize maxmerge
> says mkvdk done in 2-3 seconds.
>
> But the index size is nearly 1 gb. Doesn't it take more time doing the operation. Does mkvdk done mean the operation is done.
>
> Please do reply,
>
> Thanks in advance,
> Regards,
> Rakesh.
>
>
>
> The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo. com/
>



The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.

#853 From: "Linda" <Linda@...>
Date: Wed Nov 18, 2009 8:33 pm
Subject: Lead Business Analyst - eCommerce - Endeca or Mercado Chicago
lindaabenton
Offline Offline
Send Email Send Email
 
Lead Business Analyst - Ecommerce – Endeca or Mercado
B2B Chicago Distributor
US Citizen, PR or Green Card only
No relo assistance

JOB PURPOSE:
• Subject matter expert in creating, delivering and managing the Search Roadmap
Endeca based functional improvements for the Global platforms
• Company is looking to morph from catalog base to a savvy eCommerce firm
• Excellent understanding of  Product Data and how it ties into Search – core
function of the role
• To liaise with the global and regional eCommerce teams to solidify and deliver
functional and UI related Search enhancements


15% of the role is reporting with eCommerce team
40% is requirements gathering, road mapping
15% is measurement pc
30% is managing matrix resources – internal ee's, IT & development team from UK

Initially role will be that of a doer – fast paced environment.  Opportunity
affords a vertical leap into mgmt as this eCommerce role grows

No coding and development pc to this role - must be able to hand off
requirements to development – will influence what goes into search platform –
expert understanding of search data – must be able to decrease" no search"
results.  Feedback from stake holders will assess how to blend this into search.

RESPONSIBILITIES:
• Create/build, manage and deliver Search functionality through all Company
websites that currently utilize either Endeca or other Search engines and to
create a roadmap detailing the evolution of the applicable functionality.  This
includes four different businesses involved under parent company.
• Collect and report key search metrics to global stakeholders on a weekly and
monthly basis.
• Collect search requirements from regional and global eCommerce teams, regional
marketing functions within the four businesses in an effort to identify and
prioritize improvements to for entry into the Company agile development list of
prioritized global requirements.
• Help author and then implement the overall Search strategy for all Company
transactional websites, as well as, Community website, intranet, and eSupplier
web properties.
• Monitor and serve as technical expert on all Endeca related search
improvements and to take a leadership role in the quality review and measurement
of those improvements.
• Work with GIS, Endeca and Google to keep the organization up to date with the
latest version based functional enhancements and to make recommendations for
updates based on external vendor roadmaps.
• Work with Infrastructure and Architectural teams to define hardware and
software requirements necessary to support Search related improvements
• Work with UI designers and eCommerce UCD team to benchmark and make
recommendations for UI related Search and Product Data improvements
• Work with Product Data Group to make sure usable product data is returned from
the Search engine following a Customer query
• Serve as the functional subject matter expert and be able to create, explain
the overall Endeca, Google, and ClearSpace, engine related Search vision and how
this vision fits within/compliments the overall vision around Product Data.
• Help to drive the requirements engineering phase of any Search related
projects and participate in work/effort estimation on a per project basis.  The
Business Analyst – eCommerce will also take on a lead role in any QA related
improvement around Search.
• Ensure Regional eCommerce teams are fully trained and exploiting Web Studio,
Endeca Merchandising, Google search and ClearSpace search functionality.

REQUIREMENTS:
• Degree Qualified – BSE (preferred) with 5-7 years eCommerce experience;
Content management Systems, extranets and micro-stores are pluses
• Implementation of Endeca or Mercada an absolute must!  Strong technical
understanding of Endeca (wildcarding, A graphs, D graphs, parametric search,
etc) and other Search applications.  Familiarity with Google and Clearspace
search a plus
• Excellent understanding of  Product Data and how it ties into Search   Note: 
core function of the role
• Strong written, verbal communication and presentation skills for development
groups and business partners to understand at all levels of the organization
• Strong ability to prioritize simultaneous enhancement requests from various
stakeholders based on quantitative metrics around ROI and CBA
• Excellent ability to translate metrics and analytical data into design and
functional recommendations; work closely with development teams to translate
into technical specifications.  Strong analytical skills.
• Experience of online marketing including; email marketing, SEO, PPC and
affiliate programs
• Required travel of up to 15% to UK and/or APAC.

Qualified candidates please e-mail resume and cover letter to:  
Linda@...
www.BentonSearch.com

#852 From: "knewit_fooo" <fokke@...>
Date: Fri Nov 20, 2009 6:17 pm
Subject: Re: Optimizing Verity Indexes
knewit_fooo
Offline Offline
Send Email Send Email
 
Rakesh,

Maxmerge merges partition (files in the parts directory of your collection). Try
to run

   mkvdk -collection <path> -optimize tuneup-squeeze-ngramindex

Tuneup is a combination of maxmerge and spanword (creates a spanning word list,
which is a list of all words from all partition files).
Squeeze removes all deleted files (normaly deleted files are only flagged as
deleted).
ngramindex speeds up wildcard searches. You can only use this flag if you also
build a spanning word list.

You also might want to run the optimize with the maxclean flag, which removes
unused partition files but you can only do that on an offline collection.

Regards,

Fokke Oosterhoff
KnowledgePlaza
f.oosterhoff@...

--- In search_dev@yahoogroups.com, rakesh kumar <joinrakee2004@...> wrote:
>
> Hi,
>
> We use LiveServer verity k2 server search engine for indexing xml files.
Currently we have about 200K files that have been indexed.
>
> But with the UI search, We feel the results are coming slow. How can i modify
indexes to make searches faster.
>
> I have tried mkvdk collection -path -optimize maxmerge, merging partitions.
>
> Is there some more commands that can help me optimizing indexes amd make
searches faster.
>
> One more doubt i have is :: mkvdk collection -path -optimize maxmerge
> says mkvdk done in 2-3 seconds.
>
> But the index size is nearly 1 gb. Doesn't it take more time doing the
operation. Does mkvdk done mean the operation is done.
>
> Please do reply,
>
> Thanks in advance,
> Regards,
> Rakesh.
>
>
>
>       The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.
http://in.yahoo.com/
>

#851 From: rakesh kumar <joinrakee2004@...>
Date: Fri Nov 20, 2009 6:40 am
Subject: Optimizing Verity Indexes
joinrakee2004
Offline Offline
Send Email Send Email
 
Hi,

We use LiveServer verity k2 server search engine for indexing xml files. Currently we have about 200K files that have been indexed.

But with the UI search, We feel the results are coming slow. How can i modify indexes to make searches faster.

I have tried mkvdk collection -path -optimize maxmerge, merging partitions.

Is there some more commands that can help me optimizing indexes amd make searches faster.

One more doubt i have is :: mkvdk collection -path -optimize maxmerge
says mkvdk done in 2-3 seconds.

But the index size is nearly 1 gb. Doesn't it take more time doing the operation. Does mkvdk done mean the operation is done.

Please do reply,

Thanks in advance,
Regards,
Rakesh.


The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.

#850 From: rakesh kumar <joinrakee2004@...>
Date: Tue Nov 17, 2009 8:53 am
Subject: Re: Verity sysinfo.log file
joinrakee2004
Offline Offline
Send Email Send Email
 
Thank you very much for the reply.

I am going with reindexing the project. I just want to don't take any risks.

Regards,
Rakesh.


From: Mark Bennett <mbennett.ideaeng@...>
To: search_dev@yahoogroups.com
Sent: Mon, 16 November, 2009 9:33:27 PM
Subject: Re: [search_dev] Verity sysinfo.log file

 

From the first set of errors/log entries you gave, I'd say they look like disk I/O errors.  Perhaps not enough room on the disk or something.  Merge files can get very large.

However, the second set of errors indicate a logical/structural problem with the index.

It's rare for a K2 index to go corrupt, I haven't seen it happen in many years.  However, in this case, I would suspect the index is now in a compromised state.  I don't know why it would start happening now and not earlier, I agree that's an interesting question.

One suggestion would be to rebuild the index from scratch.

Also, if you have been building an index across a network, either with NAS or SAN, or via NFS, etc, I'd suggest trying it on a local disk first, at least until it starts working correctly.  I'm not saying that would cause a problem, but building on a local disk would eliminate a number of potential issues.

Mark

--
Mark Bennett / New Idea Engineering, Inc. / mbennett@ideaeng. com
Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513


On Sat, Nov 14, 2009 at 1:42 AM, rakesh kumar <joinrakee2004@ yahoo.co. in> wrote:
 

Hi,

We use verity search engine that comes with OpenText Delivery Server.

1. Yesterday we uploaded about 85k old xml files for indexing and even though there were negligible indexing errors, Got only 10 files with indexing errors out of them, I could see some more data that i couldn't understand. The sysinfo.log file has this info ::

Fri Nov 13 05:49:19 2009
msg(1): Error   E0-0242 (Vct): Error: Can't write file 0x200011A for optimizing
Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0207 (Transactions) : The following work could not be done or recovered:
Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  START 0 1 MRG 00001174 "Fri Nov 13 05:49:19 2009" "Fri Nov 13 06:29:19 2009" 25777 15334288 1 55501

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  MRG 0 "/usr/local/RedDot/ LiveServer/ tomcat/webapps/ cps/WEB-INF/ lib/se/verity/ data/colls/ test_v_en_ i_0/parts/ 00000833"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  MRG 0 "/usr/local/RedDot/ LiveServer/ tomcat/webapps/ cps/WEB-INF/ lib/se/verity/ data/colls/ test_v_en_ i_0/parts/ 00000999"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  MRG 0 "/usr/local/RedDot/ LiveServer/ tomcat/webapps/ cps/WEB-INF/ lib/se/verity/ data/colls/ test_v_en_ i_0/parts/ 00001166"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  MRG 0 "/usr/local/RedDot/ LiveServer/ tomcat/webapps/ cps/WEB-INF/ lib/se/verity/ data/colls/ test_v_en_ i_0/parts/ 00001171"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  MRG 0 "/usr/local/RedDot/ LiveServer/ tomcat/webapps/ cps/WEB-INF/ lib/se/verity/ data/colls/ test_v_en_ i_0/parts/ 00001172"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  MRG 0 "/usr/local/RedDot/ LiveServer/ tomcat/webapps/ cps/WEB-INF/ lib/se/verity/ data/colls/ test_v_en_ i_0/parts/ 00001173"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions) : >>  END

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0208 (Transactions) : End of problem work

Can  you please tell me what this means? Does this mean that Indexing has failed for some documents and I have to index again. While we were indexing we ran into memory problems as there was no sufficient space for index creation.We then freed some space for indexing. Could that be the issue.

What happens if there no sufficient space for index creation. Does it temporarily stop the creation and then continue once memory is freed or does it just stop and we have to manually start the indexing.

2. When we delete files from index, some times we get the following data in log file.
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 101632' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 101633' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 102533' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 112933' in a range index

We have a tag COMPANYREFID in our xml files. Why didn't we get this error when we indexed it but we get this only when we remove the file from index.

Please do reply, Thanks in advance,
Regards,
Rakesh Kumar J.


The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.



The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.

#849 From: "Ronald Baan | Emid" <rbaan@...>
Date: Sat Nov 14, 2009 10:02 am
Subject: Verity sysinfo.log file
ronald.baan
Offline Offline
Send Email Send Email
 
Rakesh,

Memory and disk problems indeed will cause this. If you are lucky (as the first messages were from an index merge), you do not have to doany cleaning and just run an optimize with a -cleanup.
However, the second set of errors indicate that for some documents something is wrong. Maybe you can trace the refids to re-index only those. If there are too many, or also other errors, re-index is the best choice.
We have had several occassions where a corrupt index gave almost normal results, but they were not correct when we checked them, so be aware of the impact for the end users.

Good luck.

--
met vriendelijke groet / regards,

Ronald Baan
Adviser Search & Collaboration
Emid Consult B.V.
T:  +31 (0)70 - 88 70 700
M: +31 (0) 6 - 514 38 269
I: www.emidconsult.com


#848 From: Mark Bennett <mbennett.ideaeng@...>
Date: Mon Nov 16, 2009 4:03 pm
Subject: Re: Verity sysinfo.log file
ttennebkram
Offline Offline
Send Email Send Email
 
From the first set of errors/log entries you gave, I'd say they look like disk I/O errors.  Perhaps not enough room on the disk or something.  Merge files can get very large.

However, the second set of errors indicate a logical/structural problem with the index.

It's rare for a K2 index to go corrupt, I haven't seen it happen in many years.  However, in this case, I would suspect the index is now in a compromised state.  I don't know why it would start happening now and not earlier, I agree that's an interesting question.

One suggestion would be to rebuild the index from scratch.

Also, if you have been building an index across a network, either with NAS or SAN, or via NFS, etc, I'd suggest trying it on a local disk first, at least until it starts working correctly.  I'm not saying that would cause a problem, but building on a local disk would eliminate a number of potential issues.

Mark

--
Mark Bennett / New Idea Engineering, Inc. / mbennett@...
Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513


On Sat, Nov 14, 2009 at 1:42 AM, rakesh kumar <joinrakee2004@...> wrote:
 

Hi,

We use verity search engine that comes with OpenText Delivery Server.

1. Yesterday we uploaded about 85k old xml files for indexing and even though there were negligible indexing errors, Got only 10 files with indexing errors out of them, I could see some more data that i couldn't understand. The sysinfo.log file has this info ::

Fri Nov 13 05:49:19 2009
msg(1): Error   E0-0242 (Vct): Error: Can't write file 0x200011A for optimizing
Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0207 (Transactions): The following work could not be done or recovered:
Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  START 0 1 MRG 00001174 "Fri Nov 13 05:49:19 2009" "Fri Nov 13 06:29:19 2009" 25777 15334288 1 55501

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00000833"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00000999"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001166"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001171"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001172"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001173"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  END

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0208 (Transactions): End of problem work

Can  you please tell me what this means? Does this mean that Indexing has failed for some documents and I have to index again. While we were indexing we ran into memory problems as there was no sufficient space for index creation.We then freed some space for indexing. Could that be the issue.

What happens if there no sufficient space for index creation. Does it temporarily stop the creation and then continue once memory is freed or does it just stop and we have to manually start the indexing.

2. When we delete files from index, some times we get the following data in log file.
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 101632' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 101633' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 102533' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 112933' in a range index

We have a tag COMPANYREFID in our xml files. Why didn't we get this error when we indexed it but we get this only when we remove the file from index.

Please do reply, Thanks in advance,
Regards,
Rakesh Kumar J.


The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.


#847 From: rakesh kumar <joinrakee2004@...>
Date: Sat Nov 14, 2009 9:42 am
Subject: Verity sysinfo.log file
joinrakee2004
Offline Offline
Send Email Send Email
 
Hi,

We use verity search engine that comes with OpenText Delivery Server.

1. Yesterday we uploaded about 85k old xml files for indexing and even though there were negligible indexing errors, Got only 10 files with indexing errors out of them, I could see some more data that i couldn't understand. The sysinfo.log file has this info ::

Fri Nov 13 05:49:19 2009
msg(1): Error   E0-0242 (Vct): Error: Can't write file 0x200011A for optimizing
Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0207 (Transactions): The following work could not be done or recovered:
Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  START 0 1 MRG 00001174 "Fri Nov 13 05:49:19 2009" "Fri Nov 13 06:29:19 2009" 25777 15334288 1 55501

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00000833"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00000999"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001166"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001171"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001172"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  MRG 0 "/usr/local/RedDot/LiveServer/tomcat/webapps/cps/WEB-INF/lib/se/verity/data/colls/test_v_en_i_0/parts/00001173"

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0209 (Transactions): >>  END

Fri Nov 13 05:49:19 2009
msg(1): Error   E3-0208 (Transactions): End of problem work

Can  you please tell me what this means? Does this mean that Indexing has failed for some documents and I have to index again. While we were indexing we ran into memory problems as there was no sufficient space for index creation.We then freed some space for indexing. Could that be the issue.

What happens if there no sufficient space for index creation. Does it temporarily stop the creation and then continue once memory is freed or does it just stop and we have to manually start the indexing.

2. When we delete files from index, some times we get the following data in log file.
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 101632' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 101633' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 102533' in a range index
Wed Nov 11 16:47:18 2009
msg(1): Warn    E2-0547 (Document Index): Corrupt data entry '>COMPANYREFID 112933' in a range index

We have a tag COMPANYREFID in our xml files. Why didn't we get this error when we indexed it but we get this only when we remove the file from index.

Please do reply, Thanks in advance,
Regards,
Rakesh Kumar J.


The INTERNET now has a personality. YOURS! See your Yahoo! Homepage.

#846 From: "miles_b_kehoe" <mbk@...>
Date: Tue Nov 10, 2009 4:57 am
Subject: SearchDev Dinner at ESS West November 18
miles_b_kehoe
Offline Offline
Send Email Send Email
 
We've just put the final touches on the annual SearchDev dinner in conjunction
with the Enterprise Search Summit West next week in San Jose, California. Anyone
who attends the conference, or anyone in the Bay Area, is welcome to attend.

Lucid Imagination is sponsoring the dinner this year along with New Idea
Engineering, which will be held on Wednesday night, November 18, at 6PM in the
San Jose Hilton, adjacent to the convention center.

Seats are limited, so if you think you will want to attend, please RSVP today to
info(at)ideaeng.com with your name and names of the folks who will join you. Of
course, replace the (at) with @...

Miles

#845 From: philippe deltenre <pdeltenr@...>
Date: Thu Nov 5, 2009 11:30 pm
Subject: Re : Difference between verity and verity k2
pdeltenr
Offline Offline
Send Email Send Email
 
Hi Rakeh,
Following some press release (http://www.internetretailer.com/internet/marketing-conference/85625-reddot-launches-live-server-version-21.html), it seems that Verity K2 v5.5 is the one which is embedded ... Nevertheless, as for any OEM agreement, it should be a limited version (constrained performances and features).
You should find the exact release by looking in the bin directory and run (if it exists) mkvdk tool. The program will then display the exact release.

FYI, Verity was the company name. So any sotfware developped by the company was lately named accordingly like Verity Developer's Kit, Verity K2 toolkit (which is a distributed architecture) while VDK was not.

Best regards,

Philippe DELTENRE
pdeltenr@...
Mobile: +33 6 69 58 78 56
SkypeID: pdeltenr

--- En date de : Jeu 5.11.09, rakesh kumar <joinrakee2004@...> a écrit :

De: rakesh kumar <joinrakee2004@...>
Objet: [search_dev] Difference between verity and verity k2
À: search_dev@yahoogroups.com
Date: Jeudi 5 Novembre 2009, 20h20

 

Hi,

I work on verity search engine coming with OpenText LiveServer(formerly RedDot LiveServer) and i am currently using the  verity k2 server.

Can you please tell me what the difference is between verity and verity k2 server.

One thing i can find is he talks about verity JNI or HTTP interface when he doesn't talk about Verity K2 Server. I have no idea what that means..

Please do reply,

Thanks in advance,
Rakesh.


Try the new Yahoo! India Homepage. Click here.


Messages 845 - 859 of 859   Newest  |  < Newer  |  Older >  |  Oldest
Advanced
Add to My Yahoo!      XML What's This?

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help