2009-10-06

FileNet Content Engine 3.5 - Verity Indexing Stopped

Here are some pointers regarding indexing and what to look for when comes to figuring out if there are problems.

1) Gather CE trace logs, specifically ContentSearch and ContentRM. Turn on all the trace options/flags for both of these logs.
You can view the ContentRM CE trace log and see the items being queued for indexing by looking for the phrase "sending filename to CBR indexer". If the indexing failed, you'll see "indexing failed, updating all requests".

You should see signs of indexing the ContentRM with a call to IndexIQFile, like this example below.
2005/07/27 22:31:33.418 0ed4 0000 -> CFN_Indexer::IndexIQFile 2005/07/27
22:31:33.418 0ed4 0000 C:\Program Files\FileNet\Content Engine\Log \IndexQueue\000000065{529A1CC0-7CB8-456D-B37D-51D05248E179}001000
{0C3C9546-8729-4DB3-A567-85DD4260E93A}.IQ

2) Verity SHOULD log errors to ContentSearch trace if there is a problem with indexing a specific item.

If a Verity Indexing submit request fails there will be an error in the event log 'An error occurred in a Verity VDK method call.' on the File Store Service computer. To get detailed info the best place to start is the ContentSearch trace, which will contain output from the Verity call-backs. Normally Verity (through the VDK, CS used K2) doesn't fail the submit request if files are missing, or can't be indexed - it logs it in the callbacks and returns success.

3) Check the sysinfo log (under the indexing folder in the file store
physical location, typically : C:\\
\index\fs0
Look for errors “unable to open” and UNC paths. Permissions errors can indicate that the user that is running the FSS may not have adequate permissions to the FileStore folder (see step 10).

4) Look in same folder : C:\\\index\fs0
“lock” files .lck. Believe that removing them from that folder may release the indexing mechanism if it was locked by Verity when it hit a previous error. I.e. Collection.lck

5) If nothing is being indexed, check the indexing folder “parts” folder for current entries (this is a bit more difficult if there are multiple indexes since you’ll have to check every one of them). Check that the files have recent date time stamps. If they are rather old and yet the system has been up for a while, the indexing isn’t running correctly.

6) If nothing is being indexed, look on the CE, there is a folder under the installation folder that holds items waiting to be indexed. If the CBR halts for any reason, ...\FileNet\Content Engine\Log\IndexQueue will begin to fill up with files. Once indexing resumes, the number of files in the folders should go back down until it reaches zero (then the indexing process will have caught up with the current system requests).

7) When is indexing completed? The number of files in...\FileNet\Content Engine\Log\IndexQueue will be zero and queue entries such as the following will appear in the ContentSearch CE trace log:

2005/06/10 01:04:13.632 05d4 0000 VdkCollectionSubmit AOK 2005/06/10 01:04:13.632 05d4 0000 VdkCollectionSubmit: \\3lfsusda\fn_fs \FS_FS2_upg\index\fs0 <656>

[Thanks Fintan]

1 comment:

  1. Hi Fintan,

    Could you please let me know when do the files under the \FileNet\Content Engine\Log\IndexQueue has RIQ extension?

    Appreciate your help.

    Thanks,
    Shashi

    ReplyDelete