Gravatar for grant.killian@rackspace.com

Question by grantkillian, Nov 10, 2016 5:03 PM

Coveo Cloud Index Not Updating

We have a Sitecore implementation using Coveo Cloud; we've applied this documentation to enable the "pub Database Search Index". Our pub database is named "PRODCDSWeb" but, otherwise, is no different from the documentation related to "Pub" We see Coveowebindex getting updates after a publish, but we see the and Coveopubindex NOT getting updates.

I can't embed the full configuration here due to the formatting, but I'm happy to email or share otherwise; for now, here's a graphic of the basic areas . . .

We set ContentSearch.VerboseLogging to true and set the timingLevel="high" on events "indexing:start", "indexing:end" . . . when we did a trial publish for item 8906E2B4-95A9-4A71-841C-085DEC54C257 the log reflects this for the coveowebindex:

ManagedPoolThread #15 21:25:13 INFO  [Index=Coveo_web_index] ItemUpdated Coveo_web_index|sitecore://web/{8906E2B4-95A9-4A71-841C-085DEC54C257}?lang=en&ver=1|/Sites/customer/home/offices/us/blah/cary

ManagedPoolThread #15 21:25:13 INFO  [Index=Coveo_web_index] UpdateDependents Coveo_web_index|sitecore://web/{8906E2B4-95A9-4A71-841C-085DEC54C257}?lang=en&ver=1|/Sites/customer/home/offices/us/blah/cary

but for the coveopubindex we see only OnExcludedFromIndex log entries:

ManagedPoolThread #9 21:24:50 INFO  [Index=Coveo_pub_index] OnExcludedFromIndex Coveo_pub_index

So I think the question is where do we get more visibility to the rules around excluding content from an index (or is this a defect in our configuration or the product we're using)?

1 Reply
Gravatar for sbelzile@coveo.com

Answer by Sébastien Belzile, Nov 11, 2016 8:20 AM

Is the content really published in your "PRODCDSWeb"? The first thing I would look at is whether your content from the master DB is indeed published to your "PRODCDSWeb" when you publish.

The OnPublishEndAsynchronous strategy is triggered after a publish to specified DB and will index content based on what has changed.

Is it possible that your publishing target is misconfigured? See Sitecore Scaling guide for details.

Gravatar for jflheureux@coveo.com

Comment by Jean-François L'Heureux, Nov 11, 2016 9:20 AM

I also note that you have 2 strategies on your pub index. You have the strategy that listens to the web database and another one for the pub database. You only need the last one. Your patch should be a "patch instead" instead of a patch that adds a strategy.

Gravatar for grant.killian@rackspace.com

Comment by grantkillian, Nov 11, 2016 10:07 AM

Shouldn't both strategies fire? To quote from https://doc.sitecore.net/sitecoreexperienceplatform/settingupmaintaining/searchandindexing/indexing/indexupdate_strategies "You should not specify more than three update strategies per index for performance reasons"

Gravatar for aasanovic@coveo.com

Comment by Aljosa Asanovic, Nov 11, 2016 10:39 AM

" You can apply multiple update strategies to each index, but the default configuration applies a single strategy to each index. It is especially important to avoid configuring multiple similar update strategies for a single index. "

https://community.sitecore.net/technicalblogs/b/sitecorejohnblog/posts/sitecore-7-index-update-strategies

This relates to Sitecore 7.x but the suggestion is most likely valid for 8.x as well.

Gravatar for jflheureux@coveo.com

Comment by Jean-François L'Heureux, Nov 11, 2016 11:41 AM

You don't need a strategy which updates the web index when you publish to pub. That's nonsense.

Gravatar for grant.killian@rackspace.com

Comment by grantkillian, Nov 11, 2016 1:05 PM

Great point. Here's our patched ShowConfig.aspx output but we still don't see the index updating:

<index id="Coveo_pub_index" type="Coveo.SearchProvider.ProviderIndex, Coveo.SearchProvider" patch:source="Coveo.SearchProvider.Custom.config">
  <param desc="p_Name">$(id)</param>
  <configuration ref="coveo/defaultIndexConfiguration" />
  <locations hint="list:AddCrawler">
    <crawler name="ContentCrawler" type="Sitecore.ContentSearch.SitecoreItemCrawler, Sitecore.ContentSearch">
      <database>PRODCDSWeb</database>
      <root>/sitecore/content</root>
      <stopOnError>true</stopOnError>
    </crawler>
    <crawler name="MediaLibraryCrawler" type="Sitecore.ContentSearch.SitecoreItemCrawler, Sitecore.ContentSearch">
      <database>PRODCDSWeb</database>
      <root>/sitecore/media library/files</root>
      <stopOnError>true</stopOnError>
    </crawler>
  </locations>
  <strategies hint="list:AddStrategy">
    <strategy ref="contentSearch/indexConfigurations/indexUpdateStrategies/onPublishEndAsyncPRODCDSWeb" patch:source="Coveo.SearchProvider.Custom.config" />
  </strategies>
  <propertyStore ref="contentSearch/indexConfigurations/databasePropertyStore" param1="$(id)" />
  <enableItemLanguageFallback patch:source="Coveo.SearchProvider.Custom.config">true</enableItemLanguageFallback>
</index>
Gravatar for jflheureux@coveo.com

Comment by Jean-François L'Heureux, Nov 11, 2016 5:34 PM

Depending on your Sitecore version, there are a few event handler responsible to trigger the strategies. Here are mines in Sitecore 8.0 Update-5:

<event name="publish:end">
  <handler type="Sitecore.ContentSearch.Events.PublishingEventHandler, Sitecore.ContentSearch" method="OnFullPublishEndHandler" patch:source="Sitecore.ContentSearch.config"/>
  <handler type="Sitecore.ContentSearch.Events.PublishingEventHandler, Sitecore.ContentSearch" method="OnPublishHandler" patch:source="Sitecore.ContentSearch.config"/>
</event>

Do you have those?

Ask a question