Gravatar for noel.brennan@hpe.com

Question by Noel Brennan, Sep 5, 2018 11:56 AM

Is it possible to provide a url for item content in a coveo source rather than having to push the content to the coveo source?

We have approx. 500K documents (metadata+content) that we push to Coveo. It takes alot of time to push the document content, so we are wondering if there is a way to provide Coveo with a url to the content rather than pushing the content, in order to speed up our push times?

Gravatar for erocheleau@coveo.com

Comment by Etienne, Sep 5, 2018 2:43 PM

What kind of content is it?

You could look at making a sitemap, if it's web content, perhaps?

Gravatar for noel.brennan@hpe.com

Comment by Noel Brennan, Sep 6, 2018 8:17 AM

Its web content. Just to clarify, is it possible to do using the push api, it sounds like it isn't?

1 Reply
Gravatar for jflheureux@coveo.com

Answer by Jean-François L'Heureux, Sep 6, 2018 8:53 AM

With the Push API, it is not possible to avoid uploading the files content.

There are other crawlers that are working the other way with a starting address and pulling the content themselves like the Web or Sitemap crawlers. Of course, the content must be public or a hole in a firewall must be opened for them to reach private content.

Ask a question