Gravatar for gkarwchan@getfishtank.ca

Question by gkarwchan, Oct 18, 2016 11:34 AM

Cloud V2 Push API large file

Hi I am using the Push API for large file for the Cloud V2. I have two questions:

I upload a file (not correctly formatted JSON file), and I upload it without error to Amazon, then I call push API for batch file with the fileID, and again, it gives me a success result without any error. But there is nothing in the Source.

Of course, I fix the JSON formatting error, and push again and it works fine, with the data being pushed correctly to the source.

So, the Push service doesn't return any error in case the document was invalid. So, how can I know programmatically that the document being pushed?


My second question is:

how to compress the json content when push upload to amazon?

any example?

1 Reply
Gravatar for dberube@coveo.com

Answer by Dominic Berube, Oct 18, 2016 12:03 PM

Hi,

The call you make to the Push API only returns that it has accepted the message, the processing of the message is done asynchronously so you won't get any formatting error from the document you sent to Amazon.

We are currently working on a feature where you would be able to follow a specific document you sent and see any error occurring in the process.

For your second question, you can use the zlib compression method to compress the json content. If you're using .NET, you can either use an external library (zlib) or use the Deflate compression method and handle the .NET known issue that doesn't output the first header bytes (known issue).

Best regards,

Dom

Ask a question