Salesforce - how much data is too much
In a Salesforce.com Org I have a custom object that is transactional -- we write ~6m rows to it per month. The object has ~20 fields that I'd like to index. I imagine each row in the Salesforce.com object would constitute one Coveo Document. In terms of data volumes, is six million Coveo Documents per month a little, nothing to worry about, or a problem? Let's say it's a manageable amount; for how many months could I continue to add ~6M Coveo Documents to my index before the data volumes present a performance or capacity issue?
Question 2: let's say I add 150k rows per day and I set Coveo to index daily. How many API queries will Salesforce count? In other words, is my data capacity question above moot simply because Salesforce won't allow the API to extract that much data anyway?
Regarding your question about "how much data is too much": today we have a limit around 30 million items in our cloud index, we are planning to raise that limit to 60 million in late Q1-Q2 2017 timeframe. If you are looking to add 6M items every month, you should be able to keep that pace for 10 months or so.
Note that we are also evaluating other solutions that would raise the item limit much higher but I don't have a committed timeline to share. We will keep you updated with our progresses.
Hope this helps.