Gravatar for paldrich@ascedia.com

Question by Paul Aldrich, Apr 7, 2016 11:18 AM

RabbitMQ - None of the specified endpoints were reachable

Hello,

I am trying to install a third party plugin for Sitecore (Clay Tablet) on a new instance. This is an international QA instance which we created based on our QA instance. I followed the third party plugin installation instructions correctly, yet I am seeing Coveo/RabbitMQ errors in the logs at the exact same spot every time I try the installation. Specifically the error I am getting repeatedly is - "None of the specified endpoints were reachable". I checked the Coveo Diagnostic page of this instance and everything is showing up green (up and running). I checked the RabbitMQ dashboard and I am not seeing any issues there either.

I am attaching the sitecore log that shows the Clay Tablet install process. I have thought of contacting Clay Tablet but this seems more like a Coveo issue than an issue with the plugin (I could be wrong). One of my co-workers noticed that when trying to run an index, the process just spins. It seems like there is something wrong with our Coveo setup on international QA (regular QA works fine).

Any advice would be greatly helpful, thanks.

EDIT: Looks like the attachment did not work, here are the relevant errors in the log:

ManagedPoolThread #2 17:03:57 ERROR An error while updating occurred
Exception: RabbitMQ.Client.Exceptions.BrokerUnreachableException
Message: None of the specified endpoints were reachable
Source: RabbitMQ.Client
   at RabbitMQ.Client.ConnectionFactory.CreateConnection(Int32 maxRedirects)
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqConnectionFactory.CreateConnection()
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Connect()
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Push(Byte[] p_Object, QueueObjects p_ObjectType)
   at Coveo.AbstractLayer.Communication.Queue.QueueCommunication.Push[T](T p_Object, QueueObjects p_ObjectType)
   at Coveo.AbstractLayer.Communication.CES.CESCommunication.PushDocument(CoveoIndexableItem p_Item, String p_DatabaseName)
   at Coveo.SearchProvider.AbstractProviderUpdateContext.UpdateDocument(Object p_ItemToUpdate, Object p_CriteriaForUpdate, IExecutionContext p_ExecutionContext)
   at Coveo.SearchProvider.AbstractIndexOperations.UpdateDocuments(IProviderUpdateContext p_Context, IIndexable p_Indexable, ProviderIndexConfiguration p_IndexConfiguration)
   at Coveo.SearchProvider.IndexOperations.Update(IIndexable p_Indexable, IProviderUpdateContext p_Context, ProviderIndexConfiguration p_IndexConfiguration)
   at Sitecore.ContentSearch.SitecoreItemCrawler.DoUpdate(IProviderUpdateContext context, SitecoreIndexableItem indexable)
   at Coveo.SearchProvider.ProviderIndexBase.Update(IIndexableUniqueId p_IndexableUniqueId, IndexingOptions p_IndexingOptions, IProviderUpdateContext p_Context, Boolean p_ShouldInitializeAdminModule)
Nested Exception
Exception: System.TimeoutException
Message: Connection to amqp-0-9://localhost:5682 timed out
Source: RabbitMQ.Client
   at RabbitMQ.Client.Impl.SocketFrameHandler_0_9.Connect(TcpClient socket, AmqpTcpEndpoint endpoint, Int32 timeout)
   at RabbitMQ.Client.Impl.SocketFrameHandler_0_9..ctor(AmqpTcpEndpoint endpoint, ObtainSocket socketFactory, Int32 timeout)
   at RabbitMQ.Client.Framing.Impl.v0_9_1.ProtocolBase.CreateFrameHandler(AmqpTcpEndpoint endpoint, ObtainSocket socketFactory, Int32 timeout)
   at RabbitMQ.Client.ConnectionFactory.FollowRedirectChain(Int32 maxRedirects, IDictionary connectionAttempts, IDictionary connectionErrors, AmqpTcpEndpoint[]& mostRecentKnownHosts, AmqpTcpEndpoint endpoint)
ManagedPoolThread #2 17:03:57 ERROR An error while updating multiple ids occurred
Exception: RabbitMQ.Client.Exceptions.BrokerUnreachableException
Message: None of the specified endpoints were reachable
Source: RabbitMQ.Client
   at RabbitMQ.Client.ConnectionFactory.CreateConnection(Int32 maxRedirects)
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqConnectionFactory.CreateConnection()
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Connect()
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Push(Byte[] p_Object, QueueObjects p_ObjectType)
   at Coveo.AbstractLayer.Communication.Queue.QueueCommunication.Push[T](T p_Object, QueueObjects p_ObjectType)
   at Coveo.AbstractLayer.Communication.CES.CESCommunication.PushDocument(CoveoIndexableItem p_Item, String p_DatabaseName)
   at Coveo.SearchProvider.AbstractProviderUpdateContext.UpdateDocument(Object p_ItemToUpdate, Object p_CriteriaForUpdate, IExecutionContext p_ExecutionContext)
   at Coveo.SearchProvider.AbstractIndexOperations.UpdateDocuments(IProviderUpdateContext p_Context, IIndexable p_Indexable, ProviderIndexConfiguration p_IndexConfiguration)
   at Coveo.SearchProvider.IndexOperations.Update(IIndexable p_Indexable, IProviderUpdateContext p_Context, ProviderIndexConfiguration p_IndexConfiguration)
   at Sitecore.ContentSearch.SitecoreItemCrawler.DoUpdate(IProviderUpdateContext context, SitecoreIndexableItem indexable)
   at Coveo.SearchProvider.ProviderIndexBase.Update(IIndexableUniqueId p_IndexableUniqueId, IndexingOptions p_IndexingOptions, IProviderUpdateContext p_Context, Boolean p_ShouldInitializeAdminModule)
   at Coveo.SearchProvider.ProviderIndexBase.Update(IEnumerable`1 p_IndexableUniqueIds, IndexingOptions p_IndexingOptions, IProviderUpdateContext p_Context)
Nested Exception
Exception: System.TimeoutException
Message: Connection to amqp-0-9://localhost:5682 timed out
Source: RabbitMQ.Client
   at RabbitMQ.Client.Impl.SocketFrameHandler_0_9.Connect(TcpClient socket, AmqpTcpEndpoint endpoint, Int32 timeout)
   at RabbitMQ.Client.Impl.SocketFrameHandler_0_9..ctor(AmqpTcpEndpoint endpoint, ObtainSocket socketFactory, Int32 timeout)
   at RabbitMQ.Client.Framing.Impl.v0_9_1.ProtocolBase.CreateFrameHandler(AmqpTcpEndpoint endpoint, ObtainSocket socketFactory, Int32 timeout)
   at RabbitMQ.Client.ConnectionFactory.FollowRedirectChain(Int32 maxRedirects, IDictionary connectionAttempts, IDictionary connectionErrors, AmqpTcpEndpoint[]& mostRecentKnownHosts, AmqpTcpEndpoint endpoint)
ManagedPoolThread #2 17:03:57 ERROR Exception
Exception: System.Reflection.TargetInvocationException
Message: Exception has been thrown by the target of an invocation.
Source: mscorlib
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.Reflection.MethodBase.Invoke(Object obj, Object[] parameters)
   at (Object , Object[] )
   at Sitecore.Pipelines.CorePipeline.Run(PipelineArgs args)
   at Sitecore.Jobs.Job.ThreadEntry(Object state)
Nested Exception
Exception: RabbitMQ.Client.Exceptions.BrokerUnreachableException
Message: None of the specified endpoints were reachable
Source: RabbitMQ.Client
   at RabbitMQ.Client.ConnectionFactory.CreateConnection(Int32 maxRedirects)
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqConnectionFactory.CreateConnection()
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Connect()
   at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Push(Byte[] p_Object, QueueObjects p_ObjectType)
   at Coveo.AbstractLayer.Communication.Queue.QueueCommunication.Push[T](T p_Object, QueueObjects p_ObjectType)
   at Coveo.AbstractLayer.Communication.CES.CESCommunication.PushDocument(CoveoIndexableItem p_Item, String p_DatabaseName)
   at Coveo.SearchProvider.AbstractProviderUpdateContext.UpdateDocument(Object p_ItemToUpdate, Object p_CriteriaForUpdate, IExecutionContext p_ExecutionContext)
   at Coveo.SearchProvider.AbstractIndexOperations.UpdateDocuments(IProviderUpdateContext p_Context, IIndexable p_Indexable, ProviderIndexConfiguration p_IndexConfiguration)
   at Coveo.SearchProvider.IndexOperations.Update(IIndexable p_Indexable, IProviderUpdateContext p_Context, ProviderIndexConfiguration p_IndexConfiguration)
   at Sitecore.ContentSearch.SitecoreItemCrawler.DoUpdate(IProviderUpdateContext context, SitecoreIndexableItem indexable)
   at Coveo.SearchProvider.ProviderIndexBase.Update(IIndexableUniqueId p_IndexableUniqueId, IndexingOptions p_IndexingOptions, IProviderUpdateContext p_Context, Boolean p_ShouldInitializeAdminModule)
   at Coveo.SearchProvider.ProviderIndexBase.Update(IEnumerable`1 p_IndexableUniqueIds, IndexingOptions p_IndexingOptions, IProviderUpdateContext p_Context)
   at Coveo.SearchProvider.ProviderIndex.Update(IEnumerable`1 p_IndexableUniqueIds, IndexingOptions p_IndexingOptions)
Nested Exception
Exception: System.TimeoutException
Message: Connection to amqp-0-9://localhost:5682 timed out
Source: RabbitMQ.Client
   at RabbitMQ.Client.Impl.SocketFrameHandler_0_9.Connect(TcpClient socket, AmqpTcpEndpoint endpoint, Int32 timeout)
   at RabbitMQ.Client.Impl.SocketFrameHandler_0_9..ctor(AmqpTcpEndpoint endpoint, ObtainSocket socketFactory, Int32 timeout)
   at RabbitMQ.Client.Framing.Impl.v0_9_1.ProtocolBase.CreateFrameHandler(AmqpTcpEndpoint endpoint, ObtainSocket socketFactory, Int32 timeout)
   at RabbitMQ.Client.ConnectionFactory.FollowRedirectChain(Int32 maxRedirects, IDictionary connectionAttempts, IDictionary connectionErrors, AmqpTcpEndpoint[]& mostRecentKnownHosts, AmqpTcpEndpoint endpoint)
Gravatar for jflheureux@coveo.com

Comment by Jean-François L'Heureux, Apr 7, 2016 2:02 PM

Is looks strange to me that your RabbitMQ endpoint scheme is "amqp-0-9". It's normally only "amqp". Can you verify the <QueueUri> element value in your Coveo.SearchProvider.config file?

3 Replies
Gravatar for paldrich@ascedia.com

Answer by Paul Aldrich, Apr 7, 2016 2:56 PM

Hi everyone,

A co-worker figured out this one for me. He had to change the app pool identity the Sitecore instance uses from ApplicationPoolIdentity -> Network Service and that stopped the errors from occurring in the logs.

Thanks, Paul

Gravatar for sbelzile@coveo.com

Answer by Sébastien Belzile, Apr 7, 2016 11:38 AM

You say that the error occurs when during the installation? Have you tried disabling Coveo, installing the module, then re-enabling Coveo?

Gravatar for hetal.dave@verndale.com

Answer by hdvti, Nov 8, 2017 7:50 PM

I am running as my AD account and still getting this error.

Message: None of the specified endpoints were reachable Source: RabbitMQ.Client at RabbitMQ.Client.ConnectionFactory.CreateConnection(Int32 maxRedirects) at Coveo.AbstractLayer.Communication.Queue.RabbitMqConnectionFactory.CreateConnection() at Coveo.AbstractLayer.Communication.Queue.RabbitMqCommunication.Connect() at Coveo.AbstractLayer.Communication.Queue.QueueCommunication.Connect() at Coveo.AbstractLayer.Communication.CES.CESCommunication.Initialize() at Coveo.SearchProvider.ProviderIndexBase.Refresh(IIndexable p_IndexableStartingPoint, IndexingOptions p_IndexingOptions, IProviderUpdateContext p_Context, Action`1 p_CrawlerAction) Nested Exception Exception: System.NotSupportedException Message: Stream does not support writing. Source: mscorlib at System.IO.__Error.WriteNotSupported() at System.IO.BufferedStream.Write(Byte[] array, Int32 offset, Int32 count) at RabbitMQ.Client.Impl.SocketFrameHandler_0_9.SendHeader() at RabbitMQ.Client.Impl.ConnectionBase.StartAndTune() at RabbitMQ.Client.Framing.Impl.v0_9_1.Connection.Open(Boolean insist) at RabbitMQ.Client.Impl.ConnectionBase..ctor(ConnectionFactory factory, Boolean insist, IFrameHandler frameHandler) at RabbitMQ.Client.Framing.Impl.v0_9_1.ProtocolBase.CreateConnection(ConnectionFactory factory, Boolean insist, IFrameHandler frameHandler) at RabbitMQ.Client.ConnectionFactory.FollowRedirectChain(Int32 maxRedirects, IDictionary connectionAttempts, IDictionary connectionErrors, AmqpTcpEndpoint[]& mostRecentKnownHosts, AmqpTcpEndpoint endpoint)

Ask a question