I've set up a very simple Skype for Business 2015 Server deployment with 3 Front End Servers - and no other roles (i.e. no Edge, Persistent Chat, Mediation Server or other trusted apps), but when I do a Start-CSPool, the pool never starts. It just
loops with this status every 1 minute and 5 seconds:
Status of the Servers:
Server Status
Stage Details
------- -------
------ --------
nso071.nsonline.net InProgress Fabric Connection
None
nso072.nsonline.net InProgress Fabric Connection
None
nso073.nsonline.net InProgress Fabric Connection
None
and finally returns the following error:
Start-CsPool : An error occurred while receiving the HTTP response to https://nso071.nsonline.net/LiveServer/UserPinManagement/FabricManagement/. This could be due to the service endpoint binding not using the HTTP protocol. This could also be due to an HTTP
request context being aborted by the server (possibly due to the service shutting down). See server logs for more details.
At line:1 char:1
+ Start-CsPool -poolfqdn pool01.nsonline.net -Verbose
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : InvalidOperation: (:) [Start-CsPool], CommunicationException
+ FullyQualifiedErrorId : Error getting fabric state. For details, see inner exception.,Microsoft.Rtc.Management.Hadr.StartOcsPoolCmdlet
Start-CsPool : Please make sure at least 2 machine(s) are in running or starting state to achieve fabric network ring quorum from the following machine list. Also makes sure Windows Fabric Host Service is running on those machines.
NSO071.NSONLINE.NET
NSO072.NSONLINE.NET
NSO073.NSONLINE.NET
At line:1 char:1
+ Start-CsPool -poolfqdn pool01.nsonline.net -Verbose
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : InvalidOperation: (:) [Start-CsPool], Exception
+ FullyQualifiedErrorId : Not enough seed nodes are running.,Microsoft.Rtc.Management.Hadr.StartOcsPoolCmdlet
I have verified that all my certificates are valid and the Certificate Authority is trusted by all servers in the pool. Each Front End has its own certificate with the proper SAN's, and they all share the OAuth Certificate stored in the CS Management
Store. All the necessary DNS records for the Pool exist - the Pool itself x 3, and records for each server in the pool, as well as the Internal and External Web Services name. I have also verified that the "Windows Fabric Host Service"
is running on all servers in the pool. I have done a clean remove of SfB Server 2015 and a reinstall, but this has not helped me. This is not an upgrade from Lync 2013, it's a new install.
The Event log named "Skype Server" doesn't reveal anything helpful for me in trying to resolve this issue, all it has is lots of:
Event ID 32169 : Server startup is being delayed because fabric pool manager is initializing.
Event ID 32170 : Pool Manager failed to connect to Fabric Pool Manager. Cause: This could happen because insufficient number of Front-Ends are currently active in the Pool.
Event ID 61043 : This process was not able to update its health status.
All of which are to be expected if the Pool has not started.
I noticed that the "Skype for Business Server Front-End" service remains stuck in the "Starting" phase for a very long time, and then finally dies. When it dies, the error returned by the Start-CSPool occurs.
I also noticed that the System log shows "The Windows Fabric Host Service service terminated unexpectedly" 4 seconds after it started, and at the same time that the Start-CsPool was run. This happens on every server in the pool. This service
is set to automatically restart, which it does successfully.
Upon looking at the "Windows Fabric\Admin" log, I noticed lots of errors similar to the following: connection 0x1BBA2070 client-nso071.nsonline.net:5092: failed to connect to 10.111.89.81:5092: 2147943625"
The IP Address shown is itself. It's occurred to me that this is possibly the cause of the issue. The Windows Fabric service listens on port 5090 - not 5092. According to NETSTAT, there is no process which is listening on port 5092.
How do I go about resolving this issue?