If you’re relatively new to Azure Service Fabric, then there is a chance you might run into this issue wherein you start debugging your service fabric application in Visual Studio 2015 and you run into this exception.
“Not Authorized to connect”
The thing here to be noted is, when you create a service fabric application in Visual Studio 2015, there are 2 projects that get created: See below screen shot.
You need to set THIS (the Fabric APP – the one with the above logo) as the startup project and NOT the Fabric Service. This will resolve the issue.
Hope this helps!!