We used a Windows Server system as a development PC a couple of years ago. It was not pleasant to use (it looked outdated compared to regular desktop Windows versions and it has some minor differences in behavior that we had to learn), but overall it worked OK.
You may have issues with OpenGL, GPU drivers, may not have virtual reality support, etc., especially now that Slicer requires minimum OpenGL 3.2, so if you don’t have a good reason to use a server version of Windows, then you are probably better off with a regular desktop version.
Thanks for the heads up. My reason for server windows is that, it is what our institution likes to put on vm’s. It looks like 2016 supports adequate opengl, so, I’m going to try it and see what happens.