There are a few OpenIGTLink implementations for Unity. You can try those. There is a summary here. It is quite old but may be usable as a starting point.
In the near future we’ll focus our efforts on driving the HoloLens directly from Slicer using OpenXR to avoid the need to develop a viewer in Unity.