There may still be some other modules we need to exclude, but the following PR allows to safely import slicer in the regular python(.exe) binary included with Slicer:
However, note that the python binary must either be started from the launcher or from a shell with with the necessary environment variables.