You should not need to delete the folder every time. If you find that you often need to do it then probably there is something unusual about your display configuration. Do you use multiple screens?
Slicer saves your window positions by default. If you change your display configurations (sometimes unplug a monitor, change resolution, etc.) then the windows might be restored in invalid positions.
If you often change your screen configuration then it may make sense to disable “Save user interface size and position on exit” option in menu: Edit → Application settings → Appearance.
If you rarely change your screen configuration then managing your Slicer application settings file (Slicer.ini) can help. For example, you could save a settings file that you use for a single screen and another settings file that you use for two screens.
Disabling the “Save user interface size and position on exit” option worked!
I don’t usually change the display configuration. It has been the same for the last few months. I am not sure if the system (e.g., OS) does something in the background or not. But this trick worked for me anyway!