Switching Displays (pc, extend, second) freezes windows

Switching displays will cause windows 8.1 to freeze, leaving me with a black screen where I can see my mouse pointer but that's about it. Only solution is to force reboot the computer. Keyboard shortcuts to reset, do nothing. ie win+x, u, r... should reset but it doesn't do anything, so the system is indeed frozen.

I'm using a laptop and I like to use all the different monitor configurations throughout the day, sometimes I'm in extended mode, sometimes second screen only, sometimes completely away from my desk just using my laptop screen.

I've tested with different monitors, hdmi, display port, removing as many variables as possible to make sure there are no conflicts. Re-installed all graphics drivers etc. Definitely seems like a windows bug.

Has anyone else experienced this or know what might be causing the system to hang whenever I try switching displays? Really annoying!!

Any input is much appreciated