I wonder if the issue is not Internet Explorer but rather Windows 10 Edge browser? Windows Edge browser has a thicker looking "E" and is probably the icon you are clicking from your main screen. If you click to select your programs and search for Internet Explorer - test to see if the issue occurs there.
I have just heard of some other issues with people using the Edge browser at work, this is the only reason I bring this up
