While looking through the spyglass (rmb held down), pressing M to open the map results in the map being impossible to close.
Pressing esc while in this state will open the pause menu but everything becomes completely unresponsive, requiring the game to be closed via Task Manager.
