Game freeze on black loading screen

Regularly, at least 50% of the time, the game will freeze for myself and my husband (I am the host on our home network) when we try to go through a portal to another realm or fast travel to another realm. Instead of the typical loading screen, all we see is a black screen. Eventually we have to completely exit out of the game using either Task Manager or Stopping the game through Steam, then relaunch to try and travel again. Gameplay at any other time is usually okay, without stuttering or lag.