Within same realm as respite (other side of map). No movement stat effects preventing. No prep message appearing. When I click the button nothing happens. Exited and reopened game; did not fix. Selected Travel To Respite from character menu and it worked, but still not letting me travel while in-game.
I'm having the same issue.