The Activations of Fae artifacts seems bugged

It's not only in the Fae-vaults that this happens, that you cannot activate the artifact to open the portals. It also happened in the boss fights, latest one was Yex and the artifact doesn't work after that. Luckily the quests seems to be finished even if you travel back to your respite.
However, doing side quests and opening vaults and trigger the artifacts doesn't work anymore. They did before, don't know what happened. I have restarted the game several times, travelled to respite points and other realms, it doesn't change.