I can't control it, even as a Servant. If it chooses to show me someone's memories, I'll be left completely vulnerable while the vision plays out, like you said.