Hm. [There's all sorts of internal commentary and theorizing about the flow of time during inter-dimensional(?) travel and what may have affected that if so.]

If you can get your hands on a spell scroll, then absolutely - a person who doesn't use magic could go travel between and withinside it. Those spell scrolls usually require a lot of specific resources and time to make though, so they're quite rare.