Disastrous if you were both truly away, yes. But from my understanding, the world goes into a temporary pause when you disappear. Meaning, you will return back home to the same point you left and come back as though nothing ever happened.

So I would see no harm in wishing for your father's presence, if his is the presence of someone you want.