Got it in one! The going theory is that there's something mucking up the timelines: people aren't getting pulled backwards or forwards but sideways, into a divergent timeline, yoinked here instead.