I do think something like this would be a good idea, reserved for temporal storms specifically. I've thought drifter's being able to phase through walls, or maybe a special kind of drifter that can, or somehow lets surrounding drifter's also get in, (inspired by the phasing visual drifters seem to have in storms) would make storms less cheese-able. It could make some sense with the world slowly being more and more corrupted as time goes on.