I've been in a dimension where my own hand grew infinitely smaller hands. Time travel and dimensional issues are the most confusing and messed up subjects. Meddling with any of it is a bad idea, and this accident was inadvertent. I didn't know my prime universe counterpart was going to show up.
There's nothing we can do.
The stone's not being compliant and turning back time by four years runs the risk of breaking time entirely.