He did push Oliver back, but he turned the momentum of the thrust into some sort of somersault move. Enough so that he didn't collide too solidly with the ground and was able to roll out of it into a fighting stance.
And then Shadow and Laurel were gone. Eyes narrowed, Oliver grabbing the nerf bow and arrows as he raced from the room. Even if they couldn't be used to hurt anyone at least he would be able to maybe throw the boy off-guard with them.