Oliver was trying to throw him off balance. Another nerf arrow flicked an ear as it flew by and then Oliver raced into the fray, sparring with Shadow from the other side and leaving him open to an attack from Laurel if she could recover.
As strong as the boy was, Oliver wasn't hitting with everything he had, either. This was play-fighting after all.