You make valid arguments to chip away at the theory. I mean, for someone so unskilled as many see muggles that is giving them a lot of credit to steal from someone so powerful as a wizard. Then again, it is a muggle stealing it from a baby perhaps. I am not sure of the logistics the Department has theorized.