Well, back home (I'm from a different world, obviously) our home had a lot of security charms on it. I can check and see if Sam knows what ones are on the complex, I might be able to add to it. My son wasn't actually brought here with me, though, but I have thought about it.
The amulets are shiny, so one possibility to keep a baby from playing with them would be a disillusionment charm. If it blends in with what is around it, perhaps there won't be as much of an attraction to it?