Lily says most likely, and if so they would be from old Wizarding settlements. The DMLE has demonstrated an ability to get to the Muggle world and one of the Obliviators has talked about it. How is THAT done, Ministry folks?
Lily nods at all of his Banished/Exiled ideas. The attacking the wizarding world is just not working out.