I am sure we all have memories that it would be lovely to forget. It would make life easier. But memory curses are so tricky and if you're not careful easily broken by true love.
The curse eliminated that problem from arising. So, everyone who came over with the curse, resided in Storybrooke.