Edit buttons don't show on LJ-designed layouts. Other people could add buttons for Edit, Goatse, Rickroll, and Random Google Search if they want.
I doubt I know enough CSS to tweak the code to hide the button from people other than mods & the author. I might remove it entirely, making edits only possible from the "internal" post view.