Something that also sabotages their ability to get back to business would be good. Illusions or curses that make it seem like the space is haunted. Tamper with the cat plates so Umbridge can’t get comfortable anywhere. Pranking any space they try to move into.