Oo.. just found this link that may be of interest. http://www.victoriaspast.com/LifeofVictorianWoman/LifeofVictorianWoman.html It also mentions contraceptive sponges. I know these were used in the ancient world, but I'm going to do a bit of digging to hopefully find a non-poisonous solution that would have be added to it in (neo)Victorian society.
It also mentions rubber as being used to make condoms, but to be honest I don't think they came into common use until much later.