Being "knocked down the priority list" in a romantic relationship means it isn't healthy to start off. There's a time and a place for priorities and in a polyamorous relationship, choosing one partner over another means that you probably shouldn't be in one.