Julius, rules are rules, and unfortunately neither you or I has the power to change them. Some of these rules are tradition but I think some are very good practise. Students of other House have their own common rooms, and there are plenty of unused classrooms, clubs and, dare I say it, the library for you to mingle in.
You could of course petition the Head Master to change them.