Your choice also. If it backfires fantastically and little Charlie threatens to disown you both, you two get to pay a therapy bill.
Why not wait until Charlie is older and let him decide if he likes frocks or not while he's in university, when he wakes up one morning wearing one and wondering how the bloody hell that happened.