It's more fair than keeping things as they are and letting him think you're happy. Or breaking up for the sake of a wife he may never see again. The station doesn't allow for completely fair, or you'd both be at the same stage in life. Have you told him how you feel?
It's not silly. Baby stuff can be confusing for anyone.