Actually, as far as Africa is concerned, this was precisely the time of total European control of the continent, with Italy occupying Ethiopia 1936-1941.
Although a few scattered dominions had achieved independence before WWII (if we exclude the colonies in the Americas, which belonged to an earlier era of colonialism), the disassembly of the European empires didn't start until the post-war period.