Not exactly true
"they basically were able to take on all comers until numbers started working against them"
In terms of combat troops they had us (Australians) seriously outnumbered when they tried to take New Guinea but we held our ground at Kokoda, they NEVER broke through, we outlasted them and kept Port Moresby out of their hands.
In the Burma campaign too, the British prevailed in key battles at Kohima (British largely outnumbered) and Imphal (roughly evenly matched)(17,500 british killed or wounded compared to 53,879 japanese killed or wounded).
Important battles like Midway and the Coral Sea were also fairly even match ups.
They could take on all comers when they still had the jump on us, once we dug in and learnt their tactics nuff said.
"I don't need white people hanging around".
Well they kinda do actually, who else would have supplied them with jet fighters and Panther tanks for reverse engineering (which did actually happen BTW).