That’s such an American take.

Here in Australia female doctor makes grammatical sense, and woman doctor sounds ridiculous. Woman doctor would have the same assumption as it also has an opposite in man doctor, which sounds equally as ridiculous unlike male doctor.

Now you could say my doctor is a woman and that makes perfect sense whereas my doctor is a female is ferengi.