I suppose wind noise is something which is quite subjective. What appears to be heavy wind noise to somebody may be perfectly tolerable to another. Sometimes, even for the same person, at different times, your ear's sensitivity may varies e.g. when you just come out from a quiet office or when you just step out from a dischoteque
If you have just recently opened up your door panel, most probably the culprit could be some screws or joints which are not property put back or worse you may see one or two screws or pins lying on your car carpet, knowing very well that it must be the b*#stard fella who have forgotten to screw your door panel back properly.