E46 326 Passenger side mirror problem

[MyBimmer]

I have the problem to adjust my passenger side mirror, it cannot be adjusted up, down, left and right. My driver side one is O.K. However the memory function is working all right for both mirror. The passenger side one can even tilt down once change to reverse gear. I thought it was the control switch on the driver side handle, so I bought a new one but problem is not solved. I move the slide switch to select either driver side or passenger side, then adjust using the joystick, but the driver side mirror will move in both cases. That is why I thought it was the problem switch in the beginning and bought the new switch. Please advise!!TQMybimmer