I've got a similar problem with the mouse controls.
Sometimes - no idea, what causes this to happen - the view is rotating all the time, sometimes even changing the direction of rotation. I can compensate this by turning the mouse in the opposite direction.
Quitting and restarting the game may help sometimes, but often needs to be repeated several times.
Joystick is a Logitech Wingman extreme digital 3D, mouse is a Logitech MarbleMouse (track ball).