Long-term optical/IR variability of the Be/X-ray binary LS V+44 17/RX J0440.9+4431