Statistics of The VLT/NaCo large program to probe the occurrence of exoplanets and brown dwarfs at wide orbits. IV. Gravitational instability rarely forms wide, giant planets