Statistics of Angular momentum redistribution by mixed modes in evolved low-mass stars. II. Spin-down of the core of red giants induced by mixed modes