Statistics of LLAMA: Stellar populations in the nuclei of ultra-hard X-ray-selected AGN and matched inactive galaxies