On birth rates, the lockdown and above all Brexit, the right is out of touch with the public