Ex-Tory chairman Sir Jake Berry has defected to Reform, in the latest blow to the Conservatives.