Jacob Rees-Mogg, the Conservative MP, has said he feels “very silly” for speaking at a black tie dinner hosted by a man who advocates the repatriation of "non-indigenous" Britons, despite being warned of the group’s far-Right links.