Only a small number of businesspeople who voted Brexit now consider Brexit an “economic price worth paying”, a new survey suggests.