Firms fear imports of raw materials will dry up or rise in price when Britain leaves the EU, survey says.