Decision to leave shrank the British economy by reducing growth and spurring higher inflation, economists say.