Mr Drakeford, who is stepping down next month after five years as First Minister, said Brexit had left Wales a billion pounds worse off and cut off from the rest of the world.