Brexit worries have overshadowed even the Bank of England’s positive outlook and weighed heavily on the Pound Sterling.