Fix uncertainty calculations by removing caching, which was invalid

I made a mistake calculating the uncertainties and caching results. This pull request fixes the issue. Will unfortunately be a bit slower.