Nobody is asking whether the fact being retrieved is actually true.
Retrieval correctness is not factual correctness.
The fix isn't a better model. It's a text file where you write down what you already know. 30 seconds. One correction. Every future output gets better.
I wrote about how I actually do this, why I think about reports like code commits, and the Sisyphus problem of building context.