Every few months RAG systems are becoming more and more flexible and reliable. The progress is at a blistering pace.

Currently experimenting with LightRAG and the depth of accuracy and consistency for complex, technical documents (like structural design codes) is extremely impressive.

A newer, even more flexible project (RAG-Anything) has already been built on its foundation.

Where will it end?

There's so much active processing of existing knowledge bases happening, it won't stay compartmentalized forever.

Food for thought!