Emacs has some packages that interface with Ripgrep; e.g. refer to this post in this forum. I use both consult-grep and rg.el.
I think you have enough tools to start forming your own set up. I’d experiment with the following set up if I had a similarly large volume of knowledge base to start with.
- Have clear separation of your own thoughts and the library of text files and books
- Have a root directory/folder for your notes and library — this way, you can use Ripgrep, etc. to search your notes and library at the same time
- Your own thoughts are written as notes with Org-roam
- Notes can have forward link to the source in your file in your library
- “Internal links” are established among your thoughts, thus among your notes, not among text files in the library
- Optionally use my Org-remark to highlight parts of text files and write “marginal notes” inside Org-roam — this way, you can “add” links from the article to your notes without changing the files in your library (the yellow highlighter in the illustration)
I believe it’s the same model @laotang suggests above.