Scripting (like Harpa AI) to enabled advanced RAG
Gathering votes
I would love to be able to create scripts to rewrite or augment prompts or increase interactivity with the user.
For example:
- keyword extraction
- rephrasing
- synonym substitution
- Hypothetical document embeddings (HyDE)
- prompt (re)compression
For a nice list of techniques, [see here] .(https://decodingml.substack.com/p/your-rag-is-wrong-heres-how-to-fix?publication_id=1526003&post_id=153581453&isFreemail=true&r=lob3f)
The book is even better if you're looking for techniques to improve Socrates' retrieval performance. I don't know how much Socrates is doing already, compared to other RAG SaaS providers.
But some of the techniques can be implemented using some kind of scripting system and that would take the development burden off of your engineers.
bestresearch2
4 days ago
Activity
One vote
Categories
Feature
In case you are wondering, the articel I shared is taken from an excerpt of the LLM Engineers Handbook which is a new title on Packt.
It also happens to be in the excellent current MLE Humble Bundle which contains several books on LLM and RAG. https://www.humblebundle.com/books/machine-learning-engineer-masterclass-packt-books
I hope you find these resources useful and can use them to keep improving Socrates!
0 3 days ago Reply