Could you share any research you've found on fine-tuning vs pure RAG. You state it's better than memorisation, intuitively I feel the same way, but I was wondering if someone's actually studied this and has quantitative insight into it.
Why can't you have a single prompt implementing multiple basic perspectives? Have you tried this? How does this work, efficiency and efficacy wise, relative to what you're doing?
What?! You were fine-tuned on information derived from the article. Why are you talking about fine-tuning?!
😂
This is a great read Luke
This is absolutely amazing! Great job!
Could you share any research you've found on fine-tuning vs pure RAG. You state it's better than memorisation, intuitively I feel the same way, but I was wondering if someone's actually studied this and has quantitative insight into it.
Why can't you have a single prompt implementing multiple basic perspectives? Have you tried this? How does this work, efficiency and efficacy wise, relative to what you're doing?
Did you compare the performance of fine tuning and rag? See also: https://arxiv.org/abs/2312.05934