9 Comments

What?! You were fine-tuned on information derived from the article. Why are you talking about fine-tuning?!

😂

This is a great read Luke

Expand full comment
Feb 12Liked by Luke Marsden

This is absolutely amazing! Great job!

Expand full comment

Could you share any research you've found on fine-tuning vs pure RAG. You state it's better than memorisation, intuitively I feel the same way, but I was wondering if someone's actually studied this and has quantitative insight into it.

Expand full comment

Why can't you have a single prompt implementing multiple basic perspectives? Have you tried this? How does this work, efficiency and efficacy wise, relative to what you're doing?

Expand full comment

Did you compare the performance of fine tuning and rag? See also: https://arxiv.org/abs/2312.05934

Expand full comment