5 ms·
How would one finetune for "idea synergy"?
by _lyxd 2y ago
How would one finetune for "idea synergy"?
- cpill 2y agoYou'd need an example set, like all FT'ing
- _lyxd 2y agoIdea synergy is Ill defined, creating a consistent, high quality dataset of the scale required is not easy at all. What is the data, pairs of syngeristic papers? Or are you embedding each paper and finding the closest in "idea space"? LLMs are apt for RAG/fuzzy search. Learning a relevant embedding space that has the fidelity where distances have an interpretation of "idea symergy" is not like "semantic meaning" (I.e. RAG embedding space), otherwise you'd simply get similar papers on the same topics as "synergistic" Maybe I'm confused as to what you mean by idea synergy.