5 ms·
Are you using anything like Llamaindex internally or did you write it from scratch without the assistance form a helping wrapper like this?
by tibanne 3y ago
Are you using anything like Llamaindex internally or did you write it from scratch without the assistance form a helping wrapper like this?
- yuhongsun 3y agoWe use LlamaIndex very sparingly. Specifically the context aware document chunking functionality is via LlamaIndex. We couldn't use the more involved pipelines because we needed significant custom logic to enforce permissions, filters (like time filter, source filter, document-set filters), and other complexities. At that point, it's easier to write from scratch rather than conform to expectations of these third party libraries.
- tibanne 3y agoI was considering starting a project just like this using Llamaindex but I think I'll give yours a try first before going that route. Looks good. Thank you.
- yuhongsun 3y agoI think these developer platforms like LlamaIndex and Langchain are super great for prototyping and understanding the crowdsourced best approaches in solving these new LLM related challenges. Depending on how custom the pipelines need to be, you'll either find that you've saved a huge amount of time using these libraries, or you'll find that you have no option but to switch off and build from scratch.
- tibanne 3y agoThat makes sense. It was my fear that I'd start with a wrapper that helps but end with a wrapper that hurts. Good to know that it's still worth experimenting with these for prototyping and discovery. I'm guessing that there will still be components of them that you can use in a product if you don't want to implement something quite specific yourself.