I wrote about split points and the need for including section hierarchy in this post: https://ambikasukla.substack.com/p/efficient-rag-with-document-layout?r=ft

I wrote about split points and the need for including section hierarchy in this post: https://ambikasukla.substack.com/p/efficient-rag-with-document-layout?r=ft8uc&utm_campaign=post&utm_medium=web https://ambikasukla.substack.com/p/efficient-rag-with-docume... All this is automated in the llmsherpa parser https://github.com/nlmatics/llmsherpa https://github.com/nlmatics/llmsherpa which you can use as an API over this library.