6 ms·
Interesting, I wanted to do this for a personal use case (mostly learning), but with PDFs. What's tech stack? I have explored using the AWS AI tools, but it see
by samuria 2y ago
Interesting, I wanted to do this for a personal use case (mostly learning), but with PDFs. What's tech stack? I have explored using the AWS AI tools, but it seems a bit overkill for what I want it to do.
- tompec 2y agoTech stack is a mix of serverless Laravel, with Cloudflare and AWS functions, and some Pinecone for vector storage. Still experimenting on a few things but don't want to over-engineer unless I know where I'm going.
- stevenicr 2y agoGiven that cloudflare spies on traffic and reports to multiple agencies on it's findings, perhaps a breakdown of the chain and the privacy implications of each block in the stack would be beneficial?
- stevenicr 2y agoYa know, a downvote on this pre-aug 2019 would be fine. people still being ignorant about their publicly posted policies 5 years later is annoying.
- lou1306 2y agoIf the PDFS are textual or have OCR, then pdf2text from the Poppler suite ought to be enough? If not, add Tesseract/ocrmypdf to the pipeline?
- kordlessagain 2y agoHere's some code to deal with that: https://github.com/MittaAI/SlothAI/blob/main/SlothAI/lib/processor.py#L2069 https://github.com/MittaAI/SlothAI/blob/main/SlothAI/lib/pro... https://github.com/MittaAI/mitta-community/tree/main/services/gpu/ocr https://github.com/MittaAI/mitta-community/tree/main/service... There's code in there that just reads PDF meta data as well, but you can't always guarantee it's there in a PDF.
- oneshtein 2y agoTry aichat: https://github.com/sigoden/aichat https://github.com/sigoden/aichat