6 ms·
Actually, we have trained the model to convert to markdown and do semantic tagging at the same time. Eg, the equations will be extracted as LaTeX equations, and
by souvik3333 1y ago
Actually, we have trained the model to convert to markdown and do semantic tagging at the same time. Eg, the equations will be extracted as LaTeX equations, and images (plots, figures, and so on) will be described within the `<img>` tags. Same with `<signature>`, `<watermark>`, <page_number>.
Also, we extract the tables as HTML tables instead of markdown for complex tables.
- jtbayly 1y agoWhat happens to footnotes?
- souvik3333 1y agoThey will be extracted in a new line as normal text. It will be the last line.
- jtbayly 1y agoSo I’m left to manually link them up? Have you considered using something like Pandoc’s method of marking them up? Footnotes are a fairly common part of scanned pages, and markdown that doesn’t indicate that a footnote is a footnote can be fairly incomprehensible.
- agoose77 1y agoI am lazily posting this all over the thread, but do check out MyST Markdown too! https://mystmd.org https://mystmd.org. We handle footnotes as a structured object.
- mgr86 1y agoHave you considered XML. TEI, for example, is very robust and mature for marking up documents.
- esafak 1y agoFirst I heard of it. https://en.wikipedia.org/wiki/Text_Encoding_Initiative https://en.wikipedia.org/wiki/Text_Encoding_Initiative
- mgr86 1y agoUnderstandable. I work in academic publishing, and while the XML is everywhere crowd is graying, retiring, or even dying :( it still remains an excellent option for document markup. Additionally, a lot of government data produced in the US and EU make heavy use of XML technologies. I imagine they could be an interested consumer of Nanonets-OCR. TEI could be a good choice as well tested and developed conversions exist to other popular, less structured, formats.
- jxramos 1y agomaybe even epub, which is xhtml
- agoose77 1y agoDo check out MyST Markdown (https://mystmd.org https://mystmd.org)! Academic publishing is a space that MyST is being used, such as https://www.elementalmicroscopy.com/ https://www.elementalmicroscopy.com/ via Curvenote. (I'm a MyST contributor)
- viraptor 1y agoDo you know why myst got traction, instead of RST which seems to have all the custom tagging and extensibility build in from the beginning?
- agoose77 1y agoMyST Markdown (the MD flavour, not the same-named Document Engine) was inspired by ReST. It was created to address the main pain-point of ReST for incoming users (it's not Markdown!). As a project, the tooling to parse MyST Markdown was built on top of Sphinx, which primarily expects ReST as input. Now, I would not be surprised if most _new_ Sphinx users are using MyST Markdown (but I have no data there!) Subsequently, the Jupyter Book project that built those tools has pivoted to building a new document engine that's better focused on the use-cases of our audience and leaning into modern tooling.