11 ms·
You need a lot more power. I found gpt4o struggles doing basic OCR of printed text by hallucinating alot, while tesseract engine (old skool) gets it perfect. Yo
by langcss 2y ago
You need a lot more power. I found gpt4o struggles doing basic OCR of printed text by hallucinating alot, while tesseract engine (old skool) gets it perfect. You need the model to be powerful enough to do everything.
You can work around this by the way by sending the output through a checking stage.
So picture -> gpt4o -> out1, picture -> tesseract -> out2, out1,out2 -> llm.
Might work for sound too.
- killerstorm 2y agoSpeech is inherently easier to represent as a sequence of tokens than a high-resolution image. Best speech to text is already NN transformer based anyway, so in theory it's only better to use a combined model
- falcor84 2y agoInteresting, I've actually been using gpt4o extensively for OCR and didn't encounter any significant issues - could I ask you to please give an example of an image of (otherwise legible) text that it hallucinates on?
- schrodinger 2y agoSame, it's perfect at OCR. Generating an image with text in it however… nope!
- langcss 2y agoI'll send you an email.