5 ms·
Yeah, GPT 5.6 Sol is very good. Generally, Gemini models remain SOTA for VLM tasks with 3.7-flash at the top. --- That said, considering variables like cost (s
by cpnwaugha 28d ago
Yeah, GPT 5.6 Sol is very good. Generally, Gemini models remain SOTA for VLM tasks with 3.7-flash at the top.
---
That said, considering variables like cost (say, over 100k PDF pages) and accuracy requirements (e.g., construction documents with dense images & tables), Gemini and other SOTA VLMs are expensive and inaccurate, and therefore unsuitable. This is where niche, open-weight, and task-specific OCR/VL models come in.
With a one-line change, you can switch between DeepSeek OCR 2, GLM-OCR, dots.mocr, Paddle OCR VL, PP-OCRv6, etc., and process 100K+ pages for under $60 on VLM Run Gateway
This is why we built VLM Run Gateway, one OpenAI-compatible endpoint for open-weight OCR and VLM models.
Try it out quickly via OpenAI SDK:
```
client = OpenAI(
base_url="https://gateway.vlm.run/v1/openai https://gateway.vlm.run/v1/openai",
api_key="<VLMRUN_API_KEY>",
)
response = client.chat.completions.create(
model="rednote-hilab/dots.mocr",
messages=[{
"role": "user",
"content": [{
"type": "document_url",
"document_url": {"url": "https://.../invoice.pdf"},
}],
}],
extra_body={"document_dpi": 72},
)
```
or via our CLI:
```
pip install vlmrun
vlmrun gw models
vlmrun config set --api-key 'vlmrun' # anon-user, rate-limited
vlmrun gw chat <doc>.pdf -m zai-org/glm-ocr
vlmrun gw chat <doc>.pdf -m zai-org/glm-ocr --json-mode
vlmrun gw chat <doc>.pdf -m deepseek-ai/deepseek-ocr-2
vlmrun gw chat <doc>.pdf -m rednote-hilab/dots.mocr
vlmrun gw chat <doc>.pdf -m paddleocr/pp-ocrv6
```
Docs: https://docs.vlm.run/gateway https://docs.vlm.run/gateway
Catalog: https://docs.vlm.run/gateway/models https://docs.vlm.run/gateway/models
MCP: https://docs.vlm.run/gateway/mcp-server https://docs.vlm.run/gateway/mcp-server
Colab Quickstart: https://colab.research.google.com/drive/1RkuVIyuc5Po-UlcSlFyJCam5tjCm9IHM?usp=sharing https://colab.research.google.com/drive/1RkuVIyuc5Po-UlcSlFy...
Read the full post here: https://huggingface.co/blog/vlm-run/intro-to-vlmrun-gateway https://huggingface.co/blog/vlm-run/intro-to-vlmrun-gateway