7 ms·
Just tried gemma3:4b for structured output and it fails with a strange error ( ollama is the latest): Ollama error: POST predict: Post "http://127.0.0.1:49675/
by seektable 2y ago
Just tried gemma3:4b for structured output and it fails with a strange error ( ollama is the latest):
Ollama error: POST predict: Post "http://127.0.0.1:49675/completion http://127.0.0.1:49675/completion": read tcp 127.0.0.1:49677->127.0.0.1:49675: wsarecv: An existing connection was forcibly closed by the remote host.
Not sure this is Ollama or gemma3:4b problem. At the same time, gemma3:12b works fine for the same API request (100% identical, only difference is model id).
- seektable 2y agolooks like Ollama's issue: https://github.com/ollama/ollama/issues/9686 https://github.com/ollama/ollama/issues/9686, https://github.com/ollama/ollama/issues/9687 https://github.com/ollama/ollama/issues/9687