7 ms·
Do you run the models locally? No local model for me manages to get function calling right.
by okeuro49 10mo ago
Do you run the models locally?
No local model for me manages to get function calling right.
- spacecadet 10mo agoAre you using LangGraph tool nodes? I run very small, non-RLHF instruction models with maybe a 2% failure rate on response format matching tool definition. I would also guess you do not have your orchestration and pipe configured correctly.