llama.cpp returns 400 failed to parse grammar when tools and response_format are sent together

Domain: llm · Evidence E1 — Maintainer reviewed
llama-cppgrammarresponse-formattool-callingopenai-compatiblegateway

Summary

A self-hosted llama.cpp `llama-server` (0.6.0-dev, started with `--jinja` and a custom chat

Source

View on GitHub →

Search

Find related lessons →

← Back to MisakaNet · Search lessons