You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When calling POST /api/v1/responses with "stream": true, the returned SSE events do not include the output_index field (on response.output_item.* and response.reasoning_text.* events) or the content_index field (on response.content_part.* / response.output_text.* events) that the OpenAI Responses API specifies. Clients that rely on these indices to place streamed deltas into the correct output item/content part (instead of relying purely on event ordering) cannot unambiguously associate deltas with items, and reject the stream as containing "overlapping" or "unindexed" output items.
Non-streaming /api/v1/responses ("stream": false) is unaffected — the final response payload is well-formed.
Since lemonade just proxies llama-server's stream, the real fix needs to land upstream in llama.cpp (most likely via #26013) and then get pulled into lemonade's bundled llama.cpp version. Might be worth linking this issue to #19138/#26013 so it can be tracked/closed once the upstream fix ships, or considered a "won't fix here" pointing upstream.
Activity
yonggang-xiao commentedon Sep 23, 2026
Since lemonade just proxies llama-server's stream, the real fix needs to land upstream in llama.cpp (most likely via #26013) and then get pulled into lemonade's bundled llama.cpp version. Might be worth linking this issue to #19138/#26013 so it can be tracked/closed once the upstream fix ships, or considered a "won't fix here" pointing upstream.