Add check for empty choices in response chunks (#738)

2026-06-02 06:14:32 +02:00 · 2026-01-28 05:11:00 +08:00
parent a04167c723
commit 880e7db0d0
1 changed files with 2 additions and 0 deletions
@@ -114,6 +114,8 @@ class Handler:

        try:
            for chunk in response:
+                if not chunk.choices:
+                    continue
                delta = chunk.choices[0].delta

                # LiteLLM uses dict instead of Pydantic object like OpenAI does.