FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

Keep managed turns on successful fallback by mostlydev · Pull Request #51 · mostlydev/cllama · GitHub

Keep managed turns on successful fallback - #51

Open
mostlydev wants to merge 1 commit into
masterfrom
fix-managed-failover-stickiness
Open

Keep managed turns on successful fallback#51
mostlydev wants to merge 1 commit into
masterfrom
fix-managed-failover-stickiness

Conversation

Copy link
Copy Markdown
Owner

Summary

  • keep the declared fallback sticky for subsequent managed-tool model rounds
  • avoid retrying a timed-out primary after every tool result
  • cover same-provider, different-model policy slots in a regression test

Live evidence

Tiverton’s 2026-08-12 13:00 ET coordinator turn hit the 150s Grok candidate timeout three times in one 10-round managed turn. Each timeout successfully fell back to Haiku, but the next round restarted at Grok, consuming about 450s before completion.

Verification

  • go test ./internal/proxy -run "TestManagedTurnKeepsFallbackStickyAcrossToolRounds|TestManagedDispatchAdvancesToFallbackOnResponseBodyReadError" -count=1
  • go test ./...

mostlydev marked this pull request as ready for review August 12, 2026 17:23
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant


Back | FazBrowse Home | New Git URL