Repository navigation
refactor(ai-gateway): return every inference provider for Kilo-exclusive models - #7772
chrarnoldus wants to merge 1 commit into
Conversation
Code Review SummaryStatus: No Issues Found | Recommendation: Merge Executive SummaryThe Files Reviewed (8 files)
Previous Review Summaries (2 snapshots, latest commit cba96eb)Current summary above is authoritative. Previous snapshots are kept for context only. Previous review (commit cba96eb)Status: No Issues Found | Recommendation: Merge Executive SummaryThe incremental changes resolve both prior suggestions: Files Reviewed (3 files)
Previous review (commit fae4971)Status: 2 Issues Found | Recommendation: Address before merge Executive SummaryThe Overview
Issue Details (click to expand)SUGGESTION
Files Reviewed (8 files)
Reviewed by deepseek-v4.1-flash-1017 · Input: 58.9K · Output: 12.1K · Cached: 1.1M Review guidance: REVIEW.md from base branch |
cba96eb to
8fc4624
Compare
Summary
getInferenceProviderreturned a single provider. When a Kilo-exclusive model had more than one entry ininference_provider_restriction, it returnednull, so such a model was:inference_provider_idsin the catalogprovider.only/provider.ignorecheckIt is now
getInferenceProviders, which returns every distinct provider that may serve the model:Callers updated:
inference_provider_ids.checkExclusiveModelProviderAllowed: allows the request when any provider survivesonly/ignore, and names every provider in the 403.Every current exclusive model has zero or one restriction entry, so today's behavior does not change. This is a prep PR for #7291, where public custom LLMs declare several inference providers.
Verification
Visual Changes
N/A
Reviewer Notes
Unit tests cover multi-provider allow/deny in
checkExclusiveModelProviderAllowed, plus multi-provider and repeated restriction entries ingetInferenceProviders.