Repository navigation
fix(openai): support major-only GPT cache model IDs - #22
Open
JakubSchwenkbeck wants to merge 2 commits into
Open
JakubSchwenkbeck wants to merge 2 commits into
JakubSchwenkbeck wants to merge 2 commits into
Conversation
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
OpenAI GPT-6 model IDs such as
gpt-6-lunado not include a minor version component. The existing cache-capability matcher only recognized IDs matchinggpt-<major>.<minor>, so these models did not receive:{"prompt_cache_options": {"mode": "explicit"}}when using an explicit prompt-cache breakpoint.
This PR updates the matcher to support both:
gpt-<major>.<minor>-..., such asgpt-5.6-lunagpt-<major>-..., such asgpt-6-lunaIt also adds regression coverage for major-only GPT-6 IDs.
Changes
_GPT_VERSION_RE.0.gpt-6-lunato the cache mapping tests.Validation
Origin
This fix addresses a DSPy integration issue where GPT-6 model IDs were sent a
prompt_cache_breakpointwithout the corresponding explicit cache mode.This contribution was prepared with assistance from GitHub Copilot SDK in VS Code.
The behavior was reproduced locally and verified with the focused test suite.