add model selection backend support#167
Conversation
Signed-off-by: chinmaychahar <chinmay.cc.06@gmail.com>
|
|
|
Great start @chinmaychahar ! I approved the pipeline to run. Let me know if you have any issues with the automated pipelines. |
|
Thanks! I'll take a look at the failing tests |
Signed-off-by: chinmaychahar <chinmay.cc.06@gmail.com>
|
I removed the server-side caching, made sens that the frontend query cache handles that already, let me know if anything else needs changing |
jspada200
left a comment
There was a problem hiding this comment.
Looks good to me! I wish the openai API had a better way to filter the models but it looks like the only way is the way you did it! This PR looks good, just needs to have the pipeline resolved
|
Thanks! I'll take an action idea to fix the current code format failure. And then get started on the frontend changes if there are no other comments |
Signed-off-by: Chinmay <chinmay.cc.06@gmail.com>
Summary
Add backend support for user-selectable LLM models (Issue - #87).
GET /modelsendpointmodelfield onPOST /generate-noteto override the server defaultpreferred_modelpersisted in user settings (MongoDB)Testing
How I Tested
make testand all backend tests passbackend/tests/llm_providers/test_model_selection.pyGET /modelsendpoint returns expected shape via test clientpreferred_modelfield persists and returns correctly in user settings endpoints