Open AI API Maturity #973

Activity

1. Jack-Khuu

   added

   Known GapsThese are known Gaps/Issues/Bug items in torchchatThese are known Gaps/Issues/Bug items in torchchat

   on Jul 30, 2024
2. vmpuri commented on Aug 2, 2024

   

   vmpuri

   on Aug 2, 2024

   Contributor

   More actions

   PR 995 addresses some initial concerns. Responses should now be formatted in JSON using the API dataclasses. Here are our functional gaps so far:

   • system_fingerprint/seed implementation is incomplete. We need to figure out a good way to create and consume fingerprints from seeds. For now, the client cannot control reproducibility of the responses.
   • model cannot be selected by the client. The model is selected when starting the server and cannot be changed without exiting the process. The server does not check to ensure the request/response models match
   • Agentic behavior/toolcall functionality is unimplemented. We will focus on getting chat right first, then create entrypoints for tool usecases.

   Behavior Issues

   • Model responses may not respond in the expected manner. See Weird model behaviour on Server/Browser: Looks like it's not using the template #989
3. ywang96 commented on Aug 4, 2024

   

   ywang96

   on Aug 4, 2024

   More actions

   Hello there! I'm curious if supporting OpenAI Vision API is also something you're interested in since it looks like the team does plan to support vision language models from the discussion in #988

   If you do, happy to help!
4. vmpuri

   linked a pull request that will close this issueOpenAI API JSON formatted #995on Aug 6, 2024
5. vmpuri

   linked a pull request that will close this issueOpenai api models endpoint #1000on Aug 6, 2024
6. vmpuri commented on Aug 6, 2024

   

   vmpuri

   on Aug 6, 2024

   Contributor

   More actions

   Hey Roger, thanks for reaching out! We do plan on adding LLaVA support in the coming weeks, and we'd appreciate your help on the API/server components.

   I'm still working on bringing the initial version of the API and server up to spec, but I'll keep this issue updated with my progress.

   👍React with 👍1Reacted by Roger Wang
7. vmpuri commented on Aug 19, 2024

   

   vmpuri

   on Aug 19, 2024

   Contributor

   More actions

   Landed pulls #1035 #1034 #1042 which prove that the basic completion API works as expected with the Python OpenAI API.
8. Jack-Khuu

   added

   enhancementNew feature or requestNew feature or request

   triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

   on Feb 4, 2025
9. Jack-Khuu

   closed this as completedon Feb 4, 2025