Repository navigation
Allow custom semantic backend? #115
Description
Hi folks, currently semantic kernel only allows us to use either OpenAI or Azure OpenAI as TextCompletion or Embedding backends. Is it possible for your team to add support for a customized TextCompletion backend? It will be helpful for developers who host their own GPT or AICG service.
use case
// my customized semantic backend
ITextCompletionClient myGossipTextClientInstance
IBackendConfig myGossipTextClientConfig
// suggested API to add config to kernel
kernel.Config.AddTextCompletionBackend(myGossipTextClientConfig, myGossipTextClientInstance)
Activity
timlaverty commentedon Mar 20, 2023
Hi Xiaoyun Zhang (@LittleLittleCloud) , thanks for sending feedback. We are actively working on better multi-model and multi-modal support and will have an update on this shortly.
LittleLittleCloud commentedon Mar 20, 2023
Tim Laverty (@timlaverty) Thanks, looking forward to having this functionality in semantic kernel.
dluc commentedon Mar 20, 2023
Xiaoyun Zhang (@LittleLittleCloud) as Tim Laverty (@timlaverty) we're actively working on this.
In the meantime, just in case you are blocked, by the design the kernel allows to plug in any function that implements the ISKFunction interface. So, only if this is urgent, this is one available path to integrate any model not yet supported.
craigomatic commentedon Mar 30, 2023
Devis Lucato (@dluc) This is now supported as of this PR #161 right?
evchaki commentedon Apr 4, 2023
This is now in the main branch, Xiaoyun Zhang (@LittleLittleCloud) thanks for the feedback!
Bump prettier from 3.0.0 to 3.0.1 in /webapp (microsoft#115)