You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have a feature request: It would be interesting to implement the interactive mode (-i option) that is available in llama.cpp, in order to run the starchat-alpha fine-tuned version of the model. I have tested it with the prompt option and works properly, but it would be more useful with the interactive mode.
Activity
nmntz commentedon May 20, 2023
It should be possible by mimicking llama.cpp and main.cpp
Contributions are welcome 🤗