Skip to content

🐚 docs: add llamay custom endpoint provider - #894

Open
drvt69talati wants to merge 1 commit into
LibreChat-AI:mainfrom
kosa8ai:docs/llamay-endpoint
Open

drvt69talati wants to merge 1 commit into
LibreChat-AI:mainfrom
kosa8ai:docs/llamay-endpoint

Conversation

@drvt69talati

Copy link
Copy Markdown

Summary

  • Adds llamay, a single-binary local inference server, to AI Endpoints: ai_endpoints/llamay.mdx plus a sidebar entry. The page follows the Ollama and Lemonade pages.
  • Covers the custom endpoint YAML, the API-key placeholder, model fetching, and Docker networking. llamay binds to loopback by default, so the Docker section has users bind it with -api-key and put the same key in apiKey, rather than exposing an unauthenticated port.
  • Adds a monochrome LlamayIcon drawn from https://llamay.com/logo.svg, registered as Llamay in lib/icons.tsx.

Disclosure: I work on llamay.

Verification

All against llamay serve -m qwen2.5:0.5b:

  • GET /v1/models with Authorization: Bearer llamay lists the models on disk, so fetch: true works for an endpoint named llamay.
  • POST /v1/chat/completions works with the documented settings, streaming and non-streaming, and so does a short title prompt (titleModel: "current_model").
  • With -api-key, a request with no key returns 401 and a request with Authorization: Bearer <key> returns 200, which matches how LibreChat sends apiKey.
  • Every CLI command on the page (pull, serve -m, models, -addr, -api-key) is checked against llamay help.

I could not run pnpm run typecheck locally. llamay.tsx has the same shape as lemonade.tsx, and the registry edits mirror the Lemonade ones from #759.

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@vercel

vercel Bot commented Oct 29, 2026

Copy link
Copy Markdown

@drvt69talati is attempting to deploy a commit to the LibreChat's projects Team on Vercel.

A member of the Team first needs to authorize it.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant