Skip to content

docs: add DaoXE OpenAI-compatible base_url client example#1237

Open
seven7763 wants to merge 1 commit into
bentoml:mainfrom
seven7763:docs/add-daoxe-openai-compatible-base-url
Open

docs: add DaoXE OpenAI-compatible base_url client example#1237
seven7763 wants to merge 1 commit into
bentoml:mainfrom
seven7763:docs/add-daoxe-openai-compatible-base-url

Conversation

@seven7763

Copy link
Copy Markdown

Summary

Adds a third client example under Start an LLM server showing that the same OpenAI Python SDK pattern used with a local OpenLLM server also works against a remote OpenAI-compatible gateway.

  • New <details> block: Remote OpenAI-compatible gateway (DaoXE)
  • base_url=https://daoxe.com/v1, key via DAOXE_API_KEY, model via env / GET /v1/models
  • Applied to both README.md and README.md.tpl so regenerated docs keep the example

DaoXE notes

  • Multi-model, multi-protocol AI API gateway (OpenAI Chat Completions / Responses, Anthropic Messages, and more). This example uses OpenAI Chat Completions only.
  • Model IDs are account-scoped — list with client.models.list() or see catalog; no hard-coded public model IDs.
  • Not available in mainland China.
  • Site: https://daoxe.com · examples: https://github.com/seven7763/DaoXE-AI

I maintain DaoXE.

Test plan

  • README renders the new details section after the LlamaIndex example
  • With a DaoXE key: OpenAI(base_url="https://daoxe.com/v1", api_key=...) chat completion works for an account-visible model ID
  • Local OpenLLM localhost:3000 examples remain unchanged

Show how the same OpenAI Python client used with a local OpenLLM server
can target a remote OpenAI-compatible gateway (DaoXE at https://daoxe.com/v1).

Notes: multi-protocol context; account-scoped model IDs; not available in
mainland China. Updates both README.md and README.md.tpl.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant