Add Atlas Cloud LiteLLM provider alias - #356
Conversation
|
Resolved the merge conflicts with the current Validation:
|
Rebuilt the Atlas Cloud alias on upstream's reworked LLM lane: - Upstream removed the direct OpenAI-SDK route (`_is_openai_model`, `use_openai_sdk`) and now sends everything through LiteLLM. That deletion is taken as-is; the Atlas support no longer piggybacks on that path. - The old two-value `prepare_litellm_call()` is replaced by two pieces that fit upstream's shape: `_litellm_model()` gains an `atlascloud/` branch that normalizes to the `openai/` wire form, and a new `_atlascloud_kwargs()` supplies api_base/api_key. Both `llm_completion` and `llm_acompletion` merge those kwargs ahead of `_llm_backend`, so an explicit backend still wins. - Tests updated for two upstream behaviour changes: bare model names now get the `openai/` prefix, and completion kwargs carry `max_retries: 0` instead of `temperature: 0`. - README takes upstream's rewrite wholesale. The old Atlas snippet used the retired `model:`/`retrieve_model:` YAML keys and had no place in the new SDK-oriented page; the runnable example lives in pageindex/config.yaml. Signed-off-by: binyangzhu000-sudo <binyangzhu000@gmail.com>
|
Synced with What upstream changed, and how this adapts
README: taken wholesale from upstream. My old snippet used the retired Verification — Disclosure: I work at Atlas Cloud. |
Summary
atlascloud/model alias that routes PageIndex LiteLLM calls through Atlas Cloud's OpenAI-compatible endpointATLASCLOUD_API_KEYand optionalATLASCLOUD_API_BASEonly when Atlas Cloud models are selectedValidation
.venv/bin/python -m compileall pageindex.venv/bin/python -m pytest tests/test_atlascloud_litellm.py tests/test_issue_163.pygit diff --checkqwen/qwen3.5-flashanddeepseek-ai/deepseek-v4-proNo sponsor, logo, credits, or partner sections were added.