Skip to content

Fix non agentic colocate mode in cli.#1457

Merged
copybara-service[bot] merged 1 commit into
mainfrom
lance-non-agentic
May 13, 2026
Merged

Fix non agentic colocate mode in cli.#1457
copybara-service[bot] merged 1 commit into
mainfrom
lance-non-agentic

Conversation

@wang2yn84
Copy link
Copy Markdown
Collaborator

This PR fixes the non agentic colocate mode that our customer is using. This PR does the following:

  1. Add a new script for non agentic vllm colocate mode
  2. Add support for vllm/sglang config in non agentic cli
  3. Fix the modle name
  4. Fix the base config file to remove the base config, otherwise the cli overwrite won't take effect.

Reference

Colab Notebook

Checklist

  • I have added all the necessary unit tests for my change.
  • I have verified that my change does not break existing code and all unit tests pass.
  • I have added all appropriate doc-strings/documentation.
  • My PR is based on the latest changes of the main branch (if unsure, rebase the code).
  • I have signed the Contributor License Agreement.
  • I have followed Contribution Guidelines.

@wang2yn84 wang2yn84 force-pushed the lance-non-agentic branch from 1947e3c to 9bbfbb3 Compare May 1, 2026 21:50
@wang2yn84 wang2yn84 force-pushed the lance-non-agentic branch 2 times, most recently from ab4e6ec to f49df20 Compare May 13, 2026 00:24
@wang2yn84 wang2yn84 force-pushed the lance-non-agentic branch from f49df20 to 030894c Compare May 13, 2026 00:26
@copybara-service copybara-service Bot merged commit bbfdf6a into main May 13, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants