Skip to content

fix(vllm_plugin): fix multimodal registration for offline inference#348

Open
baotran152 wants to merge 1 commit intomicrosoft:mainfrom
baotran152:fix/vllm-multimodal-registration
Open

fix(vllm_plugin): fix multimodal registration for offline inference#348
baotran152 wants to merge 1 commit intomicrosoft:mainfrom
baotran152:fix/vllm-multimodal-registration

Conversation

@baotran152
Copy link
Copy Markdown

  • Wrap dummy audio data in AudioProcessorItems + MultiModalDataItems in
    get_dummy_processor_inputs; plain list caused AttributeError on
    get_processor_data() during KV cache profiling
  • Fix mm_data to mm_data_items due to mismatches with vLLM
  • Add get_data_parser() override on VibeVoiceProcessingInfo with
    target_sr=24000; previous method was on wrong class and never called,
    leaving resampler with target_sr=None on every generate() call"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant