Skip to content

Switch hello-world and vllm to single-shot once livepeer/go-livepeer#3955 lands #4

Description

@rickstaa

What

Switch the hello-world and vllm examples from the persistent live-runner path to single-shot, once single-shot payment is decided and implemented in livepeer/go-livepeer#3955.

Why

Both are request/response (batch) apps, but they currently use the persistent path (reserve_session then proxy then stop_runner_session) as a workaround, because single-shot mode has no payment yet. The persistent path bills by held open wall clock time (a 402 at reservation plus a 5s LivePaymentProcessor ticker), which over charges short request/response calls and ties billing to how long the session is held rather than the work done.

Blocked on

livepeer/go-livepeer#3955 (bill payments for single-shot live runner calls). This is purely a workaround-removal once the billing model is chosen and shipped.

Changes when unblocked

  • Register the runner with mode="single-shot".
  • Call via the paid single-shot path (target /apps/{runner}/app/{path}), dropping reserve_session and stop_runner_session.
  • Remove the persistent-path workaround from both example clients.

Acceptance

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions