Update GreenPT: cached-token rates, compression variants, kimi-k3 - #3927
Open
Casburggraaf wants to merge 4 commits into
Open
Update GreenPT: cached-token rates, compression variants, kimi-k3#3927Casburggraaf wants to merge 4 commits into
Casburggraaf wants to merge 4 commits into
Conversation
GreenPT now bills prompt-cache hits at a reduced input rate on these models, so each gains cost.cache_read. Cache writes are not charged, so cost.cache_write is omitted rather than set to zero. glm-5.2 cache_read 0.3135 kimi-k2.6 cache_read 0.2508 kimi-k2.7-code cache_read 0.1881 minimax-m2.5 cache_read 0.0627 The same pass also picks up list-price corrections: kimi-k2.6 moves to 0.7524 / 4.275, kimi-k2.7-code input to 0.9006, and minimax-m2.5 input to 0.1938. glm-5.2's own prices are unchanged. Rates: https://docs.greenpt.ai/prompt-caching and https://docs.greenpt.ai/pricing
Kimi K3 is generally available on GreenPT at 3.762 input, 18.81 output and 0.9405 for cached prompt tokens. GreenPT serves it with text and image input, so the inherited video modality is overridden away. https://docs.greenpt.ai/model-cards
GreenPT serves nine ids that are glm-5.2 carrying a built-in output-compression ruleset: three families (caveman compresses prose, ponytail compresses generated code, honey compresses both) at three intensities (-lite, unsuffixed, -ultra). They are the same upstream model at the same price per token, including the same cached rate, and return fewer output tokens. Each is declared through base_model so cost and limits cannot drift from glm-5.2. https://docs.greenpt.ai/compression-models
The upstream provider withdrew this model and GreenPT no longer serves the id, so requests for it now fail. Marked deprecated rather than deleted so existing configurations still resolve against the catalog.
Contributor
|
No actionable findings. |
Collaborator
|
Are you sure reasoning efforts arent supported at all here? No toggles either? Seems inaccurate to me. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Refreshes the GreenPT catalog added in #3726. Four things changed on our side since that merged: prompt caching shipped, nine compression ids went GA, one model was withdrawn upstream, and a few list prices moved.
No entries are removed and nothing outside
providers/greenpt/is touched. Costs remain USD, converted from GreenPT's EUR list price at 1.14 USD/EUR; files whose price was re-verified for this update carry the later capture date in their top-of-file comment, untouched files keep the original one.1. Cached prompt tokens (
cost.cache_read)GreenPT now bills prompt-cache hits at a reduced input rate.
cost.cache_writeis omitted rather than zeroed: cache writes are not charged at all.cache_readglm-5.2and all nine compression variantskimi-k3kimi-k2.6kimi-k2.7-codeminimax-m2.5These are the only models that discount cache hits; every other GreenPT entry bills input at its normal rate and is left without the field.
2. Price corrections
Our upstream list prices were re-read from the gateway's own catalogue rather than its marketing page, which had been quoting higher figures:
kimi-k2.6kimi-k2.6kimi-k2.7-codeminimax-m2.5glm-5.2prices are unchanged; it only gainscache_read. Untouched entries were deliberately not re-rounded, to keep the diff limited to real changes.3. New:
kimi-k3GA on GreenPT at 3.762 / 18.81, cached 0.9405. Declared through
base_model = "moonshotai/kimi-k3", inheriting the 1,048,576 context. GreenPT serves it with text and image input, so the inheritedvideomodality is overridden away, consistent with howkimi-k2.6is already declared here.4. New: nine compression variants of
glm-5.2glm-5.2-{caveman,honey,ponytail}each in-lite, unsuffixed and-ultra. They are the same upstream model carrying a built-in output-compression ruleset:cavemancompresses prose,ponytailcompresses generated code,honeycompresses both, and the suffix selects intensity. Same price per token (including the cached rate) and the same context; the saving comes purely from generating fewer output tokens.All nine are declared through
base_model = "zhipuai/glm-5.2", so their cost and limits cannot drift from the base entry.5. Deprecated:
kimi-k2.6-fastWithdrawn by the upstream provider; GreenPT no longer serves the id and requests for it fail. Marked
status = "deprecated"rather than deleted, so existing configurations still resolve. Its prices are untouched.Reasoning controls
Unchanged from #3726 and applied to the new entries too: the documented effort enum stays limited to the GreenPT-hosted models whose control is documented first-party (
gemma4,green-r,green-r-raw).kimi-k3and all nine variants are pass-through endpoints whose accepted values we have not verified, so they declarereasoning_options = [].Verification
bun validateis green.bun testshows no failures beyond the 3 pre-existingpackages/sdk/src/snapshot.jsmodule-resolution errors that also fail on a cleandev. Diffing the resolved catalog against the publishedmodels.dev/api.jsonconfirms exactly the 10 additions, the 4 repriced fields, the 15cache_readvalues and the one status change, with nothing else moved.Evidence
reasoning_effortvalues on GreenPT-hosted models