klinsmaya/CLIProxyAPI
1
0
Fork 0
mirror of https://gh-proxy.org/https://github.com/klinsmaya/CLIProxyAPI.git synced 2026-11-11 02:46:47 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
cb110ad4fa860844d207331f000d065992a335b2
CLIProxyAPI/internal/runtime
T
History
Luis Pater cb110ad4fa perf(executor): improve token counting by introducing countXAIInputTokens 
- Refactored token counting logic into a reusable `countXAIInputTokens` function for better readability and maintainability.
- Replaced direct encoder usage with structured input handling, including JSON parsing and segment collection.
- Switched tokenizer from `Cl100kBase` to `O200kBase` to support larger contexts.

Closes: #4492
2026-07-22 04:00:51 +08:00
..
executor
perf(executor): improve token counting by introducing countXAIInputTokens
2026-07-22 04:00:51 +08:00