Skip to content

feat: add Rust CLI with tokenizer models - #2

Merged
eordano merged 3 commits into
mainfrom
rust-cli
Feb 28, 2026
Merged

feat: add Rust CLI with tokenizer models #2
eordano merged 3 commits into
mainfrom
rust-cli

perf: O(n²)→O(n log n) tiktoken BPE, zero-copy trie, smaller tables

f8229db
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar