Repository navigation

mtc-inc-bpe

Public

About

Incremental BPE tokenization for all prefixes

Custom properties

7 stars

1 watching

Report repository

Name		Name	Last commit message	Last commit date
.github		.github
src		src
tools		tools
.gitignore		.gitignore
Cargo.toml		Cargo.toml
LICENSE-APACHE		LICENSE-APACHE
LICENSE-MIT		LICENSE-MIT
README.md		README.md
release-plz.toml		release-plz.toml
rustfmt.toml		rustfmt.toml

Repository files navigation

mtc-inc-bpe

Incremental BPE tokenization for all prefixes.

License

© 2025-2026 ModelTC Team (Chielo <mail@chielo.org>)

This project is licensed under either of

at your option.

The SPDX license identifier for this project is MIT OR Apache-2.0.

About

Incremental BPE tokenization for all prefixes

Custom properties

7 stars

1 watching

Report repository

Releases

Packages

Used by

Contributors

Languages