GitHub - kayces/gpt_tokenizer: BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs · GitHub

Name		Name	Last commit message	Last commit date
Latest commit History 17 Commits
assets		assets
packages		packages
scripts		scripts
.gitignore		.gitignore
Cargo.toml		Cargo.toml
README.md		README.md
analysis_options.yaml		analysis_options.yaml
melos.yaml		melos.yaml
pubspec.yaml		pubspec.yaml

Repository files navigation

cargo build only re-run tokenizer/build.rs when the symbols are changed
cocopods 1.12.0 supports slice_type: .dylib. see github
build-apple.sh
- if LIBNAME=libgpt_tokenizer.a, everything works well

About

BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs

pub.dev/packages/flutter_gpt_tokenizer

Report repository

Releases

No releases published

Packages

Contributors

Languages

Dart 33.4%
Rust 24.5%
CMake 12.1%
C++ 11.7%
C 8.1%
Shell 6.6%
Other 3.6%