Skip to content

Commit f15f7df

Browse files
committed
Partial sync of codebase
1 parent 00813b3 commit f15f7df

File tree

4 files changed

+9
-3
lines changed

4 files changed

+9
-3
lines changed

CHANGELOG.md

+6
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,12 @@
22

33
This is the changelog for the open source version of tiktoken.
44

5+
## [v0.9.0]
6+
- Support for `o1` and `o3` models
7+
- Better error messages when loading invalid vocabulary files
8+
- Support for encoding to numpy arrays
9+
- Delayed imports when not strictly necessary
10+
511
## [v0.8.0]
612

713
- Support for `o1-` and `chatgpt-4o-` models

Cargo.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[package]
22
name = "tiktoken"
3-
version = "0.8.0"
3+
version = "0.9.0"
44
edition = "2021"
55
rust-version = "1.57.0"
66

pyproject.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[project]
22
name = "tiktoken"
3-
version = "0.8.0"
3+
version = "0.9.0"
44
description = "tiktoken is a fast BPE tokeniser for use with OpenAI's models"
55
readme = "README.md"
66
license = { file = "LICENSE" }

tiktoken/__init__.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,4 @@
55
from .registry import get_encoding as get_encoding
66
from .registry import list_encoding_names as list_encoding_names
77

8-
__version__ = "0.8.0"
8+
__version__ = "0.9.0"

0 commit comments

Comments
 (0)