openai/tiktoken

Python 17,130 1,370

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Recent Commits (0)

No commits tracked yet.

Comments

0 comments

Please sign in to post comments.

Loading comments...