Search results

Unable to Release Memory Used by Tiktoken Encoding After Setting to None and GC Collect

Status: Open.

#414 In openai/tiktoken;

· kimhyun5u opened on Jul 14, 2025

dead lock

Status: Open.

#413 In openai/tiktoken;

· tiandalu opened on Jul 11, 2025

Support free-threaded python3.13t

Status: Open.

#406 In openai/tiktoken;

· dunwoj-hlevel opened on Jun 3, 2025

Bug in buffer protocol implementation

Status: Open.

#405 In openai/tiktoken;

· mariosasko opened on Jun 1, 2025

Fail to Install on win-arm64

Status: Open.

#403 In openai/tiktoken;

· MrHinsh opened on May 31, 2025

RuntimeError(StackOverflow) with tiktoken.encoding_for_model('gpt-4').encode(txt, disallowed_special=())

Status: Open.

#400 In openai/tiktoken;

· sumitKpandey opened on May 6, 2025

Feature Request: Integrate Token Usage Cost Calculation Based on OpenAI's Pricing

Status: Open.

#375 In openai/tiktoken;

· Programmer-RD-AI opened on Feb 2, 2025

tiktoken under counting tokens for openai text-embedding-3-large

Status: Open.

#366 In openai/tiktoken;

· mattkauffman23 opened on Jan 9, 2025

The license file is not well referenced

Status: Open.

#362 In openai/tiktoken;

· tcosta-travelperk opened on Dec 18, 2024

Community Resource: AutoTikTokenizer - A Bridge Between TikToken and HuggingFace Tokenizers

Status: Open.

#358 In openai/tiktoken;

· bhavnicksm opened on Nov 7, 2024

Whisper

Status: Open.

#354 In openai/tiktoken;

· sine2pi opened on Oct 21, 2024

Add aarch64 musllinux wheel for 0.8.0

Status: Open.

#350 In openai/tiktoken;

· rhuddleston opened on Oct 7, 2024