Giters
dqbd
/
tiktoken
JS port and JS/WASM bindings for openai/tiktoken
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
705
Watchers:
6
Issues:
83
Forks:
53
dqbd/tiktoken Issues
It doesn't support new model "o1-mini" and "o1-preview"
Closed
3 days ago
Comments count
8
WASM file is not included in Next.js Node runtime API routes
Closed
4 days ago
no such file or directory,_tiktoken_bg.wasm
Closed
4 days ago
Comments count
1
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
Closed
a year ago
Comments count
8
Document different package options
Closed
4 days ago
Comments count
2
Error: null pointer passed to rust
Updated
7 days ago
Comments count
4
NPM package is very huge
Updated
9 days ago
Comments count
6
missing example code for js-tiktoken
Updated
16 days ago
Comments count
1
recursive use of an object detected which would lead to unsafe aliasing in rust
Updated
a month ago
[BUG] library works in test, but fails in dev server
Closed
2 months ago
Comments count
1
NPMJS repository versions are out of date
Closed
2 months ago
Comments count
2
An error occurred during the deployment of the Vercel edge function
Closed
2 months ago
Comments count
2
Missing ranks files from js-tiktoken
Closed
2 months ago
Comments count
2
Add `gpt-4o-mini` model
Closed
2 months ago
Comments count
2
How to support Llama 3?
Closed
2 months ago
Comments count
1
missing TiktokenModel for version 3.5-turbo-16k
Closed
2 months ago
Comments count
2
gpt-3.5-turbo-instruct support
Closed
2 months ago
Comments count
2
gpt-4o-mini Error: Unknown model at getEncodingNameForModel
Closed
2 months ago
Comments count
1
Add gpt-4o-2024-08-06 Model
Closed
2 months ago
Comments count
1
Using Tiktoken WASM in React Environment
Closed
3 months ago
React native error SyntaxError: Invalid RegExp: Invalid escape] in react native expo.
Updated
3 months ago
Add support for the newest Open AI embeddings models
Updated
3 months ago
Comments count
2
Add `gpt-4o` support
Closed
4 months ago
Comments count
1
Add `gpt-4.5-turbo` support
Closed
4 months ago
Performance
Updated
6 months ago
Add `gpt-4-turbo` support
Closed
6 months ago
Cannot find module error
Updated
7 months ago
Comments count
1
Add decode_with_offsets function (or PR guidance request)
Updated
7 months ago
Memory access out of bounds
Updated
7 months ago
Comments count
3
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
Updated
8 months ago
Comments count
1
'TextEncoder' is not defined - MongoDB Functions
Updated
8 months ago
Comments count
1
Support Latest Models
Closed
8 months ago
Comments count
1
Add `gpt-4-turbo-preview` to `TiktokenModel`
Closed
8 months ago
Comments count
3
Crash on React Native: `SyntaxError: Invalid RegExp: Invalid escape`
Updated
9 months ago
Comments count
2
Plans for gpt-4-turbo variants?
Closed
10 months ago
Comments count
3
How to count tokens for functions defined in the prompt?
Updated
a year ago
Comments count
1
Is it reasonable to load and run on the client side ?
Closed
a year ago
Comments count
1
Support fine tunned models
Updated
a year ago
Comments count
1
What does free actually do?
Updated
a year ago
Comments count
9
Raise error when concurrent to call new Tiktoken
Updated
a year ago
Comments count
2
Plans for `gpt-3.5-turbo-16k`?
Closed
a year ago
Comments count
5
When running 1.0.7 there is a Missing tiktoken_bg.wasm error on AWS Lambda typescript
Updated
a year ago
Comments count
3
js-tiktoken ES5 support
Closed
a year ago
Comments count
2
When running 1.0.9 there is a Missing tiktoken_bg.wasm error
Closed
a year ago
Comments count
1
Does this work in browser ?
Closed
a year ago
Comments count
2
Fatal crash: BasicBlock requested for unrecognized address
Updated
a year ago
Comments count
1
When I look at cl100k_base.json, I don't see the special tokens like <|im_start|>, but when I add them manually I get an error from the wasm
Updated
a year ago
Comments count
2
[js-tiktoken] memory leak
Updated
a year ago
Comments count
3
I would like to ask you to help me integrate into cloudflare worker for a fee, is anyone willing to help me?
Closed
a year ago
Throws Exception in AWS Lambda
Closed
a year ago
Comments count
4
Previous
Next