Giters
dqbd
/
tiktoken
JS port and JS/WASM bindings for openai/tiktoken
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
631
Watchers:
6
Issues:
76
Forks:
48
dqbd/tiktoken Issues
Crash on React Native: `SyntaxError: Invalid RegExp: Invalid escape`
Updated
5 months ago
Comments count
2
Support Latest Models
Updated
6 months ago
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
Closed
10 months ago
Comments count
8
Plans for gpt-4-turbo variants?
Closed
7 months ago
Comments count
3
How to count tokens for functions defined in the prompt?
Updated
7 months ago
Comments count
1
Is it reasonable to load and run on the client side ?
Closed
8 months ago
Comments count
1
gpt-3.5-turbo-instruct support
Updated
8 months ago
Comments count
2
Support fine tunned models
Updated
8 months ago
Comments count
1
Cannot find module error
Updated
8 months ago
What does free actually do?
Updated
8 months ago
Comments count
9
missing TiktokenModel for version 3.5-turbo-16k
Updated
8 months ago
Comments count
1
NPM package is very huge
Updated
8 months ago
Comments count
4
Error: null pointer passed to rust
Updated
9 months ago
Comments count
2
Raise error when concurrent to call new Tiktoken
Updated
9 months ago
Comments count
2
Plans for `gpt-3.5-turbo-16k`?
Closed
10 months ago
Comments count
5
WASM file is not included in Next.js Node runtime API routes
Updated
10 months ago
Anthropic models
Closed
10 months ago
Comments count
4
[BUG] library works in test, but fails in dev server
Updated
10 months ago
Comments count
1
When running 1.0.7 there is a Missing tiktoken_bg.wasm error on AWS Lambda typescript
Updated
10 months ago
Comments count
3
js-tiktoken ES5 support
Closed
10 months ago
Comments count
2
Unhandled Runtime Error. Element type is invalid. Received a promise that resolves to: undefined. Lazy element type must resolve to a class or function.
Closed
10 months ago
Comments count
5
@sveltejs/adapter-cloudflare: cloudflare worker (pages) with vite: "default" is not exported by module
Closed
10 months ago
Comments count
11
no such file or directory,_tiktoken_bg.wasm
Updated
10 months ago
Comments count
1
When running 1.0.9 there is a Missing tiktoken_bg.wasm error
Closed
10 months ago
Comments count
1
Does this work in browser ?
Closed
10 months ago
Comments count
2
Fatal crash: BasicBlock requested for unrecognized address
Updated
10 months ago
Comments count
1
NPMJS repository versions are out of date
Updated
10 months ago
Comments count
2
When I look at cl100k_base.json, I don't see the special tokens like <|im_start|>, but when I add them manually I get an error from the wasm
Updated
10 months ago
Comments count
2
[js-tiktoken] memory leak
Updated
a year ago
Comments count
3
I would like to ask you to help me integrate into cloudflare worker for a fee, is anyone willing to help me?
Closed
a year ago
Throws Exception in AWS Lambda
Closed
a year ago
Comments count
4
Document different package options
Updated
a year ago
Comments count
2
Error: mathematics con
Closed
a year ago
Comments count
2
error:fetch is not undefined
Closed
a year ago
Comments count
3
How to import in nodejs server?
Closed
a year ago
Comments count
9
Automatically determine the environment
Updated
a year ago
Comments count
3
How do I pack this into a JS that I can use directly in the browser?
Closed
a year ago
Comments count
3
ERROR: No loader is configured for ".wasm" files: node_modules/.pnpm/@dqbd+tiktoken@1.0.7/node_modules/@dqbd/tiktoken/tiktoken_bg.wasm
Closed
a year ago
Comments count
2
Failed to calculate number of tokens with tiktoken, falling back to approximate count
Closed
a year ago
Comments count
2
[Error] Unexpected character '' (Note that you need plugins to import files that are not JavaScript)
Closed
a year ago
Comments count
4
cl100k_base vocabulary export
Closed
a year ago
Comments count
2
irrecoverable crash after multiple calls to encoding_for_model()
Closed
a year ago
Comments count
2
Will there be support for deno deploy + esm.sh
Updated
a year ago
Comments count
6
Extending special tokens on lite package
Closed
a year ago
Comments count
4
Error: ENOENT: no such file or directory, open '/workspace/ChatGPT-Next-Web/.next/server/app/tiktoken_bg.wasm'
Closed
a year ago
Comments count
9
Vercel edge runtime: Module not found
Closed
a year ago
Comments count
5
decode issue
Closed
a year ago
Comments count
2
cl100k_base issue
Closed
a year ago
Comments count
9
Create React App: Unhandled Rejection (TypeError): wasm.__wbindgen_add_to_stack_pointer is not a function
Closed
a year ago
Comments count
5
Crash in Cloudflare Workers / Vercel Edge Runtime
Closed
a year ago
Comments count
1
Previous
Next