functorism / gpt4-tokenizer-visualizer

GPT4 Tokenizer Visualizer

https://react-ts-h9yrjh.stackblitz.io/

gpt4 tiktoken tokenizer visualization

GPT4 Tokenizer Visualizer

Like https://platform.openai.com/tokenizer but for GPT4

Screenshot 2023-05-21 at 17 26 06

Edit on StackBlitz ⚡️

About

GPT4 Tokenizer Visualizer

https://react-ts-h9yrjh.stackblitz.io/

gpt4 tiktoken tokenizer visualization

Languages

Language:TypeScript 72.6%Language:CSS 26.8%Language:HTML 0.5%