This is an experimental fork of Sawyer Hood's draw a ui. Hopefully some of these changes can make it upstream!
- Changes the preview to an embedded shape that appears on the canvas.
- Only selected shapes are used when generating html.
- One embedded preview can be given back to GPT, with annotations.
- Some other tweaks.
draw-a-ui
This is an app that uses tldraw and the gpt-4-vision api to generate html based on a wireframe you draw.
This works by just taking the current canvas SVG, converting it to a PNG, and sending that png to gpt-4-vision with instructions to return a single html file with tailwind.
Disclaimer: This is a demo and is not intended for production use. It doesn't have any auth so you will go broke if you deploy it.
Getting Started
This is a Next.js app. To get started run the following commands in the root directory of the project. You will need an OpenAI API key with access to the GPT-4 Vision API.
echo "OPENAI_API_KEY=sk-your-key" > .env.local
npm install
npm run dev
Open http://localhost:3000 with your browser to see the result.