tripplyons / clip-upscaler-and-enhancer

Using OpenAI's CLIP to upscale and enhance images

CLIP Upscaler and Enhancer

Using OpenAI's CLIP to upscale and enhance images

Based on nshepperd's JAX CLIP Guided Diffusion v2.4

Sample Results

Viewport	Original Image (512x512)	Using This Repo (scaled to 1024x1024 in 45 minutes)	Using Waifu2x (scaled to 1024x1024 in a few seconds)
Full Image
Zoomed In

How it works

1. Start with any image.
2. Find CLIP's embeddings of the image.
3. Resize the image to the desired resolution and add some noise.
4. Optimize the resized image for the original image's embeddings (using nshepperd's JAX CLIP Guided Diffusion v2.4).