THIS IS NOT OFFICIAL REPOSITORY. Hillobar is back with rope, this will be here just for archive. Link to the project

anyway, thanks hillobar for creating rope.

Richard Discord link: Discord

The repo is not maintained, as Im developing my own tool, called FastFaceSwap (actually rope was inspired by it, he told me). But I will help with troubleshooting if you have any issues.

I do not have backup of images, sorry

TL;DR. This tool was created just to make fun to remake memes, put yourself in the movies and other fun things. Some people on the other hand are doing some nasty things using this software, which is not intended way to use this software. Please be a good person, and don’t do harm to other people. Do not hold my liable for anything. This tool is provided for experimental and creative purposes only. It allows users to generate and manipulate multimedia content using deep learning technology. Users are cautioned that the tool's output, particularly deepfake content, can have ethical and legal implications. TL;DR ended ====

Educational and Ethical Use: Users are encouraged to use this tool in a responsible and ethical manner. It should primarily serve educational and artistic purposes, avoiding any malicious or misleading activities that could harm individuals or deceive the public.

Informed Consent: If the tool is used to create content involving real individuals, ensure that you have obtained explicit and informed consent from those individuals to use their likeness. Using someone's image without permission can infringe upon their privacy and rights.

Transparency: If you decide to share or publish content created with this tool, it is important to clearly indicate that the content is generated using deep learning technology. Transparency helps prevent misunderstandings and misinformation.

Legal Considerations: Users are responsible for complying with all applicable laws and regulations related to content creation and sharing. Unauthorized use of copyrighted materials, defamation, and invasion of privacy could lead to legal consequences.

Social Responsibility: Please consider the potential social impact of the content you create. Misuse of this tool could contribute to the spread of misinformation, deepening distrust, and undermining the credibility of authentic media.

No Warranty: This tool is provided "as is," without any warranties or guarantees of any kind, either expressed or implied. The developers of this tool are not liable for any direct, indirect, incidental, special, or consequential damages arising from the use of the tool.

Feedback and Improvement: We encourage users to provide feedback on their experiences with the tool. Your insights can contribute to refining the technology and addressing potential concerns.

By using this tool, you acknowledge that you have read and understood this disclaimer. You agree to use the tool responsibly and in accordance with all applicable laws and ethical standards. The developers of this tool retain the right to modify, suspend, or terminate access to the tool at their discretion.

ORIGINAL README

Rope

Rope implements the insightface inswapper_128 model with a helpful GUI.

Features:

Ugly GUI, but incredible features and fast workflow
Fastest face swapper available
Real-time video player
Occlusion functions

Changes for Rope - Space Worm:

Updated video rendering to use Target Video parameters
Mousewheel scroll on the time bar to control frame position
Added an occluder model (experimental, very fast, make sure you download the new model-link below)
Greatly increased performance for larger videos/multiple faces
CLIP crashing fixed. Add as many words as you like!
Detachable video preview
Fixed most bugs related to changing options while playing. Adjust setting on the fly!
GFPGAN now renders up to 512x512
Status bar (still adding features to this)

Known bugs:

Stop video playback before loading a new video, or bork

Disclaimer:

Rope is a personal project that I'm making available to the community as a thank you for all of the contributors ahead of me. I don't have time to troubleshoot or add requested features, so it is provided as-is. Don't look at this code for example of good coding practices. I am primarily focused on performance and my specific use cases. There are plenty of ways to bork the workflow. Please see how to use below.

Install:

Note: It's only configured for CUDA (Nvidia)

Set up a local venv
- python.exe -m venv venv
Activate your new venv
- .\venv\Scripts\activate
Install requirements
- .\venv\Scripts\pip.exe install -r .\requirements.txt
Place GFPGANv1.4.onnx, inswapper_128_fp16.onnx, and occluder.ckpt in the weights/ directory
Do this if you've never installed roop or Rope (or any other onnx runtimes):
- Install CUDA Toolkit 11.8
- Install dependencies:
- pip uninstall onnxruntime onnxruntime-gpu
- pip install onnxruntime-gpu==1.15.1
Double-click on Rope.bat!

To use:

Run Rope.bat
Set your Target Video, Source Faces, and Video Output folders
- Buttons will be gold if they are not set
- Only places videos or images in the respective folders. Other files my bork it
- Rope creates a JSON file to remember your last set paths
- I like to keep my folders <20 or so items. Helps to organize and reduces load times
Click on the Load Models button to initialize Rope
Select a video to load it into the player
Find Target Faces
- Adds all faces in the current frame to the Found Faces pane
- If a Face is already Found and in the pane, it won't re-add it
Click a Source Face
- Source Face number will appear
Select a Target Face
- Target Faces will show assignment number to the Source Face number
- Toggle a Target Face to unselect and reassign to currently selected Source Face
Continue to select other Source Faces and assign them to Target Faces
Click SWAP to enable face swapping
Click PLAY to play
Click REC to arm recording
- Click PLAY to start recording using the current settings
- Click PLAY again to stop recording, otherwise it will record to the end of the Target Video
Toggle GFPGAN, adjust blending amount
Toggle Diffing, adjust blending amount
Lower the threshhold if you have multiple Source Faces assigned and they are jumping around. You can also try Clearing and Finding new Target Faces (disable SWAP first)
Modify the Masking boundaries
Use CLIP to identify objects to swap or not swap (e.g Pos: face, head; Neg: hair, hand), adjust the gain of the words, and set the blur amount around the items
Change # threads to match your GPU memory (24GB ~9 threads with GFPGAN on, more threads w/o GFPGAN)
- Start with the lowest you think will run and watch your GPU memory.
- Once you allocate memory by increasing # threads, you can't un-allocate it by reducing # threads. You will need to restart Rope.
In general, always stop the video before changing anything. Otherwise, it might bork. Reassigning faces is okay
If it does bork, reload the video (reclick on it). If that doesn't work you'll need to restart

RichardErkhov / rope